Commit ba51acf
authored
Better scenario from-file support (#432)
## Summary
<!--
Include a short paragraph of the changes introduced in this PR.
If this PR requires additional context or rationale, explain why
the changes are necessary.
-->
Allows for scenarios to pass yaml or json formatted synthetic config to
data. Automatically handles conversion from single data to list.
```yaml
---
target: "http://vllm-deployment.kserve-e2e-perf.svc.cluster.local:8000/"
profile: concurrent
rate: [1,2,4,8]
max_seconds: 120
data:
prompt_tokens_min: 10
prompt_tokens_max: 8192
prompt_tokens: 4096
prompt_tokens_stdev: 2048
output_tokens_min: 10
output_tokens_max: 2048
output_tokens: 1024
output_tokens_stdev: 512
```
---
- [x] "I certify that all code in this PR is my own, except as noted
below."
## Use of AI
- [x] Includes AI-assisted code completion
- [ ] Includes code generated by an AI application
- [ ] Includes AI-generated tests (NOTE: AI written tests should have a
docstring that includes `## WRITTEN BY AI ##`)File tree
3 files changed
+52
-9
lines changed- src/guidellm
- benchmark
- data/deserializers
3 files changed
+52
-9
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
33 | 33 | | |
34 | 34 | | |
35 | 35 | | |
36 | | - | |
| 36 | + | |
37 | 37 | | |
38 | 38 | | |
39 | 39 | | |
| |||
116 | 116 | | |
117 | 117 | | |
118 | 118 | | |
| 119 | + | |
119 | 120 | | |
120 | 121 | | |
121 | 122 | | |
| |||
392 | 393 | | |
393 | 394 | | |
394 | 395 | | |
| 396 | + | |
| 397 | + | |
395 | 398 | | |
396 | | - | |
| 399 | + | |
397 | 400 | | |
398 | 401 | | |
399 | 402 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
23 | 23 | | |
24 | 24 | | |
25 | 25 | | |
26 | | - | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
27 | 35 | | |
28 | 36 | | |
29 | 37 | | |
| |||
1142 | 1150 | | |
1143 | 1151 | | |
1144 | 1152 | | |
1145 | | - | |
| 1153 | + | |
| 1154 | + | |
1146 | 1155 | | |
1147 | 1156 | | |
1148 | 1157 | | |
| |||
1669 | 1678 | | |
1670 | 1679 | | |
1671 | 1680 | | |
1672 | | - | |
| 1681 | + | |
1673 | 1682 | | |
1674 | 1683 | | |
1675 | 1684 | | |
| |||
1818 | 1827 | | |
1819 | 1828 | | |
1820 | 1829 | | |
1821 | | - | |
1822 | | - | |
1823 | 1830 | | |
1824 | 1831 | | |
1825 | 1832 | | |
| |||
1838 | 1845 | | |
1839 | 1846 | | |
1840 | 1847 | | |
1841 | | - | |
| 1848 | + | |
1842 | 1849 | | |
1843 | 1850 | | |
1844 | 1851 | | |
| |||
1931 | 1938 | | |
1932 | 1939 | | |
1933 | 1940 | | |
| 1941 | + | |
| 1942 | + | |
| 1943 | + | |
| 1944 | + | |
| 1945 | + | |
| 1946 | + | |
| 1947 | + | |
| 1948 | + | |
| 1949 | + | |
| 1950 | + | |
| 1951 | + | |
| 1952 | + | |
| 1953 | + | |
| 1954 | + | |
| 1955 | + | |
| 1956 | + | |
| 1957 | + | |
| 1958 | + | |
| 1959 | + | |
| 1960 | + | |
1934 | 1961 | | |
1935 | 1962 | | |
1936 | 1963 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
9 | 9 | | |
10 | 10 | | |
11 | 11 | | |
12 | | - | |
| 12 | + | |
13 | 13 | | |
14 | 14 | | |
15 | 15 | | |
| |||
242 | 242 | | |
243 | 243 | | |
244 | 244 | | |
| 245 | + | |
| 246 | + | |
| 247 | + | |
| 248 | + | |
245 | 249 | | |
246 | 250 | | |
247 | 251 | | |
| |||
266 | 270 | | |
267 | 271 | | |
268 | 272 | | |
| 273 | + | |
| 274 | + | |
| 275 | + | |
| 276 | + | |
| 277 | + | |
| 278 | + | |
| 279 | + | |
| 280 | + | |
| 281 | + | |
269 | 282 | | |
270 | 283 | | |
271 | 284 | | |
| |||
0 commit comments