Skip to content

Conversation

@sjmonson
Copy link
Collaborator

@sjmonson sjmonson commented Oct 22, 2025

Summary

Allows for scenarios to pass yaml or json formatted synthetic config to data. Automatically handles conversion from single data to list.

---
target: "http://vllm-deployment.kserve-e2e-perf.svc.cluster.local:8000/"
profile: concurrent
rate: [1,2,4,8]
max_seconds: 120
data:
  prompt_tokens_min: 10
  prompt_tokens_max: 8192
  prompt_tokens: 4096
  prompt_tokens_stdev: 2048
  output_tokens_min: 10
  output_tokens_max: 2048
  output_tokens: 1024
  output_tokens_stdev: 512

  • "I certify that all code in this PR is my own, except as noted below."

Use of AI

  • Includes AI-assisted code completion
  • Includes code generated by an AI application
  • Includes AI-generated tests (NOTE: AI written tests should have a docstring that includes ## WRITTEN BY AI ##)

@sjmonson sjmonson requested a review from markurtz October 22, 2025 20:03
@sjmonson sjmonson marked this pull request as draft October 22, 2025 23:27
@sjmonson sjmonson force-pushed the fix/synthetic_as_dict branch 5 times, most recently from 4c74818 to ed5a019 Compare October 29, 2025 14:06
@sjmonson sjmonson changed the title Attempt to parse synthetic config with model validate Better scenario from file support Oct 29, 2025
@sjmonson sjmonson changed the title Better scenario from file support Better scenario from-file support Oct 29, 2025
@sjmonson sjmonson force-pushed the fix/synthetic_as_dict branch from ed5a019 to 3148467 Compare October 29, 2025 14:14
@sjmonson sjmonson force-pushed the fix/synthetic_as_dict branch from 9a7394b to 398dce6 Compare October 29, 2025 14:41
@sjmonson sjmonson marked this pull request as ready for review October 29, 2025 14:48
Signed-off-by: Samuel Monson <[email protected]>
@sjmonson sjmonson merged commit ba51acf into main Oct 29, 2025
11 of 16 checks passed
@sjmonson sjmonson deleted the fix/synthetic_as_dict branch October 29, 2025 15:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants