Skip to content

[v2] Add support for chunking performance tests, and architectural changes #9485

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 22 commits into
base: v2
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
d6765ba
Progress on benchmarks
aemous Apr 1, 2025
03cd651
Update remove prints.
aemous Apr 1, 2025
607df62
Update request time to be more accurate
aemous Apr 2, 2025
957f6ba
Stage architectural changes that allow more complex benchmark suites.
aemous Apr 4, 2025
62a606d
More progress on performance framework.
aemous Apr 28, 2025
5c1ba4f
More updates/questions
aemous Apr 28, 2025
bc9ce9b
Add chunking support to performance scripts. Refine performance scrip…
aemous May 7, 2025
464143d
Bugfix in chunking code.
aemous May 7, 2025
9cce974
Cleanup data files.
aemous May 7, 2025
7b1e20b
Update performance tests output format.
aemous May 8, 2025
5ce2a28
Clean up performance framework for push.
aemous May 9, 2025
df46a22
Merge branch 'v2' into perf-tests-v2-github
aemous May 9, 2025
4607429
Remove typing
aemous May 9, 2025
f7d9dc1
Cleanup planned tasks.
aemous May 9, 2025
69b0053
Progress towards using decorators to define test cases.
aemous May 9, 2025
e8635be
Add more vision to the skeleton.
aemous May 14, 2025
1368faf
Fix import paths and fix percentage metric name.
aemous May 23, 2025
33d89b5
Adjust dimensions JSON format.
aemous May 27, 2025
5671a8b
Switch from using binary-content key in file literals for JSON Benchm…
aemous May 27, 2025
b6032eb
Develop outline for using decorators for defining performance test ca…
aemous May 27, 2025
4018ae1
Move all Metric creation to within the Summarizer.
aemous May 28, 2025
a90b887
Move results processing from suite to a separate class.
aemous May 28, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 6 additions & 3 deletions scripts/performance/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -245,9 +245,9 @@ the keys below. Each key is required unless specified otherwise.
- Example value: `["s3", "cp", "test_file", "s3://bucket/test_file", "--quiet"]`.
- `dimensions` (list) **(optional)**: Used to specify additional dimensions for
interpreting this metric.
- Each element in the list is an object with a single key-value pair.
The key is the name of the dimension (e.g. `FileSize`), and the value
is the value of the dimension (e.g. `32MB`).
- Each element in the list is an object with the following keys:
- `name` (string): Name of the dimensions
- `value` (string): Value of the dimension
- `environment` (object) **(optional)**: Specifies settings for the environment to run
the command in.
- The environment object supports the following keys:
Expand All @@ -257,6 +257,9 @@ the specified contents.
- Each element is an object with the following keys:
- `name` (string): Name of the file to create
- `content` (string): The contents of the file.
- `mode` (string) **(optional)**: The write mode to use for writing the
file contents.
- Default: `w`
- `files` (list) **(optional)**: Specifies the files that must be
created before executing the benchmark. The files created will be filled with
null bytes to achieve the specified size.
Expand Down
Loading
Loading