What's Changed
- Update docker image to docs by @CatherineSue in #10
- Doc: Set up coversage badge by @CatherineSue in #11
- feat: Support flexible plot configuration by @CatherineSue in #13
- Doc: Update logo and badge alignment by @CatherineSue in #14
- refactor: Update
image-to-texttoimage-text-to-textby @CatherineSue in #12 - fix: Resolve all mypy type errors by @CatherineSue in #17
- [Documentation] Setup MkDocs for genai-bench by @key4ng in #19
- [BUG] Fix left tokens to sample in _sample_text by @YouNeedCryDear in #20
- [core] feature: add multi cloud support by @slin1237 in #15
- [docs] add multi cloud docs by @slin1237 in #22
- [docs] add mkdocs material theme by @slin1237 in #24
- [Docs] Update broken links in README.md by @junliu-mde in #23
- [bugfix] fix mkdocs domain name by @slin1237 in #25
- [bugfix] mkdocs gh pages config inheritance issue by @slin1237 in #26
- [ci] Fix GitHub Pages deployment workflow by @slin1237 in #27
- [docs] update readme hyper links by @slin1237 in #28
- Revert "[BUG] Fix left tokens to sample in _sample_text (#20)" by @slin1237 in #29
- Move config example doc under usage folder by @key4ng in #21
- fix(cli): fix typo in the help message of
--traffic-scenarioby @rudeigerc in #34 - [Frontend] Make HF_TOKEN optional for tokenizer download by @junliu-mde in #33
- [BUG] Fix wrong default threshold for check discrepancy by @YouNeedCryDear in #38
- docs: remove non-existent entry of plot examples in mkdocs by @rudeigerc in #42
- [Misc] Fix output_throughput metrics for single request by @CatherineSue in #40
- docs: add description of
output_latencymetric in the docs by @rudeigerc in #41 - [Bug Fix] OCIModelAuthAdapter.get_credentials() returning wrong object type by @key4ng in #45
- [Core] Add oci genai backend support by @key4ng in #47
- [Bugfix] Fix token-based truncation and document duplication in TextSampler by @CatherineSue in #49
- feat: Add flexible image dataset support and make scenarios optional by @CatherineSue in #51
- bugfix: Fix typing in
ImageDatasetLoaderand num_images check by @CatherineSue in #53 - [bug] fix missing ttft record by @yiakwy-xpu-ml-framework-team in #44
- misc: Support py3.10 by @CatherineSue in #54
- Revert "[Misc] Fix output_throughput metrics for single request (#40)" by @CatherineSue in #55
- [Bugfix] Allow for benchmarking using large images. by @shenoyvvarun in #52
- bugfix: Fix TextSampler sampling logic by @CatherineSue in #58
- Add spawn rate to prevent worker overload in distributed benchmarks by @JimmyWhitaker in #56
- bugfix: Bring back HF dataset logging and scenario for images by @CatherineSue in #61
- [Bugfix] Use image-text-to-text instead of image-to-text by @TJ5 in #59
- [Misc] Improve Excel report handling when performance threshold is not met by @key4ng in #60
- feat: remove use_scenario, add DatasetScenario, make traffic scenario optional by @CatherineSue in #62
- [Docs] Fix errors in docs by @TJ5 in #57
- feat(data): normalize HF dataset types and enable lazy image sampling by @CatherineSue in #63
- [Plot] Rename plot axis label and xlimt start from 0 and update docs by @upfixer in #39
- Revert "[Plot] Rename plot axis label and xlimt start from 0 and update docs" by @CatherineSue in #64
- misc: Fix doc naming and use flexible plot in cli by @key4ng in #65
- Remove hidden cap for data and set general scale start from 0 by @CatherineSue in #66
- [Plot] Revert grid alpha and add TODOs by @CatherineSue in #67
- [CI] Fix release.yml by @CatherineSue in #68
New Contributors
- @key4ng made their first contribution in #19
- @YouNeedCryDear made their first contribution in #20
- @slin1237 made their first contribution in #15
- @junliu-mde made their first contribution in #23
- @rudeigerc made their first contribution in #34
- @yiakwy-xpu-ml-framework-team made their first contribution in #44
- @shenoyvvarun made their first contribution in #52
- @JimmyWhitaker made their first contribution in #56
- @TJ5 made their first contribution in #59
- @upfixer made their first contribution in #39
Full Changelog: v0.0.1...v0.0.2