Skip to content

v0.0.2

Latest

Choose a tag to compare

@CatherineSue CatherineSue released this 12 Aug 00:50
· 17 commits to main since this release

What's Changed

  • Update docker image to docs by @CatherineSue in #10
  • Doc: Set up coversage badge by @CatherineSue in #11
  • feat: Support flexible plot configuration by @CatherineSue in #13
  • Doc: Update logo and badge alignment by @CatherineSue in #14
  • refactor: Update image-to-text to image-text-to-text by @CatherineSue in #12
  • fix: Resolve all mypy type errors by @CatherineSue in #17
  • [Documentation] Setup MkDocs for genai-bench by @key4ng in #19
  • [BUG] Fix left tokens to sample in _sample_text by @YouNeedCryDear in #20
  • [core] feature: add multi cloud support by @slin1237 in #15
  • [docs] add multi cloud docs by @slin1237 in #22
  • [docs] add mkdocs material theme by @slin1237 in #24
  • [Docs] Update broken links in README.md by @junliu-mde in #23
  • [bugfix] fix mkdocs domain name by @slin1237 in #25
  • [bugfix] mkdocs gh pages config inheritance issue by @slin1237 in #26
  • [ci] Fix GitHub Pages deployment workflow by @slin1237 in #27
  • [docs] update readme hyper links by @slin1237 in #28
  • Revert "[BUG] Fix left tokens to sample in _sample_text (#20)" by @slin1237 in #29
  • Move config example doc under usage folder by @key4ng in #21
  • fix(cli): fix typo in the help message of --traffic-scenario by @rudeigerc in #34
  • [Frontend] Make HF_TOKEN optional for tokenizer download by @junliu-mde in #33
  • [BUG] Fix wrong default threshold for check discrepancy by @YouNeedCryDear in #38
  • docs: remove non-existent entry of plot examples in mkdocs by @rudeigerc in #42
  • [Misc] Fix output_throughput metrics for single request by @CatherineSue in #40
  • docs: add description of output_latency metric in the docs by @rudeigerc in #41
  • [Bug Fix] OCIModelAuthAdapter.get_credentials() returning wrong object type by @key4ng in #45
  • [Core] Add oci genai backend support by @key4ng in #47
  • [Bugfix] Fix token-based truncation and document duplication in TextSampler by @CatherineSue in #49
  • feat: Add flexible image dataset support and make scenarios optional by @CatherineSue in #51
  • bugfix: Fix typing in ImageDatasetLoader and num_images check by @CatherineSue in #53
  • [bug] fix missing ttft record by @yiakwy-xpu-ml-framework-team in #44
  • misc: Support py3.10 by @CatherineSue in #54
  • Revert "[Misc] Fix output_throughput metrics for single request (#40)" by @CatherineSue in #55
  • [Bugfix] Allow for benchmarking using large images. by @shenoyvvarun in #52
  • bugfix: Fix TextSampler sampling logic by @CatherineSue in #58
  • Add spawn rate to prevent worker overload in distributed benchmarks by @JimmyWhitaker in #56
  • bugfix: Bring back HF dataset logging and scenario for images by @CatherineSue in #61
  • [Bugfix] Use image-text-to-text instead of image-to-text by @TJ5 in #59
  • [Misc] Improve Excel report handling when performance threshold is not met by @key4ng in #60
  • feat: remove use_scenario, add DatasetScenario, make traffic scenario optional by @CatherineSue in #62
  • [Docs] Fix errors in docs by @TJ5 in #57
  • feat(data): normalize HF dataset types and enable lazy image sampling by @CatherineSue in #63
  • [Plot] Rename plot axis label and xlimt start from 0 and update docs by @upfixer in #39
  • Revert "[Plot] Rename plot axis label and xlimt start from 0 and update docs" by @CatherineSue in #64
  • misc: Fix doc naming and use flexible plot in cli by @key4ng in #65
  • Remove hidden cap for data and set general scale start from 0 by @CatherineSue in #66
  • [Plot] Revert grid alpha and add TODOs by @CatherineSue in #67
  • [CI] Fix release.yml by @CatherineSue in #68

New Contributors

Full Changelog: v0.0.1...v0.0.2