Open
Conversation
github-actions
bot
added
the
azsdk-cli
Contributor
There was a problem hiding this comment.
Pull request overview
Adds a large set of TypeSpec authoring benchmark testcases (focused on API versioning and ARM patterns) to the azsdk-cli benchmarks test data.
Changes:
- Expanded the TypeSpec
TestCases.jsoncatalog with new versioning/ARM authoring scenarios. - Added new TypeSpec seed projects (
main.tsp/employee.tsp/readmes) for the new scenarios. - Added many generated ARM example JSON payloads for versioned scenarios.
Reviewed changes
Copilot reviewed 118 out of 119 changed files in this pull request and generated 5 comments.
Show a summary per file
| File | Description |
|---|---|
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/TestCases.json | Registers new TypeSpec/ARM authoring benchmark scenarios and their seed files. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001001-version-spread-property/main.tsp | Seed TypeSpec project for versioned spread-property scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001001-version-spread-property/employee.tsp | Seed models/ops for spread-property scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001002-version-default-value/main.tsp | Seed TypeSpec project for versioned default-value scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001002-version-default-value/readme.md | Autorest readme seed for default-value scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001003-version-required-to-optional/main.tsp | Seed TypeSpec project for required→optional versioning scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001003-version-required-to-optional/readme.md | Autorest readme seed for required→optional scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001004-version-property-decorator/main.tsp | Seed TypeSpec project for property-decorator versioning scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001004-version-property-decorator/readme.md | Autorest readme seed for property-decorator scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/main.tsp | Seed TypeSpec project for adding preview-after-preview scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/employee.tsp | Seed models/ops for preview-after-preview scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/readme.md | Autorest readme seed for preview-after-preview scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2024-10-01-preview/Operations_List_MinimumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2024-10-01-preview/Operations_List_MaximumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2024-10-01-preview/Employees_Update_MaximumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2024-10-01-preview/Employees_ListBySubscription_MinimumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2024-10-01-preview/Employees_ListBySubscription_MaximumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2024-10-01-preview/Employees_ListByResourceGroup_MinimumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2024-10-01-preview/Employees_ListByResourceGroup_MaximumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2024-10-01-preview/Employees_Get_MaximumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2024-10-01-preview/Employees_Delete_MaximumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2024-10-01-preview/Employees_CreateOrUpdate_MaximumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2021-10-01/Operations_List_MinimumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2021-10-01/Operations_List_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2021-10-01/Employees_Update_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2021-10-01/Employees_ListBySubscription_MinimumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2021-10-01/Employees_ListBySubscription_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2021-10-01/Employees_ListByResourceGroup_MinimumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2021-10-01/Employees_ListByResourceGroup_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2021-10-01/Employees_Get_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2021-10-01/Employees_Delete_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001005-version-add-preview-after-preview/examples/2021-10-01/Employees_CreateOrUpdate_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/main.tsp | Seed TypeSpec project for adding preview-after-stable scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/employee.tsp | Seed models/ops for preview-after-stable scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/readme.md | Autorest readme seed for preview-after-stable scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2024-10-01/Operations_List_MinimumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2024-10-01/Operations_List_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2024-10-01/Employees_Update_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2024-10-01/Employees_ListBySubscription_MinimumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2024-10-01/Employees_ListBySubscription_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2024-10-01/Employees_ListByResourceGroup_MinimumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2024-10-01/Employees_ListByResourceGroup_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2024-10-01/Employees_Get_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2024-10-01/Employees_Delete_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2024-10-01/Employees_CreateOrUpdate_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2021-10-01/Operations_List_MinimumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2021-10-01/Operations_List_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2021-10-01/Employees_Update_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2021-10-01/Employees_ListBySubscription_MinimumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2021-10-01/Employees_ListBySubscription_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2021-10-01/Employees_ListByResourceGroup_MinimumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2021-10-01/Employees_ListByResourceGroup_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2021-10-01/Employees_Get_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2021-10-01/Employees_Delete_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001006-version-add-preview-after-stable/examples/2021-10-01/Employees_CreateOrUpdate_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/main.tsp | Seed TypeSpec project for stable-after-preview scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/employee.tsp | Seed models/ops for stable-after-preview scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/readme.md | Autorest readme seed for stable-after-preview scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2024-10-01-preview/Operations_List_MinimumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2024-10-01-preview/Operations_List_MaximumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2024-10-01-preview/Employees_Update_MaximumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2024-10-01-preview/Employees_ListBySubscription_MinimumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2024-10-01-preview/Employees_ListBySubscription_MaximumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2024-10-01-preview/Employees_ListByResourceGroup_MinimumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2024-10-01-preview/Employees_ListByResourceGroup_MaximumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2024-10-01-preview/Employees_Get_MaximumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2024-10-01-preview/Employees_Delete_MaximumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2024-10-01-preview/Employees_CreateOrUpdate_MaximumSet_Gen.json | Example payload for preview api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2021-10-01/Operations_List_MinimumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2021-10-01/Operations_List_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2021-10-01/Employees_Update_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2021-10-01/Employees_ListBySubscription_MinimumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2021-10-01/Employees_ListBySubscription_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2021-10-01/Employees_ListByResourceGroup_MinimumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2021-10-01/Employees_ListByResourceGroup_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2021-10-01/Employees_Get_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2021-10-01/Employees_Delete_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001007-version-add-stable-after-preview/examples/2021-10-01/Employees_CreateOrUpdate_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/main.tsp | Seed TypeSpec project for stable-after-stable scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/employee.tsp | Seed models/ops for stable-after-stable scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/readme.md | Autorest readme seed for stable-after-stable scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2024-10-01/Operations_List_MinimumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2024-10-01/Operations_List_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2024-10-01/Employees_Update_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2024-10-01/Employees_ListBySubscription_MinimumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2024-10-01/Employees_ListBySubscription_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2024-10-01/Employees_ListByResourceGroup_MinimumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2024-10-01/Employees_ListByResourceGroup_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2024-10-01/Employees_Get_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2024-10-01/Employees_Delete_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2024-10-01/Employees_CreateOrUpdate_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2021-10-01/Operations_List_MinimumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2021-10-01/Operations_List_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2021-10-01/Employees_Update_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2021-10-01/Employees_ListBySubscription_MinimumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2021-10-01/Employees_ListBySubscription_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2021-10-01/Employees_ListByResourceGroup_MinimumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2021-10-01/Employees_ListByResourceGroup_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2021-10-01/Employees_Get_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2021-10-01/Employees_Delete_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/001008-version-add-stable-after-stable/examples/2021-10-01/Employees_CreateOrUpdate_MaximumSet_Gen.json | Example payload for stable api-version. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/002001-ARM-change-resource-type/main.tsp | Seed TypeSpec project for changing ARM resource type scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/002002-ARM-define-extension-resource/main.tsp | Seed TypeSpec project for defining extension resource scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/002003-ARM-define-full-update-operation/main.tsp | Seed TypeSpec project for full-update PATCH scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/002003-ARM-define-full-update-operation/employee.tsp | Seed models/ops for full-update PATCH scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/002004-ARM-define-extension-resource/main.tsp | Seed TypeSpec project for proxy→extension resource conversion scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/002004-ARM-define-extension-resource/badgeAssignment.tsp | Seed resource definition for badge assignment scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/002005-ARM-define-the-resource/main.tsp | Seed TypeSpec project for defining a tracked ARM resource scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/002006-ARM-define-child-resource/main.tsp | Seed TypeSpec project for defining an ARM child resource scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/002007-ARM-define-custom-action/main.tsp | Seed TypeSpec project for defining a custom ARM action scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/003002-arm-action-lro/main.tsp | Seed TypeSpec project for ARM async action (LRO) scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/003002-arm-action-lro/employee.tsp | Seed models/ops for ARM async action scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/003003-arm-modify-response/main.tsp | Seed TypeSpec project for modifying LRO response headers scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/004001-decorate-mgmt-resource-name-parameter/main.tsp | Seed TypeSpec project for decorating resource name parameter scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/004001-decorate-mgmt-resource-name-parameter/employee.tsp | Seed resource definition for resource-name parameter decorator scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/004002-decorate-length-constrains-on-array-item/main.tsp | Seed TypeSpec project for array-item length constraint scenario. |
| tools/azsdk-cli/Azure.Sdk.Tools.Cli.Benchmarks/TestData/TypeSpec/004002-decorate-length-constrains-on-array-item/employee.tsp | Seed resource definition for array-item length constraint scenario. |
Comment on lines
+221
to
+228
| "name": "002008-ARM-add-parameters", | ||
| "description": "ARM-add-parameters", | ||
| "prompt": "add top and skip query parameters to the ListBySubscription operation in interface employees", | ||
| "testfiles": [], | ||
| "verifyPlan": [ | ||
| "1. The listBySubscription operation should include top and skip query parameters for pagination support.", | ||
| "2. All other existing operations in the Employees interface should remain unchanged." | ||
| ] |
There was a problem hiding this comment.
Test case 002008-ARM-add-parameters has an empty testfiles list. In AuthoringScenario.SetupAsync, TestTspFiles are what get copied into the sparse checkout to create a deterministic starting point; leaving this empty makes the scenario depend on whatever happens to be in specification/widget/... on azure-rest-api-specs at runtime, which is likely to be flaky over time. Consider adding the relevant seed TypeSpec files (e.g., the file that defines the Employees interface) to testfiles for this case.
Comment on lines
+57
to
+58
| "prompt": "Add a new preview version `2025-05-04-preview` to my service widget resource manager. Exclude Feature: `age` property with default value 21** (replaced old `age` property, which was renamed to `oldAge` and removed)", | ||
| "testfiles": [ |
There was a problem hiding this comment.
The prompt text has a stray Markdown ** after default value 21 ("21**"), which looks accidental and may reduce prompt clarity for the benchmark. Consider removing the extra asterisks / cleaning up the sentence.
|
|
||
| /** 2025-05-01 version */ | ||
| @armCommonTypesVersion(Azure.ResourceManager.CommonTypes.Versions.v5) | ||
| v2025_05_01: "2025-05-01", |
There was a problem hiding this comment.
This scenario is named/prompted as targeting a new API version 2025-05-04-preview, but the Versions enum here defines v2025_05_01: "2025-05-01" (stable) and does not include a 2025-05-04-preview entry. This mismatch will likely confuse the agent and the AI validator (verify plan mentions 2025-05-04-preview). Align the enum values/decorators with the version referenced by the test case.
Suggested change
| v2025_05_01: "2025-05-01", | |
| v2025_05_01: "2025-05-01", | |
| /** 2025-05-04-preview version */ | |
| @armCommonTypesVersion(Azure.ResourceManager.CommonTypes.Versions.v5) | |
| @previewVersion | |
| v2025_05_04_preview: "2025-05-04-preview", |
Comment on lines
+15
to
+28
| ```yaml | ||
| openapi-type: arm | ||
| openapi-subtype: rpaas | ||
| tag: package-2025-05-01 | ||
| ``` | ||
|
|
||
| ### Tag: package-2025-05-01 | ||
|
|
||
| These settings apply only when `--tag=package-2025-05-01` is specified on the command line. | ||
|
|
||
| ```yaml $(tag) == 'package-2025-05-01' | ||
| input-file: | ||
| - stable/2025-05-01/widget.json | ||
| suppressions: |
There was a problem hiding this comment.
The readme defaults to / documents package-2025-05-01 (stable) as the tag and input file, but the test case prompt/verify plan are about a new 2025-05-04-preview version. To keep the benchmark setup coherent, update the default tag and tag sections to match the version being tested (or adjust the prompt/verify plan to match 2025-05-01).
Comment on lines
+1
to
+11
| import "@typespec/rest"; | ||
| import "@typespec/versioning"; | ||
| import "@azure-tools/typespec-azure-core"; | ||
| import "@azure-tools/typespec-azure-resource-manager"; | ||
| import "./employee.tsp"; | ||
|
|
||
| using TypeSpec.Http; | ||
| using TypeSpec.Rest; | ||
| using TypeSpec.Versioning; | ||
| using Azure.Core; | ||
| using Azure.ResourceManager; |
There was a problem hiding this comment.
This main.tsp uses using TypeSpec.Http; but does not explicitly import "@typespec/http"; (it currently imports @typespec/rest and @typespec/versioning). Most other TypeSpec testcases in this repo import @typespec/http whenever TypeSpec.Http is used (e.g., TestData/TypeSpec/version-model-property-required/main.tsp). For consistency and to avoid relying on transitive imports, add the explicit @typespec/http import or remove the using TypeSpec.Http; if it's not needed.
chunyu3
force-pushed
the
authoring-cases
branch
from
8ba3b2d to
a92c0c3
Compare
chunyu3
force-pushed
the
authoring-cases
branch
from
a92c0c3 to
d3addb9
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.