Skip to content

[AVC] Refactor commands and add new audit commands#14886

Open
tjprescott wants to merge 7 commits intomainfrom
avc/AuditCommands
Open

[AVC] Refactor commands and add new audit commands#14886
tjprescott wants to merge 7 commits intomainfrom
avc/AuditCommands

Conversation

@tjprescott
Copy link
Copy Markdown
Member

@tjprescott tjprescott commented Apr 2, 2026

This PR refactors the APIView Copilot CLI command surface (renaming/re-grouping several command groups) and adds new audit/reporting commands for examining AI comment feedback and stored memories in the AVC Cosmos DB, while simplifying environment configuration by deriving the App Configuration endpoint from ENVIRONMENT_NAME.

  • Refactor CLI groups/commands (e.g., eval → test, search → kb, metrics → report, app/permissions → ops) and update docs accordingly.
  • Add new reporting/audit commands (avc report feedback / avc report memory) and related support logic (including feedback language handling).
  • Update settings/db/search managers to support environment-aware configuration and instance scoping.

Copilot AI review requested due to automatic review settings April 2, 2026 16:07
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR refactors the APIView Copilot CLI command surface (renaming/re-grouping several command groups) and adds new audit/reporting commands for examining AI comment feedback and stored memories in the AVC Cosmos DB, while simplifying environment configuration by deriving the App Configuration endpoint from ENVIRONMENT_NAME.

Changes:

  • Refactor CLI groups/commands (e.g., evaltest, searchkb, metricsreport, app/permissionsops) and update docs accordingly.
  • Add new reporting/audit commands (avc report feedback / avc report memory) and related support logic (including feedback language handling).
  • Update settings/db/search managers to support environment-aware configuration and instance scoping.

Reviewed changes

Copilot reviewed 10 out of 10 changed files in this pull request and generated 5 comments.

Show a summary per file
File Description
packages/python-packages/apiview-copilot/src/_settings.py Resolve App Configuration endpoint from ENVIRONMENT_NAME via a fixed mapping; support per-environment SettingsManager instances.
packages/python-packages/apiview-copilot/src/_search_manager.py Allow SearchManager to be constructed with an explicit environment.
packages/python-packages/apiview-copilot/src/_database_manager.py Key DatabaseManager singletons by environment to support staging/production side-by-side usage.
packages/python-packages/apiview-copilot/src/_apiview.py Extend AI comment feedback query to support language=None (all languages) and include language in results.
packages/python-packages/apiview-copilot/scripts/dump_cli_command_tree.py New helper script to dump the CLI command tree and descriptions.
packages/python-packages/apiview-copilot/README.md Update examples/docs for the refactored CLI groups and env setup.
packages/python-packages/apiview-copilot/cli.py Refactor command groups, add audit/report commands, and add test pytest convenience command.
packages/python-packages/apiview-copilot/AGENTS.md Update operational docs for renamed commands and env setup.
packages/python-packages/apiview-copilot/.github/skills/run-evals/SKILL.md Update skill instructions to use the new avc test eval command path.
packages/python-packages/apiview-copilot/.github/skills/dev-setup/SKILL.md Update dev setup skill instructions to match the new CLI command groups.

@tjprescott tjprescott self-assigned this Apr 2, 2026
@tjprescott tjprescott added the APIView Copilot Issues related to APIView Copilot label Apr 2, 2026
@github-project-automation github-project-automation bot moved this to 🆕 New in APIView Apr 2, 2026
@tjprescott tjprescott moved this from 🆕 New to 👀In PR in APIView Apr 2, 2026
@tjprescott tjprescott added this to the 2026-05 milestone Apr 2, 2026
@tjprescott tjprescott force-pushed the avc/AuditCommands branch 2 times, most recently from 023ce03 to b2327ae Compare April 2, 2026 22:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

APIView Copilot Issues related to APIView Copilot

Projects

Status: 👀In PR

Development

Successfully merging this pull request may close these issues.

2 participants