feat(rpi): refine RPI and HVE artifact workflows - #2843
Open
Allen Greaves (agreaves-ms) wants to merge 27 commits into
Open
feat(rpi): refine RPI and HVE artifact workflows#2843Allen Greaves (agreaves-ms) wants to merge 27 commits into
Allen Greaves (agreaves-ms) wants to merge 27 commits into
Conversation
- converge edits and validation before behavior testing - simplify tester execution and always-loaded guidance - add final-candidate conformance coverage ♻️ - Generated by Copilot
- reject contradictory timing, invocation, and revise outputs - align declared stimulus total with the parsed inventory 🧪 - Generated by Copilot
- constrain output to three opposing choices - prevent partial grader scores from passing 🧪 - Generated by Copilot
- document current deterministic and LLM grader use - distinguish eval graders from hygiene checks 📝 - Generated by Copilot
- report all 64 instruction stimuli - align skill subject count with source tags 📝 - Generated by Copilot
📝 - Generated by Copilot
🔧 - Generated by Copilot
📝 - Generated by Copilot
🧭 - Generated by Copilot
…ifacts 🔧 - Generated by Copilot
🧭 - Generated by Copilot
- support agent-owned and user-retained Review decisions - persist append-only review decisions and recovery projections - handle unavailable or stranded review builders safely 🔍 - Generated by Copilot
⚙️ - Generated by Copilot
- remove separate phase-detail artifacts - add task-local goals, targets, criteria, and delegation controls - synchronize RPI guidance and documentation 🧭 - Generated by Copilot
- add diagrammed phase checklists and structured task blocks - align planning, implementation, critique, and review artifacts - document linked artifact formatting and implementation guidance 🧭 - Generated by Copilot
🛠️ - Generated by Copilot
…ct guidance 🛠️ - Generated by Copilot
🧭 - Generated by Copilot
🧭 - Generated by Copilot
- clarify reader-first findings and stable evidence locators - formalize review decision history and disposition projections - align agent workflows with updated artifact contracts 📝 - Generated by Copilot
- document manual and automatic lifecycle behavior - align artifact ownership and tracking conventions - expand RPI asset usage documentation 🧭 - Generated by Copilot
🔧 - Generated by Copilot
⚙️ - Generated by Copilot
🛠️ - Generated by Copilot
📝 - Generated by Copilot
Codecov Report❌ Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #2843 +/- ##
==========================================
- Coverage 83.14% 83.02% -0.12%
==========================================
Files 183 185 +2
Lines 34029 34616 +587
Branches 25 27 +2
==========================================
+ Hits 28292 28740 +448
- Misses 5734 5873 +139
Partials 3 3
Flags with carried forward coverage won't be shown. Click here to find out more.
🚀 New features to boost your workflow:
|
Contributor
Eval Execution |
Bill Berry (WilliamBerryiii)
approved these changes
Sep 5, 2026
32 tasks
- remove the retired prompt eval backlink - derive safe preflight checks from matching workflows - add regression coverage for CI wrapper handling 🔧 - Generated by Copilot
Jamie Kim (jkim323)
approved these changes
Sep 5, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Pull Request
Description
This PR refines the RPI and HVE artifact workflows around explicit operating modes, durable
task-centered evidence, bounded delegation, and terminal review or testing decisions. It also
migrates pull request preparation from a prompt and broad instruction set to a dedicated skill with
focused local preflight checks.
RPI lifecycle
stable task identity, and record user-owned, agent-owned, or retained decisions with provenance.
phase delegation, and task-local requirements and implementation detail.
route decisions, and user conversation.
stranded-run recovery, and distinct routing for defects, decision gaps, evidence gaps, and residual
work.
HVE artifact lifecycle
workflow-extension modes while keeping detailed criteria in on-demand references.
fidelity and independent grading, and a non-Pass result ends the run instead of starting a same-run
edit and retest loop.
guidance routes new work through HVE Builder and HVE Builder Tester.
Pull request workflow and distribution
repository-template preservation, committed-diff analysis, focused changed-area validation, and one
approval before push or GitHub write.
pull-request prompt and package-scoped instruction.
synchronized with the new workflow contracts.
Related Issue(s)
None identified in the branch or commit history.
Type of Change
Select all that apply:
Code & Documentation:
Infrastructure & Configuration:
AI Artifacts:
hve-builderand addressed all actionable findings.github/instructions/*.instructions.md).github/prompts/*.prompt.md).github/agents/*.agent.md).github/skills/*/SKILL.md).github/hooks/*/*.json)evals/)Other:
.ps1,.sh,.py)Sample Prompts (for AI Artifact Contributions)
User Request:
Take this repository change through RPI automatically with standard review depth, then prepare a pull
request using focused changed-area checks.
Execution Flow:
RPI routes the work through Research, Plan, Implement, and Review while persisting phase evidence and
parent decisions. The pull-request skill then collects committed branch context, preserves this
repository template, runs changed-area checks, and requests approval before any GitHub write.
Output Artifacts:
.copilot-tracking/.copilot-tracking/pr/pr.mdSuccess Indicators:
Each phase reports its durable artifact and decision state, the review records a bounded verdict, and
the prepared pull request matches the committed diff without pushing or writing to GitHub before
approval.
For detailed contribution requirements, see:
Testing
git diff --check 52abb388bc76da960005ef60dc1c81b768b9b3ed..HEADnpm run plugin:validatenpm run docs:generate:checknpm run validate:skills(78 skills, zero errors and warnings)npm run lint:ai-artifactsnpm run lint:asset-docswith zero errors and repository-wide advisory warningsnpm run lint:mdnpm run lint:tablesafter repair commitcd68fcb6enpm run lint:frontmatternpm run lint:psshellcheck .github/skills/hve-core/pull-request/scripts/collect-context.shnpm run lint:yamlnpm run spell-checkwith zero issuesMarkdown-Link-Check.ps1 -ChangedFilesOnlyThe broad
npm run lint:md-linkscommand also ran and reported three unchanged external-link failuresoutside this branch. Hosted CI and model-backed behavior execution remain pending.
Checklist
Required Checks
AI Artifact Contributions
hve-builderreview mode to review contributionhve-builderreviewRequired Local Checks
The following local-safe validation commands must pass before merging:
npm run validate:localnpm run validate:docsnpm run spell-checknpm run lint:md-linksSecurity Considerations
GHCP Membership Changes
.github/agents/hve-core/subagents/rpi-review-builder.agent.md.github/skills/hve-core/pull-request.github/prompts/hve-core/pull-request.prompt.md.github/instructions/hve-core/pull-request.instructions.mdAdditional Notes
The full validation and documentation aggregates, hosted CI, browser suites, service-dependent tests,
security scans, and model-backed eval execution were not run as part of targeted local preflight.