Skip to content

docs(subagent-strategy): keep a standing roster across a multi-PR session - #53

Open
cristim wants to merge 1 commit into
mainfrom
docs/standing-agent-roster
Open

docs(subagent-strategy): keep a standing roster across a multi-PR session#53
cristim wants to merge 1 commit into
mainfrom
docs/standing-agent-roster

Conversation

@cristim

@cristim cristim commented Aug 10, 2026

Copy link
Copy Markdown
Member

Closes #51.

The existing reuse guidance optimises a single follow-up: same files, next round of the same loop, subsystem pooling. Over a long multi-PR session the compounding win is different, and larger. Nothing described it.

An agent that has worked several changes in one subsystem accumulates a model of how that subsystem fails, which no briefing transfers and no file cache substitutes for.

What prompted this

A session that shipped 30 PRs across an auth/permissions subsystem, a provider layer, and CI. Two things stood out:

  • An implementer, told once that a wildcard-carrying scope must be tested with len(x) == 0 rather than an IsUnrestricted(x) helper, applied that unprompted to the next PRs identical guard. A fresh agent repeats the defect and costs another review round.
  • A reviewer four PRs into one subsystem began finding defects in the fixes rather than in the original bugs: a fix that closed the less-reachable half of a bug, a guard that introduced a false refusal for every seeded group. That needs a model of the failure shapes, not familiarity with a diff.

What the section adds

Standing rosters — one reviewer and one implementer per active subsystem, routed by name for the session. Reviewer/implementer independence still binds; pooling is per subsystem, not per PR.

Environment deltas, not just task deltas. A long-lived agents model of the world goes stale in ways its model of the code does not: the base moved, the CI contract changed, another agent holds a file it is about to edit, an earlier instruction was retracted. Every collision in that session traced to omitting one of these, and they read as agent error when they are orchestration error.

A handoff contract. The most transferable part: pin the baseline in both directions. A handoff recording only the failing row of a mock/production divergence leads the successor to tighten until that row passes, swapping one wrong answer for another while staying green. Also: name the axis actually verified ("safe across packages; within-file scope unchecked", not "safe"), and state what was inspected and deliberately left alone, since a sweep reporting only its changes is indistinguishable from one that stopped early.

Permission to stop. Two agents flagged their own context depth and handed over cleanly. Both framed it apologetically; both were right. One declined an open-ended fan-out specifically because starting deep in context guarantees a mid-task handoff later, which is strictly worse than a clean one now.

Scope

Additive, nested under the existing "Reuse agents before spawning new ones" section. No existing guidance changed or contradicted.

Summary by CodeRabbit

  • Documentation
    • Added guidance for maintaining reviewer and implementer rosters across pull requests.
    • Documented subsystem-based task routing and independent role assignments.
    • Added recommendations for reusing failure knowledge and sharing environment updates.
    • Introduced a structured handoff format covering baselines, verification scope, and gaps.

…sion

The existing reuse guidance optimises a single follow-up: same files, next
round of the same loop, subsystem pooling. Over a long multi-PR session the
compounding win is different and larger, and nothing described it.

An agent that has worked several changes in one subsystem accumulates a model
of how that subsystem fails, which no briefing transfers and no file cache
substitutes for. Observed over a 30-PR session: an implementer applied a
correction it had learned on one PR to the next PR's identical guard without
being told, and a reviewer four PRs deep began finding defects in the fixes
rather than in the original bugs.

Adds four things the session showed were missing:

- standing rosters, typically one reviewer and one implementer per active
  subsystem, routed by name for the session's duration
- briefing the environment delta, not just the task delta. A long-lived
  agent's model of the world goes stale in ways its model of the code does
  not: the base moved, the CI contract changed, another agent holds a file,
  an earlier instruction was retracted. Every collision in that session
  traced to omitting one of these
- a handoff contract that pins baselines in both directions. A handoff
  recording only the failing row of a mock/production divergence leads the
  successor to tighten until that row passes, swapping one wrong answer for
  another while staying green
- permission to stop. Two agents flagged their own context depth and handed
  over cleanly; both framed it apologetically, and both were right, one
  because the remaining work was an open-ended fan-out where starting deep
  guarantees a mid-task handoff later

Closes #51
@coderabbitai

coderabbitai Bot commented Aug 10, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

📝 Walkthrough

Walkthrough

The strategy documentation adds guidance for maintaining named reviewer and implementer rosters across multiple pull requests. It defines subsystem routing, environmental delta briefings, independent roles, accumulated knowledge reuse, and structured handoffs.

Changes

Multi-PR agent continuity

Layer / File(s) Summary
Standing roster and handoff contract
subagent-strategy.md
The guidance retains named agents by subsystem, preserves reviewer and implementer independence, communicates environment changes, and records passing and failing baselines, verification scope, uncovered areas, and context-depth transitions.

Estimated code review effort: 1 (Trivial) | ~5 minutes

Possibly related PRs

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly summarizes the addition of standing reviewer and implementer rosters for multi-PR sessions.
Linked Issues check ✅ Passed The changes address all coding objectives in issue #51, including rosters, environment deltas, handoffs, and context-depth reporting.
Out of Scope Changes check ✅ Passed The changes are additive guidance within the existing reuse section and remain within issue #51 scope.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch docs/standing-agent-roster

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🧹 Nitpick comments (1)
subagent-strategy.md (1)

65-74: 📐 Maintainability & Code Quality | 🔵 Trivial | ⚡ Quick win

Make environment and context status explicit handoff fields.

The guidance requires environment deltas in continuations and asks agents to report context-depth limits. The handoff contract does not explicitly require the successor report to include either item. Add mandatory fields for the environment delta and context status, including base-branch changes, CI contract changes, file ownership, retracted instructions, and the handoff trigger.

Proposed clarification
 **Handoff contract.** When an agent winds down, its report must let a successor act without re-deriving:
 
+- **Record the environment delta**, including base-branch, CI, ownership, and instruction changes.
+- **Record context status**, including the context-depth limit or handoff trigger.
 - **Pin the baseline in both directions**, not only the failing one.
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@subagent-strategy.md` around lines 65 - 74, Update the handoff contract in
the “Handoff contract” section to require explicit fields for environment delta
and context status. Ensure the environment field covers base-branch changes, CI
contract changes, file ownership, and retracted instructions, while the
context-status field records the handoff trigger, including context-depth limits
or open-ended remaining work.
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Nitpick comments:
In `@subagent-strategy.md`:
- Around line 65-74: Update the handoff contract in the “Handoff contract”
section to require explicit fields for environment delta and context status.
Ensure the environment field covers base-branch changes, CI contract changes,
file ownership, and retracted instructions, while the context-status field
records the handoff trigger, including context-depth limits or open-ended
remaining work.

ℹ️ Review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: a014f1f7-074a-4232-8106-77d115fcfe69

📥 Commits

Reviewing files that changed from the base of the PR and between 073e1bf and 1b38211.

📒 Files selected for processing (1)
  • subagent-strategy.md

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

subagent-strategy: no guidance on keeping a standing reviewer/implementer roster across a multi-PR session

1 participant