Add AI issue replication mode to MAUI Copilot - #37445

Draft

kubaflo wants to merge 170 commits into

dotnet:improved-reviewerfrom

kubaflo:copilot/replicate-issues-pipeline

Commits on Aug 15, 2026

Add AI issue replication pipeline
Copilot CI
committed
187637f
Keep review mode independent of replication publishing
Copilot CI
committed
ba5ec00
Support orientation-based issue reproduction
Copilot CI
committed
760cee1
Allow replication dry runs before publisher setup
Copilot CI
committed
b71e4d9
Allow GitHub attachment CDN redirects
Copilot CI
committed
f91cad6
Restore tracked baseline before replication
Copilot CI
committed
4e5f8dd
Keep Appium state outside the worktree
Copilot CI
committed
5e6970d
Harden replication agent write permissions
Copilot CI
committed
f538c85
Pass source root to trusted sandbox runner
Copilot CI
committed
9936d72
Fix Catalyst replication retries
Copilot CI
committed
cbc02e6
Surface recorder process failures
Copilot CI
committed
f28b57c
Improve empirical replication retries
Copilot CI
committed
125e43c
Fix recorder and Catalyst Appium integration
Copilot CI
committed
fe2fa8f
Harden Sandbox retry authoring
Copilot CI
committed
c064b05
Harden replication proof validation
Copilot CI
committed
7c250f9
Let host recordings finish naturally

Copilot CI
and
Copilot
committed
0636c5a
Use trusted device verifier runner

Copilot CI
and
Copilot
committed
ec09efd
Reuse trusted publication infrastructure
Copilot CI
committed
980832a

Commits on Aug 16, 2026

Fix live replication pilot failures
Copilot CI
committed
f341eb3
Fix replication asset commit output
Copilot CI
committed
ca5da2d
Retry Windows recording tool installation
Copilot CI
committed
33eb601
Record Catalyst evidence through Appium
Copilot CI
committed
3e3f54d
Restore verifier build side effects
Copilot CI
committed
7472af2
Fix replication retries and guard matching
Copilot CI
committed
48a9457
Pad short iOS reproduction recordings
Copilot CI
committed
a13d96f
Allow safe aliases in reproduction tests
Copilot CI
committed
eca189b
Bypass proxies for local Appium health checks
Copilot CI
committed
68f35f2
Validate rejected lighter test reasons
Copilot CI
committed
49cebe3
Require event-driven reproduction test repairs
Copilot CI
committed
b127ab9
Use validator result for replication publication
Copilot CI
committed
021d284
Probe Appium on IPv4 loopback
Copilot CI
committed
24550ad
Preserve replication verifier diagnostics
Copilot CI
committed
a880954
Fix replication failure diagnostics
Copilot CI
committed
4ead39c
Discover Apple XHarness results
Copilot CI
committed
4d2905c
Separate verifier diagnostics from publication
Copilot CI
committed
83d8e90
Attach Windows Appium after launch
Copilot CI
committed
d871007
Fix verifier diagnostics artifact root
Copilot CI
committed
6dd9a85
Remove Catalyst capture intermediates
Copilot CI
committed
98be036
Repair invalid generated replication tests
Copilot CI
committed
22d21b8
Prefer current device verifier results
Copilot CI
committed
6e4be23
Allow a final generated test repair
Copilot CI
committed
e4367e7
Allow assembly-qualified XAML namespaces
Copilot CI
committed
7dc3607
Preserve a Sandbox compile repair
Copilot CI
committed
5ab20b7
Clarify bounded Sandbox XAML repairs
Copilot CI
committed
b9ec920
Preserve primary replication failures
Copilot CI
committed
978694d
Allow slow UiAutomator server installs
Copilot CI
committed
577eec6
Preserve a final Sandbox repair
Copilot CI
committed
abb45fd
Clarify Appium plan nullability
Copilot CI
committed
9479b93
Allow a final generated test repair
Copilot CI
committed
a7fb9a1
Allow inline XAML schema URIs
Copilot CI
committed
eeac1ca
Align replication attempt validation
Copilot CI
committed
df2f408
Allow final device test repair

Copilot CI
and
Copilot
committed
083b4b7
Allow trimming annotations in generated sources

Copilot CI
and
Copilot
committed
c62aefc
Publish reproductions through MauiBot fork
Copilot CI
committed
63bc876
Post MauiBot non-reproduction outcomes
Copilot CI
committed
addceef
Publish outcomes after failed replication
Copilot CI
committed
c4915d1
Handle reproduced outcome manifests
Copilot CI
committed
dd8932c
Use the MauiBot account identity
Copilot CI
committed
af334f0
Discover the MauiBot reproduction fork
Copilot CI
committed
20f4e8c
Preflight MauiBot publication in parallel
Copilot CI
committed
4564a1c
Create the MauiBot fork on demand
Copilot CI
committed
1071e24
Give test repairs the exact reproduction guard
Copilot CI
committed
079a669
Allow safe generated UI test setup
Copilot CI
committed
b88c1c3
Constrain planned failure signatures
Copilot CI
committed
bce95ff
Make reproduction tests fail unconditionally
Copilot CI
committed
b4e3a90
Harden and redirect reproduction rollout
Copilot CI
committed
57ee575
Move reproduction PRs during publisher preflight
Copilot CI
committed
a5ecbd2
Migrate reproduction PR feedback to testing fork
Copilot CI
committed
98d5798
Ignore unmatched historical reproduction feedback
Copilot CI
committed
4d78b16
Add lightweight replication feedback snapshots
Copilot CI
committed
d205250
Limit feedback export to feedback runs
Copilot CI
committed
60af218
Require semantic trigger equivalence
Copilot CI
committed
ec4315a
Fix Windows replication harness startup
Copilot CI
committed
b34c1a1
Harden sandbox replication verdicts
Copilot CI
committed
2263260
Require production-path replication fidelity
Copilot CI
committed
1291046
Require symbol lookup on sandbox retries
Copilot CI
committed
d9cdc86
Record mobile lifecycle triggers
Copilot CI
committed
cfe1466
Accept safe UI test constructor names
Copilot CI
committed
1ca3d14
Require hermetic reproduction prerequisites
Copilot CI
committed
4143b8a

Commits on Aug 17, 2026

Preserve reproduction contracts and transitions
Copilot CI
committed
73a01bb
Force trusted Appium file execution
Copilot CI
committed
1eb712a
Harden replication publication validation
Copilot CI
committed
09217b2
Require direct visible rendering evidence
Copilot CI
committed
7c4b2cd
Bundle Windows App Runtime for replication
Copilot CI
committed
1118bc2
Preserve runtime inset and platform fidelity
Copilot CI
committed
666b6fb
Allow safe custom handler context wiring
Copilot CI
committed
758ff75
Fix Windows replication architecture scoping
Copilot CI
committed
7f39000
Harden inset and verifier evidence contracts

Copilot CI
and
Copilot
committed
741ac31
Preserve automatic property propagation in reproductions

Copilot CI
and
Copilot
committed
d67ef4f
Reject missing-handler reproduction failures

Copilot CI
and
Copilot
committed
9fc6be4
Capture trusted Windows app crashes

Copilot CI
and
Copilot
committed
7ec30b0
Require visible reproduction evidence
Copilot CI
committed
5f3865e
Fix attached Windows process exit proof
Copilot CI
committed
6a6c64e
Repeat timing-sensitive reproduction triggers
Copilot CI
committed
ff41c94
Fix replication Copilot telemetry artifact layout
Copilot
committed
e774503
Classify completed negative reproductions
Copilot CI
committed
22c6f9a
Merge remote-tracking branch 'refs/remotes/kubaflo/copilot/replicate-issues-pipeline' into copilot/replicate-issues-pipeline
Copilot CI
committed
045535e
Bound replication subprocess execution

Copilot CI
and
Copilot
committed
5f70736
Fix bounded child argument composition

Copilot CI
and
Copilot
committed
861a5fb
Resolve Android semantic verdict text

Copilot CI
and
Copilot
committed
0ba054d
Resolve Android verdict prefixes
Copilot CI
committed
0a0b52b
Require stable Android trigger locators
Copilot CI
committed
e55f44e
Distinguish Copilot pipeline run modes
Copilot CI
committed
9f33775
Retry only transient Android deployment failures
Copilot CI
committed
6f32528
Back off transient Copilot service failures
Copilot CI
committed
6be5889
Classify Copilot service outages
Copilot CI
committed
8aff559
Fix Copilot invocation on Windows agents
Copilot CI
committed
abd9294
Handle blocked replication publication cleanly
Copilot CI
committed
fb71fd2
Retry invalid replication test plans
Copilot CI
committed
d34385e
Make replication retries actionable and survive device flakiness

Copilot CI
and
Copilot
committed
3323858
Apply device infrastructure retries on the final sandbox attempt

Copilot CI
and
Copilot
committed
dce87eb
Skip candidate validation when no manifest was produced

Copilot CI
and
Copilot
committed
60ea4f3
Reject prohibited-capability issues before spending device attempts

Copilot CI
and
Copilot
committed
56b71b4
Publish reproduced candidates that follow the test naming convention

Copilot CI
and
Copilot
committed
b3db0f4
Survive GitHub service outages during replication

Copilot CI
and
Copilot
committed
15a5c4d
Stop the safety scanner rejecting ordinary reproduction code

Copilot CI
and
Copilot
committed
813d2e5
Give the agent the real failure text on retry

Copilot CI
and
Copilot
committed
3fcc538
Retry every publisher GitHub call during a service outage

Copilot CI
and
Copilot
committed
c04c6c3
Tell the agent which contract rule its output broke

Copilot CI
and
Copilot
committed
9155f41
Resolve MAUI AutomationIds across native attributes

Copilot CI
and
Copilot
committed
de71ccf
Tell the agent why trusted verification rejected its test

Copilot CI
and
Copilot
committed
81890c8
Show the agent the compiler error that broke its test build

Copilot CI
and
Copilot
committed
df5b4ed
Pin reproduction PRs to the validated baseline commit

Copilot CI
and
Copilot
committed
8593bfe
Base reproduction branches on the pull request base

Copilot CI
and
Copilot
committed
06df680
Stop the trusted Appium runner failing analysis as an error

Copilot CI
and
Copilot
committed
d8a7bfb
Apply reviewer findings from reproduction PR feedback

Copilot CI
and
Copilot
committed
eec4808
State the evidentiary role of the recording in reproduction PRs

Copilot CI
and
Copilot
committed
8a2ac65
Unblock exception-typed crash oracles and colliding test paths

Copilot CI
and
Copilot
committed
66575c5
Stop recorder faults from consuming reproduction attempts

Copilot CI
and
Copilot
committed
c50f202
Point XAML directive rejections at the code-behind alternative

Copilot CI
and
Copilot
committed
3bbd2bc
Show Sandbox build breaks and accept substantiated blocks

Copilot CI
and
Copilot
committed
eb6357b
Apply reviewer findings from validated reproduction PRs

Copilot CI
and
Copilot
committed
e3cf1fe
Report a conclusive non-reproduction as a successful run

Copilot CI
and
Copilot
committed
e95f5a4
Demand measurable, tolerant, and causal reproduction assertions

Copilot CI
and
Copilot
committed
60cb59f
Show the agent which elements the app actually exposes

Copilot CI
and
Copilot
committed
4f9b4c8
Re-plan the test tier when the chosen tier cannot observe the defect

Copilot CI
and
Copilot
committed
f049d73
Name the exact false-pass modes reviewers found in published PRs

Copilot CI
and
Copilot
committed
270d4fa
State the execution host in reproduction PR bodies

Copilot CI
and
Copilot
committed
f61fb75
Publish a runnable test name in reproduction PRs

Copilot CI
and
Copilot
committed
37885e8
Make public issue outcome comments opt-in

Copilot CI
and
Copilot
committed
ecfb6e9
Recognise an app crash and stop attempts oscillating

Copilot CI
and
Copilot
committed
d0d834f
Show the whole reproduction in the preview GIF

Copilot CI
and
Copilot
committed
e51bf6f
Never conclude a non-reproduction from lost attempts

Copilot CI
and
Copilot
committed
c0d1f8f
Fix the failure history lookup on OrderedDictionary

Copilot CI
and
Copilot
committed
4e12ec7

Commits on Aug 18, 2026

Name the simulator or emulator that ran the reproduction

Copilot CI
and
Copilot
committed
2d5369f
Keep the state before the first interaction in the recording

Copilot CI
and
Copilot
committed
e7329a6
Prove the reproduction is deterministic before publishing

Copilot CI
and
Copilot
committed
6d9ecd0
Answer the reproduction question from repeated clean observations

Copilot CI
and
Copilot
committed
8e24193
Let a reproduction keep one pointer down through a direction change

Copilot CI
and
Copilot
committed
a5b305e
Stop publication failing on the runnable test name

Copilot CI
and
Copilot
committed
5d5a41e
Assert the crash when a reported crash actually happens

Copilot CI
and
Copilot
committed
924a44a
Keep a reproduction that failed for the predicted reason

Copilot CI
and
Copilot
committed
c7778af
Stop losing a finished reproduction to a package download

Copilot CI
and
Copilot
committed
d9c55b5
Verify the reproduction against the commit it will be published on

Copilot CI
and
Copilot
committed
0d5e088
Record the device at the resolution the claim needs

Copilot CI
and
Copilot
committed
bc3c977
Give the reproduction a legal way to wait

Copilot CI
and
Copilot
committed
625b3b5
Stop losing whole runs to a file in the wrong folder

Copilot CI
and
Copilot
committed
3053599
Print what the agent said when its work never arrived

Copilot CI
and
Copilot
committed
2f23483
Look one directory up for a required output

Copilot CI
and
Copilot
committed
21c22d2
Stop losing Android runs before they start

Copilot CI
and
Copilot
committed
f57be0d
Tell the agent what to write, not only what not to

Copilot CI
and
Copilot
committed
d556d0a
Do not spend the reproduction budget on filing errors

Copilot CI
and
Copilot
committed
279277d
Fail fast when apt is waiting for a lock it will not get

Copilot CI
and
Copilot
committed
bdb11eb
Stop a stray escape from deleting half the agent's instructions

kubaflo
and
Copilot
committed
dadf2b2
Make the recording show the defect happening

kubaflo
and
Copilot
committed
5c15daf
Stop losing Android runs to an unreachable package mirror

kubaflo
and
Copilot
committed
3117b53
Require a reproduction test to rule out its own setup failing

kubaflo
and
Copilot
committed
37ab510
Stop rediscovering work a pull request already covers

Copilot CI
and
Copilot
committed
9a7c7a0
Treat an already-covered issue as an answer, not a failure

Copilot CI
and
Copilot
committed
3626017
Merge improved-reviewer into issue replication pipeline
Copilot CI
committed
4b7a000