Skip to content

Run automated conformance suite in CI - #2048

Open
russlan23 wants to merge 2 commits into
finos:mainfrom
russlan23:feat/issue-2045/conformance-ci
Open

Run automated conformance suite in CI#2048
russlan23 wants to merge 2 commits into
finos:mainfrom
russlan23:feat/issue-2045/conformance-ci

Conversation

@russlan23

Copy link
Copy Markdown

Describe your change

Adds a Playwright contribution check for the FDC3 conformance framework. The check starts the conformance app and the FDC3 for Web reference Desktop Agent, launches the runner inside the Desktop Agent, selects the complete non-manual pack, and fails with the underlying conformance failure messages when any test fails.

The browser runner now exposes machine-readable status and totals after the Mocha run. While exercising the pack, the check also exposed three setup and cleanup problems in the recently added destructured-method tests; this change supplies the required getAppMetadata argument, waits for freshly opened mock apps to initialize, awaits the close broadcast, and uses the existing mock-processing timeout.

Manual intent-resolver and channel-selector tests remain outside this automated check.

Validation performed:

  • Complete non-manual conformance pack against the reference Desktop Agent: 115 passed, 0 failed
  • Isolated fdc3.destructuredMethods pack: 8 passed, 0 failed
  • npm run test
  • npm run lint (passes with existing workbench warnings)
  • npm run build --workspace fdc3-conformance
  • Conformance-package ESLint and Prettier checks
  • npm run test:ci --workspace fdc3-conformance -- --list

Related Issue

Resolves #2045.

Contributor License Agreement

  • I acknowledge that a contributor license agreement is required and that I have one in place or will seek to put one in place ASAP.

Review Checklist

@linux-foundation-easycla

linux-foundation-easycla Bot commented Aug 4, 2026

Copy link
Copy Markdown

CLA Signed
The committers listed above are authorized under a signed CLA.

  • ✅ login: russlan23 / name: russlan23 (94990af)

@netlify

netlify Bot commented Aug 4, 2026

Copy link
Copy Markdown

Deploy Preview for fdc3 ready!

Name Link
🔨 Latest commit 7b55281
🔍 Latest deploy log https://app.netlify.com/projects/fdc3/deploys/6a7dab026c0e040008979f99
😎 Deploy Preview https://deploy-preview-2048.preview-fdc3.finos.org
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@russlan23
russlan23 marked this pull request as ready for review August 4, 2026 18:05
@russlan23
russlan23 requested a review from a team as a code owner August 4, 2026 18:05
@russlan23

Copy link
Copy Markdown
Author

/easycla

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Make FDC3 conformance test framework run under CI as a contribution test

1 participant