Skip to content

Feat/factory verification score - #6

Merged
nonlinearnishu merged 3 commits into
mainfrom
feat/factory-verification-score
Jun 4, 2026
Merged

Feat/factory verification score#6
nonlinearnishu merged 3 commits into
mainfrom
feat/factory-verification-score

Conversation

@nonlinearnishu

Copy link
Copy Markdown
Collaborator

No description provided.

nonlinearnishu and others added 3 commits June 4, 2026 16:13
…ation options

feat: add verification-engineer.md and update factory-kit-check.js to support --base, --diff, --json, and --md flags for more flexible verification strategy generation

feat: add scorecard rendering and delta tracking for PRs

feat: add git-related utilities for delta scoring and report generation

feat: add UNCOVERED and UNCOVERED_COUNTS to index.ts for tracking uncovered pitfalls

feat: add score calculation and delta computation for improved reporting and gating capabilities

feat: add new skill for conformance gate and related documentation

feat: add Factory verification documentation with four-tier eval spectrum, score system, delta gate, and guardrails at PR boundary

feat: introduce factory-skill-action, a new Action that synthesizes verification discipline from various existing files and adds an eval spectrum, score model, and delta-gated conformance. This action integrates with `factory-kit-check` and improves the overall verification process in the factory.

feat: add factory-conformance CI job to check for critical-severity findings in PRs
Runs factory-kit-check from source (npm ci → build → node bin/...),
not the published package the shipped template npx's — the kit IS the
package. Same contract: sticky scorecard, gate only on a new critical.
Now that .factory-check.json ignores the kit's own detection-pattern
files, the self-scorecard is clean, so this is safe to wire on.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@github-actions

github-actions Bot commented Jun 4, 2026

Copy link
Copy Markdown

🏭 Factory conformance — ✅ Pass

This PR: ✅ no new criticals

Severity Repo This PR
Critical 0 0
High 0 0
Medium 0 0
Low 0 0

Coverage: 6/48 pitfalls machine-checked (13%).

⚠️ 5 critical-class pitfalls are not machine-checked — a passing grade does not clear them: untested-rollback-shipped-to-prod, prod-destructive-write-no-layer-c-snapshot, llm-auto-runs-runbook-commands, phi-in-email-no-baa-check, ai-generated-code-no-review-queue.

@nonlinearnishu
nonlinearnishu merged commit e807082 into main Jun 4, 2026
2 checks passed
@nonlinearnishu
nonlinearnishu deleted the feat/factory-verification-score branch June 4, 2026 21:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant