Skip to content

fix(submit): harden trusted submission ingestion#443

Open
ShivamB25 wants to merge 5 commits into
junhoyeo:mainfrom
ShivamB25:split/submit-trust-gate
Open

fix(submit): harden trusted submission ingestion#443
ShivamB25 wants to merge 5 commits into
junhoyeo:mainfrom
ShivamB25:split/submit-trust-gate

Conversation

@ShivamB25
Copy link
Copy Markdown

@ShivamB25 ShivamB25 commented Apr 18, 2026

Summary

  • harden the submit boundary before competitive data is written
  • return explicit trust-state decisions for trusted, rejected, and review-required submissions
  • fix legacy token writes and dated snapshot parsing at the submit layer

Changes

  • reject malformed, empty, duplicate-date, unsupported-client, negative-counter, and future-dated payloads before persistence
  • add submit trust decisioning with machine-readable reason codes
  • defer legacy token upgrades until accepted writes
  • parse separated snapshot model dates such as gpt-4o-2024-08-06

Testing

  • frontend Vitest coverage for submit validation and trust decisioning
  • frontend typecheck
  • frontend build
  • local runtime verification against the app and Postgres

Refs #441

@vercel
Copy link
Copy Markdown
Contributor

vercel Bot commented Apr 18, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
tokscale Ready Ready Preview, Comment Apr 18, 2026 9:54pm

Request Review

Copy link
Copy Markdown
Contributor

@cubic-dev-ai cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

2 issues found across 14 files

Prompt for AI agents (unresolved issues)

Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.


<file name="packages/frontend/src/lib/validation/submissionTrust.ts">

<violation number="1" location="packages/frontend/src/lib/validation/submissionTrust.ts:33">
P1: Unvalidated `timestampMs` conversion can throw `RangeError` and crash trust assessment instead of returning structured trust-state output.</violation>
</file>

<file name="packages/frontend/src/lib/db/migrations/0005_concerned_justin_hammer.sql">

<violation number="1" location="packages/frontend/src/lib/db/migrations/0005_concerned_justin_hammer.sql:5">
P2: `submission_reviews` lacks DB integrity constraints for trust state/domain and numeric/date invariants, allowing invalid records despite ingestion hardening.</violation>
</file>

Reply with feedback, questions, or to request a fix. Tag @cubic-dev-ai to re-run a review.

Comment thread packages/frontend/src/lib/validation/submissionTrust.ts Outdated
@ShivamB25
Copy link
Copy Markdown
Author

ShivamB25 commented May 2, 2026

@junhoyeo @IvGolovach sorry to bother you I may be missing context here, but I noticed the public all-time leaderboard still appears to show some unusually large entries (hundreds of billions of tokens / very large cost totals across a relatively small number of submits).

Since this PR is focused on hardening submit trust/persistence, could you share whether there has already been any review/backfill/removal plan for existing inflated leaderboard rows, or if there are follow-up steps planned? Thanks for taking a look.

@junhoyeo
Copy link
Copy Markdown
Owner

junhoyeo commented May 2, 2026

@ShivamB25 Hi, thank you for all your efforts! I’ll definitely review them when I have some spare time.

@ShivamB25
Copy link
Copy Markdown
Author

ShivamB25 commented May 2, 2026 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants