fix(contracts): require answers to name scored candidates by rudycelekli · Pull Request #53 · mohit67890/imajev · GitHub
Skip to content

fix(contracts): require answers to name scored candidates - #53

Open
rudycelekli wants to merge 1 commit into
mohit67890:mainfrom
rudycelekli:fix/answered-result-candidate-membership-20261010
Open

rudycelekli wants to merge 1 commit into
mohit67890:mainfrom
rudycelekli:fix/answered-result-candidate-membership-20261010

Conversation

@rudycelekli

Copy link
Copy Markdown
Contributor

Reject an answered Result whose value is absent from its score table or names the reserved unknown candidate. Preserve the canonical score keys for string, integer and Boolean answers, including tied valid candidates.

Validation: four rejection regressions fail on the baseline, with four valid-type controls passing. All45 contract/calibration tests pass after the fix. The available CPU suite reports666 passed,135 skipped and the same three independently reproduced baseline failures caused by unavailable optional test dependencies. Full collection requires Torch; no GPU/model or full-suite pass is claimed.

Signed-off-by: Rudy Celekli <rudy@gradiahq.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant