{{ message }}
Repository navigation
Every model call uses the workspace's reasoning effort, and none is a value: alignment no longer thinks on its own - #1066
Merged
Conversation
… value: alignment no longer thinks on its own Alignment, rule proposal and the ontology agent used a fixed low, set on 2026-09-24 from a gemini measurement. On deepseek-flash low thinks seven or eight thousand tokens a call: those three steps were six tenths of the tokens per document and four fifths of that was thinking. They now use the workspace's setting like extraction, and the setting accepts none (migration 0105), the only value that turns thinking off on DeepSeek. Measured on 20 Re-DocRED documents with deepseek-flash, thinking off in two groups against the 2026-09-30 run with alignment on low: tokens per document 22k and 19k against 47k, 6 and 4 minutes against 28, judged precision 83.3% and 89.7% against 91.7%. A workspace that wants the old behaviour sets low. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Wayland Yang <wayland0916@gmail.com>
…s migrations 0104 and 0105 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Wayland Yang <wayland0916@gmail.com>
This was referenced Oct 3, 2026
Merged
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.

Why
Alignment (kind words and phrases), rule proposal and the ontology agent used a fixed
lowreasoning effort, whatever the workspace set. That was decided on 2026-09-24 from a gemini measurement. On deepseek-flashlowthinks seven or eight thousand tokens a call: in the warm-base run (#1065) those steps were six tenths of the tokens per document, and four fifths of that was thinking.What changes
chat_client_thinkingandJUDGEMENT_EFFORTare gone; alignment, rule proposal and the ontology agent use the workspace's reasoning effort, like extraction, errata and time interpretation already did.noneis a value. The settings API and the column's CHECK (migration 0105) accept it. DeepSeek ignoresminimal; onlynoneturns its thinking off. The ninth bench run had to drop the CHECK by hand for this.none, and its hint says every call uses the setting and that the value that turns thinking off depends on the endpoint.Behaviour change for existing workspaces: a workspace set to
minimalornoneno longer getslowon alignment. One that wants the old behaviour setslow, which then also applies to extraction.Measured
20 Re-DocRED documents, deepseek-flash,
--judge 200 --errata, fresh base each. Thinking off: this branch, workspacenone, two groups. Alignment onlow: the 2026-09-30 run (dev @ 798fb24, extractionnone).lowlowside is one run, so its own spread is not measured.So this trades some precision and stability for tokens and time, and the workspace chooses. Against 0044's token threshold, 19k to 22k is still more than three times over.
Checked
noneagainst a freshly migrated database, and the model answered with it set.cargo clippy --workspace --all-targets -- -D warnings,cargo fmt --all --check,cargo test -p utopia-cli(schema version 95),-p utopia-llm;pnpm typecheck,pnpm test(228).Notes for landing
CURRENT_SCHEMA_VERSION95. A deleted document's date no longer attests: evidence records when its passage speaks, and attestation is rebuilt from what remains #1059 holds 0104 and also sets 95: whichever lands second sets 96.🤖 Generated with Claude Code