A document that states no date is not asked for one by WaylandYang · Pull Request #998 · deeplethe/utopia · GitHub
Skip to content

A document that states no date is not asked for one - #998

Merged
WaylandYang merged 2 commits into
devfrom
fix/no-dating-call
Sep 28, 2026
Merged

WaylandYang merged 2 commits into
devfrom
fix/no-dating-call

Conversation

@WaylandYang

Copy link
Copy Markdown
Contributor

0064 decision 1 says the separate call that read a date off the opening goes away. Cut 2 (#991) kept it as a fallback for documents where extraction reported no entry, which I did not make plain enough at the time.

With usage labelled by call (#996), on twenty Re-DocRED documents: sixteen took the fallback, each asking the question extraction had just answered with "none" and getting the same answer, about 940 tokens a document (2.3% of the total). On the time bench every document that states a date had it reported by extraction; the fallback never found one that was missed.

The resolver no longer calls the model for the document's date. A document whose extraction reported none has none: a relative expression in it waits at grade C and its statements carry no attestation. A date stored by the old call on a document extracted before cut 2 is still read.

Test: a_document_that_states_no_date_is_not_asked_for_one (scripted model: two requests, neither the dating prompt; the time word at grade C; no attestation).

🤖 Generated with Claude Code

WaylandYang and others added 2 commits September 28, 2026 17:24
0064 decision 1 says the separate call that read a date off the opening
goes away. Cut 2 kept it as a fallback for documents where extraction
reported no entry. With usage labelled by call (#996), twenty Re-DocRED
documents: sixteen took the fallback, each asking the question extraction
had just answered with "none" and getting the same answer, about 940
tokens a document. On the time bench every document that states a date
had it reported by extraction; the fallback never found one that was
missed.

The resolver no longer calls the model for the document's date. A
document whose extraction reported none has none: a relative expression
in it waits at grade C and its statements carry no attestation. A date
stored by the old call on a document extracted before cut 2 is still
read.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Signed-off-by: Wayland Yang <wayland0916@gmail.com>
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Signed-off-by: Wayland Yang <wayland0916@gmail.com>
@WaylandYang
WaylandYang merged commit b036f45 into dev Sep 28, 2026
@WaylandYang
WaylandYang deleted the fix/no-dating-call branch September 28, 2026 09:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant