The GLiNER side-by-side covers English and the single-pass case by WaylandYang · Pull Request #309 · deeplethe/utopia · GitHub
Skip to content

The GLiNER side-by-side covers English and the single-pass case - #309

Merged
WaylandYang merged 1 commit into
devfrom
bench/gliner-report
Sep 4, 2026
Merged

WaylandYang merged 1 commit into
devfrom
bench/gliner-report

Conversation

@WaylandYang

Copy link
Copy Markdown
Contributor

Follow-up to #305. Adds the English translations of the pharma and tech corpora with matching answer keys, and rewrites the GLiNER section of the bench README as a full report: conditions, four label settings (answer-key classes, 965 classes in batches, 965 classes in one pass), Chinese and English tables, timings, and the reading.

The new rows: with all 965 labels in a single pass GLiNER finds 0, 0, 4 and 2 entities across the four corpora, because the labels fill the encoder window and the text is truncated away. On English its recall is complete in the batched setting while type precision still falls to 13/20 and 4/14 against 19/20 and 12/13 for the pipeline after type resolution.

🤖 Generated with Claude Code

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Signed-off-by: Wayland Yang <wayland0916@gmail.com>
@WaylandYang
WaylandYang merged commit e6c3875 into dev Sep 4, 2026
@WaylandYang
WaylandYang deleted the bench/gliner-report branch September 4, 2026 09:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant