docs: update Tallyman Agent Time reporting by mattvollmer · Pull Request #28275 · coder/coder · GitHub
Skip to content

docs: update Tallyman Agent Time reporting - #28275

Merged
mattvollmer merged 12 commits into
mainfrom
matt/update-tallyman-docs
Aug 19, 2026
Merged

docs: update Tallyman Agent Time reporting#28275
mattvollmer merged 12 commits into
mainfrom
matt/update-tallyman-docs

Conversation

@mattvollmer

Copy link
Copy Markdown
Contributor

Moves Coder Agents usage reporting into the Licensing & Usage page and updates the documentation to describe Agent Time and the hb_agent_runtime_v1 Tallyman payload.

Removes the superseded Usage Data Reporting page and its manifest entry, and removes the obsolete AI Governance link to that page.

PR generated with Coder Agents

Moves Coder Agents usage reporting into the Licensing & Usage page and
updates the documentation to describe Agent Time and the
hb_agent_runtime_v1 Tallyman payload.

Removes the superseded Usage Data Reporting page and its manifest
entry, and removes the obsolete AI Governance link to that page.
@github-actions

github-actions Bot commented Aug 18, 2026

Copy link
Copy Markdown
Contributor

Removes the Coder Tasks and Agent Workspace Build usage-measurement
section from the AI Governance page. AI Governance is not a
prerequisite for usage-based billing, so this content doesn't belong
on the governance page.
@mattvollmer mattvollmer changed the title docs(ai-coder): update Tallyman Agent Time reporting docs: update Tallyman Agent Time reporting Aug 18, 2026
Comment thread docs/ai-coder/agents/licensing-usage.md Outdated
Comment thread docs/ai-coder/agents/licensing-usage.md Outdated
Comment thread docs/ai-coder/agents/licensing-usage.md Outdated
Comment thread docs/ai-coder/agents/licensing-usage.md Outdated
Rephrases the Agent Time definition to avoid the word runtime, and
removes the stream-retries, local-tool-execution, and failed-model-call
bullets per review feedback.
@mattvollmer
mattvollmer requested a review from jaaydenh August 18, 2026 20:09
@mattvollmer
mattvollmer marked this pull request as ready for review August 18, 2026 20:09
@mattvollmer

Copy link
Copy Markdown
Contributor Author

I'll open a PR in coder/coder.com to redirect the removed page.

@coderagents

coderagents Bot commented Aug 18, 2026

Copy link
Copy Markdown
Contributor

Documentation Check

This is a docs PR, so the findings below are about consistency gaps the change leaves behind, not missing docs for code.

Updates Needed

  • docs/reference/glossary.md - Resolved in 5dfa2ad by removing the Agent Workspace Build entry and dropping the "expands Agent Workspace Build allowances" claim from the AI Governance entry, so the glossary no longer points readers to content that was deleted.
  • docs/ai-coder/tasks.md - repointed the AWB note (the a2c5304 edit was reverted in 5dfa2ad)

    ⚠️ Reverted. Line 25 again tells readers to "use AI Governance features, [AI Governance]... provides expanded usage pools that grow with your user count," but ai-governance.md no longer documents Agent Workspace Build pools/limits after this PR. Either restore a brief AWB usage note on ai-governance.md or soften this pointer.

  • docs/ai-coder/index.md - The dangling "Expanded Agent Workspace Build allowances" bullet pointing to AI Governance was removed. Fixed in a2c5304.
  • docs/images/admin/ai-governance-awb-usage.png - Orphaned image deleted. Fixed in a2c5304.

New Documentation Needed

  • docs/reference/glossary.md - 5dfa2ad also removed the Coder Tasks glossary entry, but Coder Tasks is a deprecated-yet-still-documented term (dedicated docs/ai-coder/tasks.md page and widespread use across docs/ai-coder/). Per the glossary rule, a deprecated term should keep an entry that says it is deprecated and names Coder Agents as the replacement, rather than being deleted. Consider retaining a deprecation entry.

External follow-up

  • docs/ai-coder/usage-data-reporting.md is deleted, so a redirect entry in coder/coder.com:redirects.json is required. The author noted they will open that PR.

    ⚠️ External repo, cannot be verified from this PR.


Automated review via Coder Agents

@nickvigilante nickvigilante left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! No notes aside from what Documentation Check flagged :shipit: 🚀

…ce cleanup

Update glossary, tasks, and index pages to stop pointing readers to
ai-governance.md for Agent Workspace Build details that were removed.
Delete the orphaned ai-governance-awb-usage.png screenshot.

Copy link
Copy Markdown
Contributor Author

Replying to the doc-check comment.

All items addressed in commit a2c5304:

  • docs/reference/glossary.md: The Agent Workspace Build entry now points to tasks.md instead of ai-governance.md. The AI Governance entry no longer claims it "expands Agent Workspace Build allowances."
  • docs/ai-coder/tasks.md: The 1,000-build note now self-contains the scaling explanation and links to ai-governance.md only for AI Governance features, not for AWB limit details.
  • docs/ai-coder/index.md: Removed the "Expanded Agent Workspace Build allowances" bullet from the AI Governance feature list, since ai-governance.md no longer documents AWB.
  • docs/images/admin/ai-governance-awb-usage.png: Deleted. No remaining references.
  • External follow-up: The coder/coder.com redirect for the deleted usage-data-reporting.md page is in coder/coder.com#1015, which should merge after this PR.

PR generated with Coder Agents

…ks.md

Remove the Agent Workspace Build and Coder Tasks glossary entries and
the Coder Tasks mention from the Coding agent entry. Revert the tasks.md
note to its original text since the Coder Tasks page removal is handled
by a separate PR.

Copy link
Copy Markdown
Contributor Author

Updated approach per feedback (commits a2c5304 and 5dfa2ad):

  • docs/reference/glossary.md: Removed the entire Agent Workspace Build entry, the entire Coder Tasks entry, and the Coder Tasks mention from the Coding agent entry. No AWB or Coder Tasks references remain.
  • docs/ai-coder/tasks.md: Reverted. The Coder Tasks page removal is handled by a separate open PR, so this page is left unchanged.
  • docs/ai-coder/index.md: Removed the "Expanded Agent Workspace Build allowances" bullet from the AI Governance feature list.
  • docs/images/admin/ai-governance-awb-usage.png: Deleted. No remaining references.
  • External follow-up: The coder/coder.com redirect for the deleted usage-data-reporting.md page is in coder/coder.com#1015, which should merge after this PR.

PR generated with Coder Agents

Coder Agents is a native harness, not a runner for third-party agents
like Claude Code. The Coding agent entry now defines the term without
tying it to the Coder Agents product.
Auditing, Restricting, Centralizing, Standardizing, and Measuring
headings now use imperative mood per the style guide.
Comment thread docs/ai-coder/agents/licensing-usage.md
Comment thread docs/ai-coder/agents/licensing-usage.md

Copy link
Copy Markdown
Contributor

Two accuracy tweaks for the Agent Time usage reporting section (hb_agent_runtime_v1):

  1. Publish cadence. "Coder attempts to publish usage data approximately every 17 minutes" describes the publisher's check interval, but a request is only sent when unpublished events exist. Each hb_agent_runtime_v1 event is generated once per UTC hour, about 5 minutes after the hour closes (plus a few minutes of jitter), then shipped on the next 17-minute check. In steady state that's roughly one request per hour, with an hour's event reaching Tallyman within ~25 minutes of that hour ending. Worth clarifying so readers don't expect the 14:00 event in logs before ~15:05.

  2. Backfill. After downtime, Coder regenerates missed hourly events (zero-filled for idle hours) for up to 7 trailing days, so a single publish can contain multiple events (batched up to 100 per request). Hours missing beyond 7 days are not reported.

Suggested wording for the cadence paragraph:

Coder generates one hb_agent_runtime_v1 event for each UTC hour shortly after the hour ends, and checks for unpublished events approximately every 17 minutes, so each hour's usage typically reaches Tallyman within about 25 minutes. If the deployment was offline, Coder backfills missed hours for up to seven days.

Clarify context compaction as summarization and describe interrupted
generation as time streamed or spent executing tools before the
interrupt, kept on the partial assistant messages.
…xcludes

Add abbreviated bullets for failed/retried model calls and
client-executed tools handed off to external coding agents, per
review feedback.
@mattvollmer

Copy link
Copy Markdown
Contributor Author

Distinguish the hourly event generation cadence from the 17-minute
publish check interval, and document the 7-day backfill window with
its 100-event batch size.
@mattvollmer
mattvollmer requested a review from jaaydenh August 19, 2026 13:35
@mattvollmer
mattvollmer enabled auto-merge (squash) August 19, 2026 13:44
@mattvollmer
mattvollmer dismissed jaaydenh’s stale review August 19, 2026 13:51

applied rec'd changes. can add follow-ups in another PR if/when necessary.

@mattvollmer
mattvollmer merged commit ddf2d33 into main Aug 19, 2026
29 checks passed
@mattvollmer
mattvollmer deleted the matt/update-tallyman-docs branch August 19, 2026 13:51
@github-actions github-actions Bot locked and limited conversation to collaborators Aug 19, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants