@@ -72,28 +72,35 @@ demo is not a task-success rate. Mark missing metrics unmeasured, and remove or
7272qualify unsupported claims rather than manufacturing a comparison.
7373
7474Use [ CONTRIBUTING.md's video guide] ( ../../../CONTRIBUTING.md#agent-video-demos )
75- to prepare, record and attach an agent demo. For agent behavior changes, prefer a
76- short real video (about 20–45 seconds); a terminal recording works for text agents
77- and rails. Screenshots can support the clip or explain a recording gap. Show the
75+ to classify the PR and prepare, record and attach its demo. Important PRs require
76+ a video of the application/task, System1-Agents decision-model agent and actual
77+ System1-Omni inference in the same run. Check all three parts against the linked
78+ trace; a terminal recording works for text agents and rails. Screenshots and logs
79+ support the clip. Use PR #35 's recording linked in the guide as the example and
80+ choose a relevant README application candidate from the guide. Show the
7881relevant input, action sequence, and result, with failures or human intervention
79- visible. Label cuts, replay speed,
80- and elapsed timing honestly; link a fuller trace when a clip omits context. Do not
81- stage screens or present a replay as a live run. A replay must identify the source
82+ visible. Label cuts, replay speed, and elapsed timing honestly; link a fuller
83+ trace when a clip omits context. Do not stage screens or present a replay as a
84+ live run. A replay must identify the source
8285run/commit, workload, and speed; a historical or upstream model demo is not proof
8386that the current agent integration works.
8487
8588Choose figures that answer the review question: workflow screenshots, a short
8689action timeline, or task-success comparisons backed by the run records. There is
87- no asset quota. Nonvisual, docs-only, and test-only changes may use test output or
88- a concise explanation instead of video. If a relevant run cannot be made within
89- the available authorization, resources, or budget, report the gap and its impact;
90- do not turn a missing run into a pass or require a production-scale demonstration.
90+ no asset quota. Only the guide's minor docs/formatting/test-only exemption permits
91+ ` N/A ` with a reason; a nonvisual task still needs a terminal video when the PR is
92+ important. If a required run cannot be made within the available authorization,
93+ resources, or budget, report the gap and its impact; keep the important PR draft
94+ until the video is supplied or a maintainer accepts
95+ the documented exception. Do not turn a missing run into a pass or require a
96+ production-scale demonstration.
9197
9298## PR demo/evidence section
9399
94100Prepare a ** Demo / evidence** section for the PR containing what applies:
95101
96- - Task and observable result, or ` N/A ` with a concrete reason.
102+ - Required application + agents + Omni video and trace, or the documented exemption/blocker.
103+ - Task and observable result, or ` N/A ` for an exempt change with a concrete reason.
97104- Reproduction command/fixture, configuration, and baseline/head commits.
98105- Measured comparison and raw result links, including failures and limitations;
99106 distinguish personally run checks, author-reported results, and observed CI.
@@ -111,9 +118,9 @@ performance claims. Link durable, reviewer-accessible artifacts rather than loca
111118paths. If rights or safe disclosure are unresolved, omit the asset and state why.
112119
113120Check System1-Omni's current model, modality and hardware support as described in
114- the video guide. Try a supported serving path when the branch has a compatible
115- client; otherwise record the missing integration or configuration. Pin both
116- repositories and verify the actual worker/frontend from run evidence. Keep
121+ the video guide. Use a supported serving path for the required video when the
122+ branch has a compatible client; otherwise record the missing integration or
123+ configuration. Pin both repositories and verify the actual worker/frontend from run evidence. Keep
117124agent-task evidence separate from serving/kernel measurements. Do not add an
118125unrequested backend integration or run outside the authorized resources/budget
119126merely to produce a demo.
0 commit comments