Controlled study: vary one agent bound (sandbox, budget or network policy) inside a real harness · Issue #5 · harness-db/harness-db · GitHub
Skip to content

Controlled study: vary one agent bound (sandbox, budget or network policy) inside a real harness #5

Open

Description

@bhaskargurram-ai

No published ablation in the 2,824 papers we read varies the sandbox layer, and the budget and governance layers are barely touched. The paper's open-problems section proposes one small controlled study: one harness, one task suite, one bound varied at a few levels.

Wanted. A harness team or a researcher with compute to co-design and run it: pick the harness and suite, pre-register the design on OSF (template: docs/tier3_ablation_protocol.md), run, report. Joint authorship.

Activity

  1. added
    researchNeeds a study design or analysis; can lead to co-authorship
    on Sep 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    researchNeeds a study design or analysis; can lead to co-authorship

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions