Issues

• Proposal: a small offline Chinese moderation example

  promptfoo/promptfoo#11902 · Filter by author KRATS1984 opened on Oct 21, 2026

• starts-with and not-starts-with error on a numeric value instead of grading it

  promptfoo/promptfoo#11883 · Filter by author Ridzzz0Alam opened on Oct 20, 2026
  1

• --filter-metadata crashes when a test has a metadata key with a null value

  promptfoo/promptfoo#11857 · Filter by author RaphaelFakhri opened on Oct 19, 2026

• Docs: Demon Route via the generic openai:chat path (uncensored attacker models for redteam.provider)

  promptfoo/promptfoo#11821 · Filter by author demonroute2 opened on Oct 16, 2026

• Documentation example proposal: correctness and safety for an exactly-once browser action

  promptfoo/promptfoo#11818 · Filter by author axay-oxo opened on Oct 16, 2026

• CSV perplexity / perplexity-score assertions without a threshold always fail

  promptfoo/promptfoo#11779 · Filter by author nancy6547 opened on Oct 15, 2026
  2

• Unquoted YAML dates (vars, metadata, assertion values) are silently turned into {} and render as [object Object]

  promptfoo/promptfoo#11775 · Filter by author avanish-garg opened on Oct 15, 2026

• exec: provider splits arguments with quotes in the middle of a token and keeps empty quotes literal

  promptfoo/promptfoo#11773 · Filter by author avanish-garg opened on Oct 15, 2026

• POST /api/redteam/run global job state lets any request cancel the operator's run

  promptfoo/promptfoo#11770 · Filter by author AUTHENSOR opened on Oct 15, 2026
  1

• Hardening for intentionally exposed local servers: body limit, private-range blocking, egress kill switch

  promptfoo/promptfoo#11768 · Filter by author AUTHENSOR opened on Oct 15, 2026
  1

• Unauthenticated local routes proxy to Promptfoo Cloud with the operator's credentials

  promptfoo/promptfoo#11767 · Filter by author AUTHENSOR opened on Oct 15, 2026
  1

• feat(redteam): adaptive ReAct crescendo strategy with turn-by-turn reasoning

  promptfoo/promptfoo#11702 · Filter by author sarosh-quraishi opened on Oct 12, 2026

• Feature proposal: Execute CIGE agentic test cases in Promptfoo (native support or adapter)

  promptfoo/promptfoo#11683 · Filter by author vivekkrishna opened on Oct 11, 2026
  1

• openai:agents ignores invalid retry policies instead of reporting them

  promptfoo/promptfoo#11678 · Filter by author Shizoqua opened on Oct 11, 2026
  1

• Where is the ModelAudit Docker Package?

  promptfoo/promptfoo#11670 · Filter by author ShiroTohu opened on Oct 11, 2026
  1

• not-is-valid-openai-tools-call and not-is-valid-function-call ignore the not- prefix

  promptfoo/promptfoo#11487 · Filter by author kumarpriyanshu09 opened on Oct 8, 2026
  1

• [Feature] Red team plugin for South Korea's Financial Consumer Protection Act (financial:korea-consumer-protection)

  promptfoo/promptfoo#11474 · Filter by author back2zion opened on Oct 8, 2026

• Support multiple values (OR) for a single key in --filter-metadata

  promptfoo/promptfoo#11305 · Filter by author 50kgofpacifictuna opened on Sep 29, 2026

• anthropic:claude-agent-sdk: copy working_dir into a new directory for each call and each repeat

  promptfoo/promptfoo#11057 · Filter by author moltar opened on Sep 24, 2026
  1

• Prp

  promptfoo/promptfoo#11048 · Filter by author annikkarasabik-cmd opened on Sep 23, 2026

• isEmptyResponse treats transport failures (empty, undefined, null) as refusals, so a dead endpoint scores clean on 130 of 138 redteam graders

  promptfoo/promptfoo#11041 · Filter by author shaurya416 opened on Sep 23, 2026
  1

• Chat and Tool discussion, all models supported

  promptfoo/promptfoo#10973 · Filter by author fletort opened on Sep 17, 2026
  2

• --filter-providers makes an exception

  promptfoo/promptfoo#10932 · Filter by author fletort opened on Sep 14, 2026
  1

• Python provider hangs or exits without output after worker crashes or a timeout

  promptfoo/promptfoo#10928 · Filter by author mosafariuk opened on Sep 14, 2026

• --no-cache is ignored when an extension hook imports from promptfoo

  promptfoo/promptfoo#10787 · Filter by author Amiyanshu-web opened on Sep 8, 2026