Proposal: a small offline Chinese moderation example · Issue #11902 · promptfoo/promptfoo · GitHub
Skip to content

Proposal: a small offline Chinese moderation example #11902

Open

Description

@KRATS1984

Hi maintainers, would a small Chinese moderation example be useful?

I have a working prototype with 12 synthetic cases covering abuse, quoted reports, and prevention messages. It requires no API key and uses fixed predictions to demonstrate false positives, false negatives, precision, recall, and F1 through existing Promptfoo features.

I saw eval-f-score and eval-moderation. Would you prefer a new example or an addition to one of those?

The prototype was tested on Promptfoo 0.124.1. The cases and proposed labels were AI-assisted and still need human review. I'd welcome your guidance before preparing a PR.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions