You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
createAI: add an evaluation model for Clef (experimental_evaluate) #2630
createAI has no evaluation model, so Clef (@cf/cloudflare/clef, @cf/cloudflare/clef-flash) can't be used with the AI SDK's experimental_evaluate (EvaluationModelV4, ai@7.0.103+).
constai=createAI({binding: env.AI});const{ answers }=awaitevaluate({model: ai.evaluation("@cf/cloudflare/clef"),// doesn't existstate: "Checkout has been failing for every customer for the last hour.",questions: {urgent: {type: "boolean",instructions: "Is this urgent?"}}});
The modality methods live in packages/agents/src/models/ai-sdk/index.ts and ai-sdk/models/modality.ts; there is no evaluation alongside embedding, image, speech, transcription and reranking. cloudflare/ai#670 has a working EvaluationModelV4 for the old package (maps boolean to Clef's noul, forwards images, exposes confidence and legend in provider metadata) that could be ported.
Activity