Issues

• check_currentmetric() inverts accuracy/f1: exact-match generations score 0.0, all-wrong/empty generations score 1.0

  codefuse-ai/codefuse-evaluation#14 · Filter by author shaurya416 opened on Sep 24, 2026

• Any related paper?

  codefuse-ai/codefuse-evaluation#10 · Filter by author zhimin-z opened on Jun 26, 2024

• Add natural language to code evaluation language dataset for Java and JavaScript.

  codefuse-ai/codefuse-evaluation#9 · Filter by author HotSummer888 opened on Jun 5, 2024

• 是不是可以增加基于api的测试

  codefuse-ai/codefuse-evaluation#8 · Filter by author luckfu opened on Apr 30, 2024
  1