Search results

Try pytorch inference mode

Status: Open.

#12 In bigcode-project/bigcode-inference-benchmark;

· jlamypoirier opened on Jan 30, 2023

Inference tasks and milestones

Status: Open.

#11 In bigcode-project/bigcode-inference-benchmark;

· jlamypoirier opened on Jan 26, 2023

Improve inference speed of multi-query attention model

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#3 In bigcode-project/bigcode-inference-benchmark;

· harm-devries opened on Sep 23, 2022