Search results

quik.matmul.int8SpMatmul Question

Status: Open.

#15 In IST-DASLab/QUIK;

· yeliang2258 opened on Aug 12, 2024

int8FusedDequantizeCUDA Inference Results are Incorrect

Status: Open.

#14 In IST-DASLab/QUIK;

· zkf331 opened on May 29, 2024

how to build cutlass library only with kernels that used in QUIK?

Status: Open.

#12 In IST-DASLab/QUIK;

· ThisisBillhe opened on Jan 5, 2024

[Question] Does QUIK support muiti-batch inference?

Status: Open.

#11 In IST-DASLab/QUIK;

· hanrui1sensetime opened on Dec 20, 2023

[Question] How to get act_scales of custom llama-like model? How much calibration data items do we need? Need act_zeros simultaneously?

Status: Open.

#10 In IST-DASLab/QUIK;

· hanrui1sensetime opened on Dec 7, 2023