inference with the structured sparsity and quantization
quantization tensorrt structured-sparsity sparsity-pattern ptq sparse-tensor-cores sparse-int8-model accelerate-the-inference
-
Updated
Aug 30, 2023 - Python