OnnxSlim

OnnxSlim can help you slim your onnx model, with less operators, but same accuracy, better inference speed.

🚀 OnnxSlim is merged to mnn-llm, performance increased by 5%
🚀 Rank 1st in the AICAS 2024 LLM inference optimiztion challenge held by Arm and T-head

Installation

pip install onnxslim

pip install .

onnxslim your_onnx_model slimmed_onnx_model

For more usage, see onnxslim -h or refer to our examples

onnx-graphsurgeon

Polygraphy

onnx-simplifier

tabulate

onnxruntime