[Inference]Fused the gate and up proj in mlp，and optimized the autograd process.#5365
Merged
isky-cd merged 9 commits intohpcaitech:feature/colossal-inferfrom isky-cd:opt_qkv_and_mlpFeb 6, 2024
+484-50
Commits
Commits on Feb 5, 2024
Commits on Feb 6, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed