Code

Add fp8 support moe models#2928

Code

Merged

danieldk merged 2 commits intomainhuggingface/text-generation-inference:mainfrom add_moe_fp8huggingface/text-generation-inference:add_moe_fp8Copy head branch name to clipboardJan 29, 2025

+181-24

Commits

Commits on Jan 20, 2025

• Add fp8 support moe models

  mht-sharma

  committed
  1616260

  Copy full SHA for 1616260

Commits on Jan 29, 2025

• flatten condition

  mht-sharma

  committed
  7be2a5f

  Copy full SHA for 7be2a5f