[kernel] Add RMSLayerNorm triton kernel#5262

Merged

yuanheng-zhao merged 5 commits intohpcaitech:feature/colossal-inferfrom nkfyz:feat/kernels/fused_layerrmsnorm

Jan 18, 2024

+103-62

Commits on Jan 12, 2024

Commits on Jan 16, 2024

Remove the logics of mean computations, and update the name of ther kernel functions and files
nkfyz
committed

Commits on Jan 17, 2024

add benchmark of rms norm
nkfyz
committed