added query-key norm to accomodate OLMo2#1894

Merged

Andrei-Aksionov merged 6 commits intoLightning-AI:mainfrom ysjprojects:norm_qk

Jan 2, 2025

+14

Commits on Dec 28, 2024

added query-key norm to accomodate OLMo2
ysjprojects
committed

Commits on Dec 30, 2024

Commits on Jan 1, 2025

refactoring
ysjprojects
committed

Commits on Jan 2, 2025

Merge branch 'main' into norm_qk
ysjprojects
authored