Skip to content

Commit

Permalink
Rename normalization_variations to norm_variations
Browse files Browse the repository at this point in the history
  • Loading branch information
gkielian committed Apr 18, 2024
1 parent 3ea7279 commit 9c8a4df
Show file tree
Hide file tree
Showing 2 changed files with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion model.py
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@

# Variations
from variations.softmax_variations import Softermax, Constantmax, Constantmax_quan, Strongermax, Polymax, SigSoftmax, ExpPolymax, SaturatingConSmax
from variations.normalization_variations import norm_dictionary, LayerNorm, RMSNorm, pRMSNorm
from variations.norm_variations import norm_dictionary, LayerNorm, RMSNorm, pRMSNorm
from variations.position_encoding_variations import RotaryEmbedding, ShortRope, SymmetricalOverlapAngularPositions, FIRE
from variations.activation_variations import SquaredReLU, activation_dictionary
from variations.linear_variations import BitLinear1p58, BitLinear, BitLinearOptimized, linear_dictionary
Expand Down
File renamed without changes.

0 comments on commit 9c8a4df

Please sign in to comment.