Skip to content

Commit

Permalink
Update strongermax strength to default at "e"
Browse files Browse the repository at this point in the history
  • Loading branch information
gkielian committed Oct 8, 2024
1 parent 5c32aac commit 1405df4
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion train.py
Original file line number Diff line number Diff line change
Expand Up @@ -343,7 +343,7 @@ def parse_args():
model_group.add_argument("--sigsoftmax_base", type=float, default=2.0)

### Strongermax Options - Testing Incremental Adjustments to Regular Softmax
model_group.add_argument("--strongermax_strength", type=float, default=4.0)
model_group.add_argument("--strongermax_strength", type=float, default=2.718)
model_group.add_argument('--strongermax_sum_to_1', default=True, action=argparse.BooleanOptionalAction)
model_group.add_argument("--strongermax_divisor", type=float, default=1.0)
model_group.add_argument('--strongermax_use_xmax', default=True, action=argparse.BooleanOptionalAction)
Expand Down

0 comments on commit 1405df4

Please sign in to comment.