Skip to content

Commit

Permalink
Update sweep for functional interpolation pos emb
Browse files Browse the repository at this point in the history
  • Loading branch information
gkielian committed Apr 29, 2024
1 parent fb74670 commit 28b93a7
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions explorations/fire_sweep.json
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@
"block_size":["256"],
"device": ["cuda"],
"dataset": ["shakespeare_char"],
"compile": [true],
"compile": [false],
"save_nan_checkpoint": [true],
"use_rotary_embeddings": [false],
"use_abs_pos_embeddings": [false],
Expand All @@ -21,7 +21,7 @@
"seed": {
"range": {
"start": 1,
"end": 2,
"end": 1,
"step": 1
}
}
Expand Down

0 comments on commit 28b93a7

Please sign in to comment.