Skip to content

Actions: gkielian/ReaLLMASIC_nanogpt

Install Then Test All activations

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
247 workflow runs
247 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Clean normalization selection implementation
Install Then Test All activations #47: Commit 3ea7279 pushed by gkielian
April 18, 2024 18:49 3m 37s add_more_normalization_variations
April 18, 2024 18:49 3m 37s
Add partial RMSnorm "pRMSNorm" variation
Install Then Test All activations #46: Commit fa56821 pushed by gkielian
April 18, 2024 03:46 3m 35s add_more_normalization_variations
April 18, 2024 03:46 3m 35s
Add inspect_ckpts.py instructions to README.md
Install Then Test All activations #45: Commit 386bd36 pushed by gkielian
April 17, 2024 22:39 3m 38s add_checkpoint_inspector
April 17, 2024 22:39 3m 38s
Add inspect_ckpts.py instructions to README.md
Install Then Test All activations #44: Commit a951721 pushed by gkielian
April 17, 2024 22:29 3m 46s add_checkpoint_inspector
April 17, 2024 22:29 3m 46s
Add inspect_ckpts.py instructions to README.md
Install Then Test All activations #43: Commit 933659c pushed by gkielian
April 17, 2024 22:29 3m 44s add_checkpoint_inspector
April 17, 2024 22:29 3m 44s
Add compatibility for color mode for watch command
Install Then Test All activations #42: Commit 8de824f pushed by gkielian
April 17, 2024 20:13 3m 50s add_checkpoint_inspector
April 17, 2024 20:13 3m 50s
Add option to view results from existing csv file
Install Then Test All activations #41: Commit 8bd9346 pushed by gkielian
April 17, 2024 20:04 3m 41s add_checkpoint_inspector
April 17, 2024 20:04 3m 41s
Add template for simple inference
Install Then Test All activations #40: Commit 2cfb346 pushed by gkielian
April 17, 2024 03:00 1m 26s add_vector_tokenization
April 17, 2024 03:00 1m 26s
Add visualization and inference scripts
Install Then Test All activations #39: Commit 8876a98 pushed by gkielian
April 16, 2024 21:59 1m 25s add_vector_tokenization
April 16, 2024 21:59 1m 25s
Fix multigpu training for train.py script
Install Then Test All activations #38: Commit 3ffa9b9 pushed by gkielian
April 16, 2024 15:27 6m 25s multigpu_training_fix
April 16, 2024 15:27 6m 25s
Fix the FIRE implementation to utilize division
Install Then Test All activations #37: Commit a9fe238 pushed by gkielian
April 11, 2024 04:52 3m 32s add_fire_positional_embeddings
April 11, 2024 04:52 3m 32s
Add FIRE Positional Encoding
Install Then Test All activations #36: Commit 633b997 pushed by gkielian
April 10, 2024 21:35 3m 43s add_fire_positional_embeddings
April 10, 2024 21:35 3m 43s
Add FIRE Positional Encoding
Install Then Test All activations #35: Commit 4db9a88 pushed by gkielian
April 10, 2024 21:26 3m 37s add_fire_positional_embeddings
April 10, 2024 21:26 3m 37s
Add FIRE Positional Encoding
Install Then Test All activations #34: Commit e269e89 pushed by gkielian
April 10, 2024 21:25 3m 37s add_fire_positional_embeddings
April 10, 2024 21:25 3m 37s
Add Era of 1.58 bit LLMs BitLinear implementation
Install Then Test All activations #33: Commit c337068 pushed by gkielian
April 10, 2024 03:37 3m 32s add_linear_variations
April 10, 2024 03:37 3m 32s
Moved linear dictionary to bottom for ordering
Install Then Test All activations #32: Commit 5290cd4 pushed by gkielian
April 9, 2024 23:16 3m 43s add_linear_variations
April 9, 2024 23:16 3m 43s
Add test sweep for mlp parallelization
Install Then Test All activations #31: Commit 6b4c05c pushed by gkielian
April 9, 2024 03:01 3m 36s add_parallel_mlp_attn_option
April 9, 2024 03:01 3m 36s
Add fire positional encoding
Install Then Test All activations #30: Commit d8d6502 pushed by gkielian
April 7, 2024 09:10 12m 50s add_fire_attn
April 7, 2024 09:10 12m 50s
Merge pull request #114 from mmoffatt2/master
Install Then Test All activations #29: Commit c3259c2 pushed by gkielian
April 7, 2024 09:04 11m 31s add_fire_attn
April 7, 2024 09:04 11m 31s
Add powernorm normalization_variations
Install Then Test All activations #28: Commit 21bde84 pushed by gkielian
April 3, 2024 02:44 3m 51s add_layernorm_variations_2
April 3, 2024 02:44 3m 51s
Add elementwise powernorm
Install Then Test All activations #27: Commit 7f3f085 pushed by gkielian
March 29, 2024 22:51 3m 38s add_layernorm_variations
March 29, 2024 22:51 3m 38s
Add support for experimental layernorm variations
Install Then Test All activations #26: Commit 26874d7 pushed by gkielian
March 27, 2024 04:36 3m 32s add_layernorm_variations
March 27, 2024 04:36 3m 32s
Merge pull request #130 from klei22/add_mixtral8x7b_example
Install Then Test All activations #25: Commit 1a24fe6 pushed by gkielian
March 27, 2024 04:26 3m 59s add_layernorm_variations
March 27, 2024 04:26 3m 59s
Merge branch 'master' into add_softmax_sweep
Install Then Test All activations #24: Commit c2da3c5 pushed by gkielian
March 20, 2024 21:43 3m 31s add_softmax_sweep
March 20, 2024 21:43 3m 31s
Add cleaner shared_mlp/shared_attn implementation
Install Then Test All activations #23: Commit 6c7c02d pushed by gkielian
March 20, 2024 01:38 3m 28s add_mlp_attn_groups
March 20, 2024 01:38 3m 28s