Skip to content

Actions: gkielian/ReaLLMASIC_nanogpt

Actions

Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
cpu-basic-install-prepare-train-inf-test.yml
364 workflow runs
364 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Enable flash attention for specified conditions Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #114: Commit 32662da pushed by gkielian
March 10, 2024 18:58 1m 26s add_gqa_and_new_rope_variant
add_gqa_and_new_rope_variant
March 10, 2024 18:58 1m 26s
Fix control flow for attention mask Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #113: Commit 7e9b7cf pushed by gkielian
March 10, 2024 01:33 1m 21s add_gqa_and_new_rope_variant
add_gqa_and_new_rope_variant
March 10, 2024 01:33 1m 21s
Add config sweep for gqa settings Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #112: Commit ec35783 pushed by gkielian
March 9, 2024 20:11 1m 22s add_gqa_and_new_rope_variant
add_gqa_and_new_rope_variant
March 9, 2024 20:11 1m 22s
Adding todos for updating original rope variations Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #111: Commit 9d807a3 pushed by gkielian
March 9, 2024 19:58 1m 29s add_gqa_and_new_rope_variant
add_gqa_and_new_rope_variant
March 9, 2024 19:58 1m 29s
Update documentation Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #110: Commit 647359e pushed by gkielian
March 5, 2024 06:01 1m 23s documentation_updates
documentation_updates
March 5, 2024 06:01 1m 23s
Update the wikitext prepare.py file Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #109: Commit 0becfe3 pushed by gkielian
March 4, 2024 06:53 1m 36s add_parameter_groups
add_parameter_groups
March 4, 2024 06:53 1m 36s
Remove --value_only from run_curriculum.py Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #108: Commit 1f88bdd pushed by gkielian
March 4, 2024 06:06 1m 27s add_parameter_groups
add_parameter_groups
March 4, 2024 06:06 1m 27s
Add fallback for tensorboard command Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #107: Commit 919a70d pushed by gkielian
March 4, 2024 05:53 1m 40s add_parameter_groups
add_parameter_groups
March 4, 2024 05:53 1m 40s
Patch: gated attn and sliding window Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #106: Commit 03481de pushed by gkielian
March 4, 2024 00:01 1m 23s patch_gated_attn_sliding_window
patch_gated_attn_sliding_window
March 4, 2024 00:01 1m 23s
Created using Colaboratory Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #105: Commit 5ff1bf5 pushed by gkielian
March 2, 2024 02:52 1m 26s main
main
March 2, 2024 02:52 1m 26s
Created using Colaboratory Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #104: Commit 81cd792 pushed by gkielian
March 1, 2024 23:53 1m 24s main
main
March 1, 2024 23:53 1m 24s
Make value_only default behaviour Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #103: Commit d804f02 pushed by gkielian
March 1, 2024 21:48 1m 22s improve_activation_methodology
improve_activation_methodology
March 1, 2024 21:48 1m 22s
Add Shared MLP Option Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #102: Commit 5581179 pushed by gkielian
March 1, 2024 21:32 1m 25s main
main
March 1, 2024 21:32 1m 25s
Created using Colaboratory Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #101: Commit 653fa08 pushed by gkielian
March 1, 2024 21:02 1m 28s main
main
March 1, 2024 21:02 1m 28s
Created using Colaboratory Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #100: Commit 8631381 pushed by gkielian
February 28, 2024 19:20 1m 38s main
main
February 28, 2024 19:20 1m 38s
Add option for sharing attn weights across layers Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #99: Commit f294933 pushed by gkielian
February 28, 2024 03:25 1m 30s add_option_for_shared_mlp
add_option_for_shared_mlp
February 28, 2024 03:25 1m 30s
Add option for sharing attn weights across layers Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #98: Commit 22d4b77 pushed by gkielian
February 28, 2024 03:20 1m 29s add_option_for_shared_mlp
add_option_for_shared_mlp
February 28, 2024 03:20 1m 29s
Add option for sharing MLP across layers Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #97: Commit a18eca1 pushed by gkielian
February 28, 2024 03:00 1m 37s add_option_for_shared_mlp
add_option_for_shared_mlp
February 28, 2024 03:00 1m 37s
Add check to exit training on NaN Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #96: Commit beb3b71 pushed by gkielian
February 27, 2024 07:32 1m 32s add_exit_nan
add_exit_nan
February 27, 2024 07:32 1m 32s
Add curriculum patch Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #95: Commit e508351 pushed by gkielian
February 27, 2024 05:44 1m 42s add_curriculum_patch
add_curriculum_patch
February 27, 2024 05:44 1m 42s
Add fix for run_experiments.py Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #94: Commit 47c8bbe pushed by gkielian
February 26, 2024 21:10 1m 49s add_combined_support_for_lists_conditions_ranges
add_combined_support_for_lists_conditions_ranges
February 26, 2024 21:10 1m 49s
Add formatter patch Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #93: Commit ffc2afa pushed by gkielian
February 9, 2024 20:28 1m 37s xsum_pr_patch
xsum_pr_patch
February 9, 2024 20:28 1m 37s
Add means for beta, gamma, in and out logging Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #92: Commit 57e102e pushed by gkielian
January 29, 2024 08:01 1m 21s logging_beta_gamma_etc
logging_beta_gamma_etc
January 29, 2024 08:01 1m 21s
Add folder for contributed colabs Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #91: Commit 7c10266 pushed by gkielian
January 27, 2024 00:41 1m 33s main
main
January 27, 2024 00:41 1m 33s
Correct nomenclature for postln preln Basic Pytorch Installation, Data Prep, CPU Training, CPU Inference #90: Commit 12d0a2a pushed by gkielian
January 21, 2024 01:22 1m 21s wikitext103_test_replication
wikitext103_test_replication
January 21, 2024 01:22 1m 21s
ProTip! You can narrow down the results and go further in time using created:<2024-01-21 or the other filters available.