Update Understanding Transformers.md

swyxio · Dec 3, 2024 · 2c66288 · 2c66288
1 parent 9c8b5c3
commit 2c66288
Showing 1 changed file with 3 additions and 2 deletions.
diff --git a/Resources/Understanding Transformers.md b/Resources/Understanding Transformers.md
@@ -1,4 +1,5 @@
-swyx's to-read list (incl a lot of history)
+swyx's must-read list (incl a lot of history)
+- origins of attention https://x.com/karpathy/status/1864023344435380613
 - https://aman.ai/primers/ai/transformers/
 - https://magazine.sebastianraschka.com/p/understanding-large-language-models
 - visualizing https://poloclub.github.io/transformer-explainer/
@@ -163,4 +164,4 @@ abs: [https://arxiv.org/abs/2209.00099](https://t.co/99Gp0rPZHi)
 
 ## linear transformers
 
-- see https://manifestai.com/blogposts/faster-after-all/
+- see https://manifestai.com/blogposts/faster-after-all/