Skip to content
#

multi-head-self-attention

Star

Here are 6 public repositories matching this topic...

Language: All
Filter by language
All 6 Python 4 Jupyter Notebook 2
BabyGPT-Build_GPT_From_Scratch

TatevKaren / BabyGPT-Build_GPT_From_Scratch

Star 52

BabyGPT: Build Your Own GPT Large Language Model from Scratch Pre-Training Generative Transformer Models: Building GPT from Scratch with a Step-by-Step Guide to Generative AI in PyTorch and Python

python transformers pytorch neural-networks gpt layer-normalization attention-is-all-you-need multi-head-self-attention gpt-3 dropout-layers residual-connections large-language-models llms llm-training
  • Updated Dec 5, 2023
  • Python

Improve this page

Add a description, image, and links to the multi-head-self-attention topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the multi-head-self-attention topic, visit your repo's landing page and select "manage topics."

Learn more