Code

Add support for Llama3-70b#101

Code

Merged

bhavya01 merged 7 commits intomainAI-Hypercomputer/jetstream-pytorch:mainfrom llama3-70bAI-Hypercomputer/jetstream-pytorch:llama3-70bCopy head branch name to clipboardJun 10, 2024

+36-8

Commits

Commits on May 24, 2024

• Add support for Llama3-70b

  bhavya01

  committed
  ec5d842

  Copy full SHA for ec5d842

• Fix unit tests

  bhavya01

  committed
  c64a822

  Copy full SHA for c64a822

Commits on May 25, 2024

• assert model_name is one of llama-2 or llama-3 for weight sharding

  bhavya01

  committed
  0eeaa5e

  Copy full SHA for 0eeaa5e

• Fix lint

  bhavya01

  committed
  c3368da

  Copy full SHA for c3368da

Commits on Jun 10, 2024

• Revert separate shardings for llama-2 and llama-3

  bhavya01

  committed
  a40f0b0

  Copy full SHA for a40f0b0

• Merge branch 'main' into llama3-70b

  bhavya01

  authored
  7c7ca7d

  Copy full SHA for 7c7ca7d

• Fix lint

  bhavya01

  committed
  2bfbb31

  Copy full SHA for 2bfbb31