Code

[WIP] Hot swap for LoRA#8056

Code

Closed

ltoniazzi wants to merge 14 commits intoggerganov:masterggerganov/llama.cpp:masterfrom ltoniazzi:hot-swap-loraltoniazzi/llama.cpp:hot-swap-loraCopy head branch name to clipboard

+430-10

Commits

Commits on Jun 21, 2024

• Add basic cpu setup

  ltoniazzi

  committed
  12112bf

  Copy full SHA for 12112bf

• Fix passing param

  ltoniazzi

  committed
  26df64a

  Copy full SHA for 26df64a

• Remove comment

  ltoniazzi

  committed
  5c4ba81

  Copy full SHA for 5c4ba81

Commits on Jul 1, 2024

• Metal running (still buffer issues)

  

  Lorenzo Toniazzi

  committed
  028d3f7

  Copy full SHA for 028d3f7

Commits on Jul 2, 2024

• Fixed buffer allocation

  

  Lorenzo Toniazzi

  committed
  1103bdb

  Copy full SHA for 1103bdb

• Clean up

  

  Lorenzo Toniazzi

  committed
  1734f3f

  Copy full SHA for 1734f3f

• Clean up

  

  Lorenzo Toniazzi

  committed
  284e665

  Copy full SHA for 284e665

Commits on Jul 6, 2024

• update branch notes

  

  Lorenzo Toniazzi

  committed
  8f0272c

  Copy full SHA for 8f0272c

• transpose and run cont

  

  Lorenzo Toniazzi

  committed
  798cde7

  Copy full SHA for 798cde7

• transpose when loading

  

  Lorenzo Toniazzi

  committed
  931134b

  Copy full SHA for 931134b

Commits on Jul 7, 2024

• Transpose after setting data

  

  Lorenzo Toniazzi

  committed
  41e8c73

  Copy full SHA for 41e8c73

• Remove files

  

  Lorenzo Toniazzi

  committed
  6597a72

  Copy full SHA for 6597a72

Commits on Jul 8, 2024

• renames

  

  Lorenzo Toniazzi

  committed
  e481eb5

  Copy full SHA for e481eb5

• Add ff lora matmuls

  

  Lorenzo Toniazzi

  committed
  9d5089b

  Copy full SHA for 9d5089b