#

lion-optimizer

Here are 2 public repositories matching this topic...

vinnik-dmitry07 / full-batch

Super-Convergence on CIFAR10

sophia cifar10 lion second-order-optimization adamw super-convergence weight-decay sharpness-aware-minimization madgrad large-batch-optimization lion-optimizer

Updated Jun 17, 2024
Python

eljandoubi / Copilot

Homemade Copilot: Fine-tune LLM through LoftQ initialization and QLoRA-style training for code generation.

pytorch huggingface-transformers huggingface-accelerate huggingface-datasets huggingface-peft gradiio 8bit-optimizer lion-optimizer paged-optimizer

Updated Feb 5, 2024
Jupyter Notebook

Improve this page

Add a description, image, and links to the lion-optimizer topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the lion-optimizer topic, visit your repo's landing page and select "manage topics."