Homemade Copilot: Fine-tune LLM through LoftQ initialization and QLoRA-style training for code generation.
pytorch
huggingface-transformers
huggingface-accelerate
huggingface-datasets
huggingface-peft
gradiio
8bit-optimizer
lion-optimizer
paged-optimizer
-
Updated
Feb 5, 2024 - Jupyter Notebook