Notebooks to create an instruction following version of Microsoft's Phi 2 LLM with Supervised Fine Tuning and Direct Preference Optimization (DPO)
-
Updated
Sep 5, 2024 - Jupyter Notebook
#
direct-preference-optimization
Here are 4 public repositories matching this topic...
Notebooks to create an instruction following version of Microsoft's Phi 1.5 LLM with Supervised Fine Tuning and Direct Preference Optimization (DPO)
-
Updated
Aug 17, 2024
EPFLLaMA: A lightweight language model fine-tuned on EPFL curriculum content. Specialized for STEM education and multiple-choice question answering. Implements advanced techniques like SFT, DPO, and quantization.
natural-language-processing
pytorch
artificial-intelligence
lora
large-language-models
supervised-finetuning
direct-preference-optimization
-
Updated
Sep 15, 2024 - Jupyter Notebook
EPFLLaMA: A lightweight language model fine-tuned on EPFL curriculum content. Specialized for STEM education and multiple-choice question answering. Implements advanced techniques like SFT, DPO, and quantization.
natural-language-processing
artificial-intelligence
lora
large-language-models
supervised-finetuning
direct-preference-optimization
-
Updated
Sep 23, 2024 - Jupyter Notebook
Improve this page
Add a description, image, and links to the direct-preference-optimization topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the direct-preference-optimization topic, visit your repo's landing page and select "manage topics."