Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first approach
-
Updated
Jan 15, 2024 - Python
Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first approach
Add a description, image, and links to the lm-alignment topic page so that developers can more easily learn about it.
To associate your repository with the lm-alignment topic, visit your repo's landing page and select "manage topics."