Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

The official GitHub page for the survey paper "A Survey of Large Language Models".

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).

Robust recipes to align language models with human and AI preferences

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调

The easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.

A Doctor for your data

Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

WebGLM: An Efficient Web-enhanced Question Answering System (KDD 2023)

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

[NeurIPS 2023] ImageReward: Learning and Evaluating Human Preferences for Text-to-image Generation

Secrets of RLHF in Large Language Models Part I: PPO

Recipes to train reward model for RLHF.

[NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward

A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).

聚宝盆(Cornucopia): 中文金融系列开源可商用大模型，并提供一套高效轻量化的垂直领域LLM训练框架(Pretraining、SFT、RLHF、Quantize等)

Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.