Tensor library for machine learning

High-speed Large Language Model Serving for Local Deployment

C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)

TinyChatEngine: On-Device LLM Inference Library

Fast, Flexible and Portable Structured Generation

Fast Multimodal LLM on Mobile Devices

C++ implementation of Qwen-LM

Cuda implementation of Extended Long Short Term Memory (xLSTM) with C++ and PyTorch ports

Tiny C++11 GPT-2 inference implementation from scratch

qwen2 and llama3 cpp implementation

Code & data for ICLR 2024 spotlight paper: 🍯MUSTARD: Mastering Uniform Synthesis of Theorem and Proof Data

CoreScheduler: A High-Performance Scheduler for Large Model Training

Bridging Items and Language: A Transition Paradigm for Large Language Model-Based Recommendation (KDD'24)

CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.

Vulkan & GLSL implementation of FlashAttention-2

This is a special PyTorch For Poor Guys Who can't afford big GPU

LLM-driven 3D terrain generation using OpenGL and C++