Repositories list

• sglang

  Public
  SGLang is a fast serving framework for large language models and vision language models.

  cudainferencepytorch+ 17transformeropenaimoellamavlmkimiblackwell+ 10

  Python

  •

  Apache License 2.0

  •2.7k•17k•550•599•Updated Aug 26, 2025Aug 26, 2025

• SpecForge

  Public
  Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

  trainingeaglepytorch+ 4llmfsdpsglangeagle3

  Python

  •

  MIT License

  •56•331•24•8•Updated Aug 26, 2025Aug 26, 2025

• sgl-kernel-npu

  Public
  SGLang kernel library for NPU

  C++

  •

  MIT License

  •21•47•3•8•Updated Aug 26, 2025Aug 26, 2025

• sgl-project.github.io

  Public
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.

  Jupyter Notebook

  •16•72•7•4•Updated Aug 26, 2025Aug 26, 2025

• DeepGEMM

  Public
  DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

  Cuda

  •

  MIT License

  •681•18•0•0•Updated Aug 26, 2025Aug 26, 2025

• sgl-learning-materials

  Public
  Materials for learning SGLang

  MIT License

  •44•549•0•0•Updated Aug 23, 2025Aug 23, 2025

• whl

  Public
  Kernel Library Wheel for SGLang

  cudacutlasssglang+ 1flashinfer

  HTML

  •

  MIT License

  •2•11•0•0•Updated Aug 23, 2025Aug 23, 2025

• ome

  Public
  OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)

  k8sllamaoracle-cloud+ 9model-servingmodel-as-a-servicemulti-node-kubernetesllmllm-inferencedeepseeksglang+ 2

  Go

  •

  MIT License

  •40•241•30•20•Updated Aug 22, 2025Aug 22, 2025

• genai-bench

  Public
  Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.

  Python

  •

  MIT License

  •17•195•5•2•Updated Aug 22, 2025Aug 22, 2025

• awesome-sglang

  Public
  Make SGLang go brrr

  k8somellm+ 17deepseekqwen2sglangllama3llama3-1qwen2-5deepseek-v3+ 10

  Creative Commons Zero v1.0 Universal

  •0•12•0•0•Updated Aug 22, 2025Aug 22, 2025

• sgl-kernel-xpu

  Public
  SGLang kernel library for Intel XPU

  Python

  •

  MIT License

  •2•6•0•2•Updated Aug 15, 2025Aug 15, 2025

• sgl-flash-attn

  Public
  Fast and memory-efficient exact attention

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •1.9k•11•0•1•Updated Aug 13, 2025Aug 13, 2025

• sgl-whl

  Public
  SGLang wheels for multiple platforms

  MIT License

  •0•10•0•0•Updated Aug 8, 2025Aug 8, 2025

• llama-stack-evals

  Public
  Functional tests and benchmarks for verifying Llama model providers.

  Python

  •

  MIT License

  •16•1•0•0•Updated Jul 3, 2025Jul 3, 2025

• torchtitan

  Public
  A PyTorch native library for large-scale model training

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •487•0•0•0•Updated May 18, 2025May 18, 2025

• sgl-test-files

  Public
  The test files for SGLang.

  MIT License

  •1•0•0•0•Updated Mar 12, 2025Mar 12, 2025

• tensorrt-demo

  Public
  TensorRT LLM Benchmark Configuration

  Python

  •4•13•0•0•Updated Jul 26, 2024Jul 26, 2024