Skip to content

@pjlab-sys4nlp pjlab-sys4nlp

Change the repository type filter

All

    Repositories list

    5 repositories

    • llama-moe

      Public
      ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
      moellamamixture-of-expertsllmcontinual-pre-trainingexpert-partition
      Python
      •
      Apache License 2.0
      •46•861•4•0•Updated Jun 25, 2024Jun 25, 2024

    • opencompass-Huawei

      Public
      OpenCompass is an LLM evaluation platform, supporting a wide range of models (LLaMA, LLaMa2, ChatGLM2, ChatGPT, Claude, etc) over 50+ datasets.
      Python
      •
      Apache License 2.0
      •406•0•0•1•Updated Nov 3, 2023Nov 3, 2023

    • DeepSpeed

      Public
      DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
      Python
      •
      Apache License 2.0
      •4.1k•0•0•2•Updated Oct 29, 2023Oct 29, 2023

    • Megatron-DeepSpeed

      Public
      Ongoing research training transformer language models at scale, including: BERT & GPT-2
      Python
      •
      Other
      •2.3k•0•0•1•Updated Oct 13, 2023Oct 13, 2023

    • llama

      Public
      Inference code for LLaMA models
      Python
      •
      GNU General Public License v3.0
      •9.5k•1•0•0•Updated Apr 15, 2023Apr 15, 2023