Skip to content
@RWKV

RWKV

RWKV is an RNN with Transformer-level LLM performance. It is hosted as an incubation project in LF AI & Data Foundation.

Popular repositories Loading

  1. rwkv.cpp rwkv.cpp Public

    INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

    C++ 1.4k 100

  2. RWKV-infctx-trainer RWKV-infctx-trainer Public

    RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!

    Jupyter Notebook 139 27

  3. rwkv-onnx rwkv-onnx Public

    A converter and basic tester for rwkv onnx

    Python 42 3

  4. RWKV-LM RWKV-LM Public

    Forked from BlinkDL/RWKV-LM

    RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference,…

    Python 21 3

  5. RWKV-cpp-node RWKV-cpp-node Public

    Node.js implementation binding for the RWKV.cpp module

    JavaScript 20 4

  6. RWKV-wiki RWKV-wiki Public

    RWKV centralised docs for the community

    19 6

Repositories

Showing 10 of 14 repositories
  • RWKV-wiki Public

    RWKV centralised docs for the community

    RWKV/RWKV-wiki’s past year of commit activity
    19 6 3 0 Updated Sep 3, 2024
  • RWKV-infctx-trainer Public

    RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!

    RWKV/RWKV-infctx-trainer’s past year of commit activity
    Jupyter Notebook 139 Apache-2.0 27 9 4 Updated Aug 13, 2024
  • rwkv.cpp Public

    INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

    RWKV/rwkv.cpp’s past year of commit activity
    C++ 1,444 MIT 100 21 (4 issues need help) 9 Updated Aug 7, 2024
  • lm-evaluation-harness Public Forked from EleutherAI/lm-evaluation-harness

    A framework for few-shot evaluation of language models.

    RWKV/lm-evaluation-harness’s past year of commit activity
    Python 1 MIT 1,986 0 0 Updated Jul 21, 2024
  • llama.cpp Public Forked from ggerganov/llama.cpp

    LLM inference in C/C++

    RWKV/llama.cpp’s past year of commit activity
    C++ 2 MIT 10,261 0 0 Updated Jun 26, 2024
  • ggml Public Forked from ggerganov/ggml

    Tensor library for machine learning

    RWKV/ggml’s past year of commit activity
    C 3 MIT 1,128 0 1 Updated Jun 10, 2024
  • RWKV-LM Public Forked from BlinkDL/RWKV-LM

    RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

    RWKV/RWKV-LM’s past year of commit activity
    Python 21 Apache-2.0 888 0 0 Updated Apr 4, 2024
  • ChatRWKV Public Forked from BlinkDL/ChatRWKV

    ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

    RWKV/ChatRWKV’s past year of commit activity
    Python 8 Apache-2.0 721 0 0 Updated Feb 17, 2024
  • rwkv-onnx Public

    A converter and basic tester for rwkv onnx

    RWKV/rwkv-onnx’s past year of commit activity
    Python 42 3 4 1 Updated Jan 29, 2024
  • artwork Public

    Logos of RWKV projects

    RWKV/artwork’s past year of commit activity
    1 0 0 0 Updated Dec 7, 2023
View all repositories

Most used topics

Loading…