gptj.cpp

Port of GPT-J model in C/C++. Adapted from ggerganov/ggml/examples.

For Python bindings, see marella/gpt4all-j

Usage

Download

git clone --recurse-submodules https://github.com/marella/gptj.cpp
cd gptj.cpp

Build

mkdir build
cd build
cmake ..
cmake --build . --config Release

On Linux, the generated .so files will be located at:

build/src/libgptj.so
build/ggml/src/libggml.so

On macOS, the generated .dylib files will be located at:

build/src/libgptj.dylib
build/ggml/src/libggml.dylib

On Windows, the generated .dll files will be located at:

build\bin\Release\gptj.dll
build\bin\Release\ggml.dll

License

MIT