This is a zig port of https://github.com/karpathy/llama2.c Basic inferencing functionality supported.
You need zig version 0.11 or newer.
zig build run -Doptimize=ReleaseFast -- stories15M.bin 0 128 "your prompt here"
This is a zig port of https://github.com/karpathy/llama2.c Basic inferencing functionality supported.
You need zig version 0.11 or newer.
zig build run -Doptimize=ReleaseFast -- stories15M.bin 0 128 "your prompt here"