#

tiktoken

Here are 2 public repositories matching this topic...

jaco-bro / MLX.zig

MLX.zig: Phi-4, Llama 3.2, and Whisper in Zig

zig regex llama pcre2 mlx llm tiktoken

Updated Apr 14, 2025
Zig

dbtreasure / zig-bpe

Byte Pair Encoding (BPE) in the Zig programming language (0.13.0)

zig bytepairencoding tiktoken

Updated Sep 12, 2024
Zig

Improve this page

Add a description, image, and links to the tiktoken topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the tiktoken topic, visit your repo's landing page and select "manage topics."