#

tokenizers

Here are 2 public repositories matching this topic...

sappho192 / Tokenizers.DotNet

[Unofficial] Simple .NET wrapper of HuggingFace Tokenizers library

rust library csharp dotnet nuget huggingface tokenizers

Updated Jan 27, 2025
C#

LogosBible / HfTokenizers

C# wrapper for https://github.com/huggingface/tokenizers/tree/main/tokenizers

huggingface tokenizers

Updated Jan 27, 2025
C#

Improve this page

Add a description, image, and links to the tokenizers topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the tokenizers topic, visit your repo's landing page and select "manage topics."