#

glotlid

Here are 5 public repositories matching this topic...

cisnlp / GlotLID

Language Identification with Support for More Than 2000 Labels -- EMNLP 2023

language-detection multlingual language-detector language-recognition glot lid language-identification language-classification language-identification-toolkit low-resource-languages language-detection-library language-identifier language-detection-lib langid low-resource-nlp glotcc glotlid

Updated Oct 30, 2024
Python

cisnlp / GlotCC

GlotCC Dataset and Pipline -- NeurIPS 2024

crawler multlingual corpus-linguistics glot language-identification commoncrawl common-crawl glotcc multilingual-dataset glotlid

Updated Nov 1, 2024
Jupyter Notebook

cisnlp / ungoliant

🕷️ The pipeline for the OSCAR/GlotCC corpus

Updated Oct 23, 2024
Rust

cisnlp / oscar-tools

The original tooling for the GlotCC/OSCAR corpus rewritten in Rust

Updated Oct 23, 2024
Rust

cisnlp / oscar-io

Readers/Writers for GlotCC/OSCAR corpus

Updated Oct 23, 2024
Rust

Improve this page

Add a description, image, and links to the glotlid topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the glotlid topic, visit your repo's landing page and select "manage topics."