Added da_lexeme_prob.json

explosion · Dec 14, 2024 · 504dc3a · 504dc3a
1 parent 1d90ebc
commit 504dc3a
Show file tree

Hide file tree

Showing 2 changed files with 7 additions and 0 deletions.
diff --git a/spacy_lookups_data/data/da_lexeme_prob.json b/spacy_lookups_data/data/da_lexeme_prob.json
diff --git a/spacy_lookups_data/data/da_source.txt b/spacy_lookups_data/data/da_source.txt
@@ -0,0 +1,6 @@
+da_lexeme_prob are derived from 
+https://huggingface.co/datasets/chcaa/dagw-word-frequencies
+
+using revision e692bc45447f841258e30363a4b371ef1e4908f7.
+
+It is derived using the smoothed log probabilites only contains the first 1 000 000 lexemes.