This repo contains code for processing data within the Danish Foundation Models project.
The CLI is divided into separate sections:
- Document Processing (
document)process-directoryprocess-web-crawl
- Data Cleaning (
cleaning)- TBD
-
Notifications
You must be signed in to change notification settings - Fork 0
Toolkit for processing data in the danish foundation models project.
License
danish-foundation-models/dfm-processing
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Toolkit for processing data in the danish foundation models project.