Can I use it to save my datasets?

[yipliu]

Hi, I'm looking for a way to load and save my big dataset (~20000 files ~1 TB used pickle) efficiently.

I've read about safetensors and it mostly emphasizes its use in preserving models, so can it be used as a preservation dataset?