Support for multiple World/Chunk formats

[Snowiiii]

I saw there might be interested in multiple custom world/chunk formats (e.g. #95 (comment))

We currently only support reading Anvil files. My ideas where

• Region
• Slime Format
• Linear Format
• Schematic Format

I also discovered zstd which Linear Format uses, It is more modern and promises to be much faster than the old ZLib

Tell me what do you think

[Snowiiii]

One disadvantages of using different formats or different compression (e.g. zstd) is that these world become not usable in vanilla. I recently discovered that actually LZ4 which is supported in vanilla world is even fast than zstd but has a bit lower compression ratio, We definitely should use that

[RemineHD]

For the scope of this project, I think we should focus on supporting Anvil and Linear formats by default. Region format is outdated and rarely used, I don't see a real use case for it in Pumpkin.
Slime is great, but it does not work with larger worlds (Like a Vanilla survival). As it loads the whole world in RAM.
In my opinion, adding support for Slime would only add more tasks for contributors and is not really necessary to have it out of the box. I think we could leave both Slime and Schematic for plugin developers.

I may work on adding support for Linear, I really like Pumpkin and I want to collaborate in some way, but no promises!

[Commandcracker]

Small Note: lz4 compression was added in 24w04a