Alpha 1.0.1
Pre-release
Pre-release
Version 1.0.1
- errors.py - contains all custom error classes for Kerchunk pipeline
- logs.py - contains logger content and other utils
- setup.py - installs pipeline scripts into environment
- validate.py - thorough validation added (try subset, then try full fileset)
Bug Fixes:
- Dap link in cached files: Pipeline now writes cache files BEFORE concatenation to ensure no linkage.
- Dimension loading issue: Known issue with remote_protocol set - greater distinction between pre-concatenation and post-concatenation Kerchunk files.
Features added:
- Memory flag: Assign specific memory to parallel job arrays
- In-place validation: Pipeline allows rechecking of 'complete' datasets.
- Multi-dimension concatenation support
- Identical_dims identification within compute phase.
- Added custom error classes for edge cases.