Skip to content

Alpha 1.0.1

Pre-release
Pre-release
Compare
Choose a tag to compare
@dwest77a dwest77a released this 13 Feb 16:22
· 285 commits to main since this release

Version 1.0.1

  • errors.py - contains all custom error classes for Kerchunk pipeline
  • logs.py - contains logger content and other utils
  • setup.py - installs pipeline scripts into environment
  • validate.py - thorough validation added (try subset, then try full fileset)

Bug Fixes:

  • Dap link in cached files: Pipeline now writes cache files BEFORE concatenation to ensure no linkage.
  • Dimension loading issue: Known issue with remote_protocol set - greater distinction between pre-concatenation and post-concatenation Kerchunk files.

Features added:

  • Memory flag: Assign specific memory to parallel job arrays
  • In-place validation: Pipeline allows rechecking of 'complete' datasets.
  • Multi-dimension concatenation support
  • Identical_dims identification within compute phase.
  • Added custom error classes for edge cases.