-
Notifications
You must be signed in to change notification settings - Fork 25
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Updated embedded libraries: SZ3 #289
base: main
Are you sure you want to change the base?
Conversation
The failing test is the one reading an already exisiting file, so that was compressed with a previous version of the filter. |
I guess we'll have to check if the SZ3 developers are aware of it. |
This Pr is pending for a new release of SZ3 (see szcompressor/SZ3#50 (comment)) |
git-subtree-dir: src/c-blosc git-subtree-split: 43377c44427868b1d2d9b11b43d6ade2ba75216c
841c6ae72 Getting ready for release 2.15.1 843bb60d9 Undo the warning fix 253c2cc03 Fix a warning on Linux bb66cce09 Internal LZ4 sources bumped to 1.10.0. 7be3f6fbf load_lib: allow direct loading of library by name 3669c5c4c Add b2nd_nans method #624 0ec41df74 Add info about filename extensions f3aea9edc Add a check of architecture to select simd probing implementation 5ff43ff87 Add stubs and runtime checks for ALTIVEC shuffle/bitshuffle implementation 64e1ce8a4 Add stubs and runtime checks for NEON shuffle/bitshuffle implementation bf437c382 Add stubs and runtime checks for AVX512 bitshuffle implementation 9f99b3af6 Add stubs and runtime checks for SSE2 shuffle/bitshuffle implementation a675b071f Add stubs and runtime checks for AVX2 shuffle/bitshuffle implementation 2a07f3457 Do not pass `-m` flags when compiling `shuffle.c` dc5d651c3 Post 2.15.0 release actions done git-subtree-dir: src/c-blosc2 git-subtree-split: 394c862c893354241c4e9b95a3142c5af7c90b9d
b3dab4018 Merge pull request silx-kit#60 from szcompressor/newapi d70c22264 update readme 35115beeb update readme 352c1a0f6 update compress api fe6eef7e3 update compress api 75c906dda update compress api ad47f20d2 update compress api 52b4f439c update compress api 7a5447c79 update compress api cb87901dd Merge remote-tracking branch 'origin/newapi' into newapi c1d6504e1 update hdf5 filter 533292f9f Merge branch 'refs/heads/master' into newapi b3dac0c65 update readme 3f478178d Merge pull request silx-kit#56 from juntyr/32bit-hash f8fc2cb33 fix int overflow in quantization e52a2c30f Add support for 32bit systems by falling back to std::unordered_map f6cae37f5 add link to fortran api 90c66bed1 modify MDZ CR calculation to include the first frame which is stored losslessly. 09494b13c fix bug in MDZ for 1D inputs dde630245 add noprediction compressor 47593621f bugfix fdd6dee6e API rewrite data version check a887550ed API rewrite data version check 5bab19c5d API rewrite data version check 1ea5d5b07 API rewrite data version check e78f4832f Add annotation be68d6cbe bug fix for openmp 800c3248e bug fix for interp d06710a55 bug fix for interp 7fc2cb519 bug fix for MDZ 3568914cd Merge remote-tracking branch 'origin/master' 5f835fb74 bug fix for MDZ be68d645b Merge pull request silx-kit#47 from robertu94/master e308ebf85 Merge branch 'master' of github.com:szcompressor/sz3 6198db715 default initalize config 162674f87 Merge pull request silx-kit#46 from mrmbernardi/patch-1 f834756f9 Fix SZFastFrontend::size_est() returning undefined value 13e79072e config bugfix 0ac567a76 Merge pull request silx-kit#45 from szcompressor/hdf5 d6beca327 add config support to hdf5 filter 05965ac2b update 1d lorenzo fast mode d2a03eae4 add lorenzo 1D fast mode fa9a7f179 Merge pull request silx-kit#44 from szcompressor/namespace 2437574dc change namespace from SZ to SZ3, to avoid conflict with SZ2 3236a6eb2 Merge branch 'huffman' 5995fa9f2 update HDF5 filter 1fc15171c update HDF5 filter aadaaeb90 change namespace from SZ to SZ3, to avoid conflict with SZ2 e1af6bea2 change namespace from SZ to SZ3, to avoid conflict with SZ2 bdc4b503b new huffman 9aee288dd Merge pull request silx-kit#43 from mrmbernardi/decompress_output ab7896ec4 update stateNum in preprocess_encode 44839697c Decompress function returns output matching original_dtype f420554d3 update readme 31d7cbb6a add annotation for interfaces d0606d3ae Merge pull request silx-kit#41 from szcompressor/mdz 3443ae347 update readme 1219a336d disable SZ3_DEBUG_TIMINGS by default 09d43dee5 clear runtime output for MDZ f051a8361 support 3D input for MDZ 89f3b7c78 bugfix in smoke test 5a1cf1aad Merge remote-tracking branch 'origin/master' 40e9b3de5 bugfix in smoke test 140e09e9c remove the print information (OpenMP threads = ), which might be annoying and seems unneeded. 1e1dc102e Merge pull request silx-kit#38 from aumuell/uint8 9b2bf8ad5 fix missing uint8_t with GCC 13 f7d865e6e Merge pull request silx-kit#37 from robertu94/hdf5_fix 73674f3db link to MPI when hdf5 is parallel 13f835d54 openmp bugfix 318fe953f openmp bugfix 612b4993d update pysz bce7f1202 Merge pull request silx-kit#32 from exmakhina/master 62d01de0b python: load library from a sensible default path, if not provided ce7fb031e change sprintf to snprintf 1b1abcf39 interp+lorenzo sampling bugfix 9f396935d bugfix git-subtree-dir: src/SZ3 git-subtree-split: b3dab4018425803a55d8073dc55dade7fa46b7b4
Updated to use SZ3 v3.2.0 which checks that the data was compressed with a compatible version of the library. Unfortunately, the This makes reading a HDF5 dataset compressed with a previous version of SZ3 abort the process because it cannot read the Config object. This defeats the check of the version by the library.
Also, when writing a new HDF5 dataset, the current passed arguments must be changed, so as it is the
It works when setting Finally, it would be good to check that the Config read/write works when writing with one endianess and reading with another. |
This PR aims at upgrading SZ3 to the latest release: https://github.com/szcompressor/SZ3/releases/tag/v3.1.8