-
Notifications
You must be signed in to change notification settings - Fork 67
Add zstd compression read support for uproot #421
Add zstd compression read support for uproot #421
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Wow, this looks perfect! Highly approved! (Oh, two mistakes; but after that, highly approved.)
- Python zstd library is an optional dependency.
- Oh, I found an error: the installation instructions for conda should be changed. (See compressed.py:89 inline comment.)
- It's in the tests-require and manually loaded in Travis (like the others).
- Test samples with the new compression algorithm (HZZ and Zmumu).
- Unit tests use the new test samples, comparing detailed TTree values (test_compression.py,
content1
andcontent2
. - sample4version.C is ready to make new ROOT files with zstd, but that will wait until ROOT 6.20 comes out.
- Help strings have been updated.
- New constants in const.py.
The failure of the AppVeyor tests is due to appveyor.yml:53 (see inline comment).
@jpivarski I will add zstd for writing as soon we will have release. |
…ber for later deployment.
@oshadura I pushed a correction to your branch, but it hasn't shown up here yet (for me): https://github.com/oshadura/uproot/commits/add-zstd-compression-support When it does (and tests pass), I'll merge this unless you tell me not to. |
@oshadura Could you try pulling in your branch, verifying that my changes to uproot/source/compressed.py are there (where I dropped the |
I was looking at adding the conda-forge package and I noticed there are two different sets of Python bindings. Both are linked from facebook's webpage:
Is there a reason for preferring |
Thanks, let me check! |
@jpivarski @chrisburr thanks for checking, zstandard package is definitely better! (it supports much more functionality, such as dictionary generation and streaming API). I updated PR accordingly. |
Okay, great! When the tests pass, should I merge this, @oshadura? |
Yes, please! |
1d8af06
to
83169d9
Compare
@jpivarski yeap, now I am ready I think. |
Locally I have green tests:
Ran 106 tests in 33.114s
OK