Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix additional S3 support issues #2134

Merged
merged 2 commits into from
Nov 1, 2021

Commits on Oct 30, 2021

  1. Fix additional S3 support issues

    re: Unidata#2117
    re: Unidata#2119
    
    * Modify libsrc to allow byte-range reading of netcdf-3 files in private S3 buckets; this required using the aws sdk. Also add a test case.
    * The aws sdk can sometimes cause problems if the Awd::ShutdownAPI function is not called. So at optional atexit() support to ensure it is called. This is disabled for Windows.
    * Add documentation to nczarr.md on how to build and use the aws sdk under windows. Currently it builds, but testing fails.
    * Switch testing from stratus to the Unidata bucket on S3.
    * Improve support for the s3: url protocol.
    * Add a s3 specific utility code file: ds3util.c
    * Modify NC_infermodel to attempt to read the magic number of byte-ranged files in S3.
    
    ## Misc.
    
    * Move and rename the core S3 SDK wrapper code (libnczarr/zs3sdk.cpp) to libdispatch since it now used in libsrc as well as libnczarr.
    * Add calls to nc_finalize in the utilities in case atexit is disabled.
    * Add header only json parser to the distribution rather than as a built source.
    DennisHeimbigner committed Oct 30, 2021
    Configuration menu
    Copy the full SHA
    f6e25b6 View commit details
    Browse the repository at this point in the history
  2. Update release notes

    DennisHeimbigner committed Oct 30, 2021
    Configuration menu
    Copy the full SHA
    6f3bfde View commit details
    Browse the repository at this point in the history