Bring recent changes to large_image into the girder5 branch
#1712
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add a CI step to check that we can release before we do so
Undo pinning for yamlfix
Don't read adjacent items' annotations if they don't contribute to the collected data.
Improve plottable data collection.
This also does correspondence between bounding boxes and annotation elements. It is slower than desired for reading data via pandas and doing that correspondence.
Improve scanning data file for plottable data
Harden converting sources that report varied tile bands
This also adds the ability to scale pixel values from different sources to better harmonize different dtypes.
Better handle mixed dtype sources in the multi source
Add a utility function to minimize caching
Allow passing through converter options when writing a zarr sink
Do less calculations when applying affine transforms in the multi-source
Update docs for a PR #1617
Slightly shift how concurrency is divided between sources and tiles.
Improve logging during pooled concurrency in the image converter
This was tested by running lisource_compare.py on most of the GDAL
repository's autotest files. If a source threw a traceback rather than
returning that it could not read a source, it was modified to handle the
condition better.
Specifically, command like `find ../gdal/autotest/{gcore,gdrivers} -type
f -not -name '*.py' -not -name '*.txt' -exec python
test/lisource_compare.py --all --projection= --projection=EPSG:3857 {}
\+` was run, though some test files were excluded.
Harden some of the sources when trying to read bad files
Format dates in item lists
Openslide is now publishing binary wheels, but as a package called openslide-bin. Require these for appropriate platform machine/system combinations. This allows openslide to be added to the list of commonly supported sources.
Use openslide published binaries
Fix a typo in the change to openslide dependencies
Ensure tile source _dtype is an actual numpy dtype
psutil can return none for the number of logical cpus
Modify a function to keep the type checker happy
Adjust one check from PR #1711.
Add another guard on dtype based on a field report
The tiff files have some subifds without any strips or tiles and erroneously do not declare that they have float pixel data.
Handle indica labs variant tiff.
gdalwarp and gdal_translate can be used to transform images in pixel space. If such an image has no projection specified and cannot be interpreted as latitude and longitude, assume it is not geospatial.
Better detect files with geotransform data that aren't geospatial
|
Note commit ee99616 converts some recent logging changes to use the girder 5 style logging |
zachmullen
approved these changes
Nov 7, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.