You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When reading a catalog with read_hipscat change the default to only read in ra, dec coordinates, i.e., spatial coordinates, and require user to specify further columns. This is to avoid extensive loading when exploring the datasets (e.g., loading 10, 20, 50 columns of a catalog when only looking at the number of objects or similar).
Before submitting
Please check the following:
I have described the purpose of the suggested change, specifying what I need the enhancement to accomplish, i.e. what problem it solves.
I have included any relevant links, screenshots, environment information, and data relevant to implementing the requested feature, as well as pseudocode for how I want to access the new functionality.
If I have ideas for how the new feature could be implemented, I have provided explanations and/or pseudocode and/or task lists for the steps.
The text was updated successfully, but these errors were encountered:
Theoretically dask-expr would allow us to load only those columns we actually use, but it would require to change some LSDB code, for at least 1) data loading, and 2) cross-matching.
@dougbrn Can you please link here the presentation that you did which showed that dask-expr is pretty limited in that regard. or was it your @hombit presentation?
Feature request
When reading a catalog with
read_hipscat
change the default to only read inra, dec
coordinates, i.e., spatial coordinates, and require user to specify further columns. This is to avoid extensive loading when exploring the datasets (e.g., loading 10, 20, 50 columns of a catalog when only looking at the number of objects or similar).Before submitting
Please check the following:
The text was updated successfully, but these errors were encountered: