Recalculate ICESat-2 ATL11 height changes up to 20200404 #55
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Calculate Antarctic ice surface height range up to 20200404, on ~220 million data points spread out across 7 ICESat-2 cycles! Not doing the data cull anymore as we're only cutting ~30 million points instead of ~50 million points before, the `nanptp` function will still work fine since it's designed for it. Improved lots of bits and pieces around the `atlxi_dhdt.ipynb` jupyter notebook, such as documentation, and ensure that cell outputs render better on Github. Also putting the date range on the colorbar label of our hrange and dhdt figures, though I should really make the min/max date finder faster. Will update the dhdt plot in a separate commit.
|
Check out this pull request on Review Jupyter notebook visual diffs & provide feedback on notebooks. Powered by ReviewNB |
3 tasks
Calculate Antarctic rate of ice surface elevation change over time (dhdt) up to 20200404! Decided to run the dhdt calculation on data points with a height range of >0.25 m (n=~36 million), instead of just >0.5 m before (n=~10 million). More than 3 times the data points, and nice to see the time to do the calculation has just about tripled too from 3 min to 9 min. Not accounting for the fact that we're using float32 instead of float64, and the hours of hand holding to get it to work! Updated teaser image accordingly on main README.md too.
3 tasks
weiji14
added a commit
that referenced
this pull request
Aug 13, 2020
Calculate Antarctic ice surface height range (hrange) and rate of ice surface elevation change over time (dhdt) up to 20200513! Supersedes #55. This time, for the whole continent (n=~223 million data points)!! It's nice to see a full map with no blanks, and we'll need full coverage to do crossover error calculations properly later on. Side effect is that it took a couple of hours to run through the ETL data pipeline (like watching paint dry), and I was tempted to get it to work on the GPU but hit into all sorts of I/O slowness and GPU memory limitations once more. Also spruced up the code here and there. Renamed the Whillans1 and Whillans2 regions to Whillans Downstream and Upstream respectively (and changed the bounding box too). Decided to drop the unneeded min/max_cycle dimensions from the xarray.Dataset (less things to handle). Interactive dhdt_range slider now uses a more fine-grained increment of 0.25m instead of 0.5m. Updated teaser image accordingly on main README.md too.
3 tasks
weiji14
added a commit
that referenced
this pull request
Sep 15, 2020
Calculate Antarctic ice surface height range (hrange) and rate of ice surface elevation change over time (dhdt) up to 20200513! Supersedes #55. This time, for the whole continent (n=~223 million data points)!! It's nice to see a full map with no blanks, and we'll need full coverage to do crossover error calculations properly later on. Side effect is that it took a couple of hours to run through the ETL data pipeline (like watching paint dry), and I was tempted to get it to work on the GPU but hit into all sorts of I/O slowness and GPU memory limitations once more. Also spruced up the code here and there. Renamed the Whillans1 and Whillans2 regions to Whillans Downstream and Upstream respectively (and changed the bounding box too). Decided to drop the unneeded min/max_cycle dimensions from the xarray.Dataset (less things to handle). Interactive dhdt_range slider now uses a more fine-grained increment of 0.25m instead of 0.5m. Updated teaser image accordingly on main README.md too.
3 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Reprocess height range (hrange) and rate of elevation change over time (dhdt) for the the whole of Antarctica over the 2018-10-14 to 2020-04-04 time period! Supersedes #41, continuation of #44.
TODO: