Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

v1 release #107

Merged
merged 103 commits into from
Jul 6, 2023
Merged

v1 release #107

merged 103 commits into from
Jul 6, 2023

Commits on May 21, 2023

  1. Scripts for table 1

    @jasonjewik
    jasonjewik committed May 21, 2023
    Configuration menu
    Copy the full SHA
    fad80c4 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2023

  1. Fixed typos in table1.py

    @prakhar6sharma
    prakhar6sharma committed May 22, 2023
    Configuration menu
    Copy the full SHA
    97525ac View commit details
    Browse the repository at this point in the history

  2. Temp fix

    @prakhar6sharma
    prakhar6sharma committed May 22, 2023
    Configuration menu
    Copy the full SHA
    c52b84c View commit details
    Browse the repository at this point in the history

Commits on May 23, 2023

  1. iter module working with new refactor

    @prakhar6sharma
    prakhar6sharma committed May 23, 2023
    Configuration menu
    Copy the full SHA
    e52e18a View commit details
    Browse the repository at this point in the history

  2. Checkpoint 

    Tried to get ShardDataset working. Switching to IterDataset.
    @jasonjewik
    jasonjewik committed May 23, 2023
    Configuration menu
    Copy the full SHA
    454a6e9 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'iterhotfix' into jason-experiments 

    Switching to IterDataset.
    @jasonjewik
    jasonjewik committed May 23, 2023
    Configuration menu
    Copy the full SHA
    c4e6ff0 View commit details
    Browse the repository at this point in the history

  4. Update table 1 code

    @jasonjewik
    jasonjewik committed May 23, 2023
    Configuration menu
    Copy the full SHA
    9097a0d View commit details
    Browse the repository at this point in the history

  5. Adding table experiments for other architectures

    @jasonjewik
    jasonjewik committed May 23, 2023
    Configuration menu
    Copy the full SHA
    5ab3733 View commit details
    Browse the repository at this point in the history

  6. Update ViT architecture

    @jasonjewik
    jasonjewik committed May 23, 2023
    Configuration menu
    Copy the full SHA
    42323c6 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2023

  1. Add notebook

    @jasonjewik
    jasonjewik committed May 24, 2023
    Configuration menu
    Copy the full SHA
    f4d599d View commit details
    Browse the repository at this point in the history

  2. Checkpoint

    @jasonjewik
    jasonjewik committed May 24, 2023
    Configuration menu
    Copy the full SHA
    e2431bd View commit details
    Browse the repository at this point in the history

  3. Checkpointing

    @jasonjewik
    jasonjewik committed May 24, 2023
    Configuration menu
    Copy the full SHA
    7ee312a View commit details
    Browse the repository at this point in the history

Commits on May 25, 2023

  1. Updated log dir for checkpoints

    @prakhar6sharma
    prakhar6sharma committed May 25, 2023
    Configuration menu
    Copy the full SHA
    26b6f15 View commit details
    Browse the repository at this point in the history

  2. Checkpoint

    @jasonjewik
    jasonjewik committed May 25, 2023
    Configuration menu
    Copy the full SHA
    8dac45c View commit details
    Browse the repository at this point in the history

Commits on May 26, 2023

  1. Fix mse, rmse, and acc metrics

    @jasonjewik
    jasonjewik committed May 26, 2023
    Configuration menu
    Copy the full SHA
    830a1b9 View commit details
    Browse the repository at this point in the history

  2. Update acc code

    @jasonjewik
    jasonjewik committed May 26, 2023
    Configuration menu
    Copy the full SHA
    3be7777 View commit details
    Browse the repository at this point in the history

  3. Reduce precision, change early stopping metric

    @jasonjewik
    jasonjewik committed May 26, 2023
    Configuration menu
    Copy the full SHA
    8c0af7d View commit details
    Browse the repository at this point in the history

  4. Fixes

    @jasonjewik
    jasonjewik committed May 26, 2023
    Configuration menu
    Copy the full SHA
    bd8c4ac View commit details
    Browse the repository at this point in the history

  5. add lr monitor, modify checkpointing, use ddp instead of ddp_spawn

    @tung-nd
    tung-nd committed May 26, 2023
    Configuration menu
    Copy the full SHA
    ce7f742 View commit details
    Browse the repository at this point in the history

  6. modify logging keys to separate train/val/test

    @tung-nd
    tung-nd committed May 26, 2023
    Configuration menu
    Copy the full SHA
    d680ffc View commit details
    Browse the repository at this point in the history

  7. use normalized lat_mse as a validation metric

    @tung-nd
    tung-nd committed May 26, 2023
    Configuration menu
    Copy the full SHA
    0c92978 View commit details
    Browse the repository at this point in the history

  8. change training setting

    @tung-nd
    tung-nd committed May 26, 2023
    Configuration menu
    Copy the full SHA
    635e342 View commit details
    Browse the repository at this point in the history

  9. Checkpoint

    @jasonjewik
    jasonjewik committed May 26, 2023
    Configuration menu
    Copy the full SHA
    d7460ce View commit details
    Browse the repository at this point in the history

Commits on May 28, 2023

  1. Downscaling

    @jasonjewik
    jasonjewik committed May 28, 2023
    Configuration menu
    Copy the full SHA
    1d6d349 View commit details
    Browse the repository at this point in the history

  2. DL models for downscaling

    @jasonjewik
    jasonjewik committed May 28, 2023
    Configuration menu
    Copy the full SHA
    9ea1596 View commit details
    Browse the repository at this point in the history

  3. Pearson now does not rely on scipy

    @jasonjewik
    jasonjewik committed May 28, 2023
    Configuration menu
    Copy the full SHA
    f438229 View commit details
    Browse the repository at this point in the history

  4. ViT experiment and PRISM support

    @jasonjewik
    jasonjewik committed May 28, 2023
    Configuration menu
    Copy the full SHA
    1a76a30 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2023

  1. Multiple transformation bug fix

    @jasonjewik
    jasonjewik committed May 29, 2023
    Configuration menu
    Copy the full SHA
    ed7f82b View commit details
    Browse the repository at this point in the history

  2. fix duplicate denormalization bug

    @tung-nd
    tung-nd committed May 29, 2023
    Configuration menu
    Copy the full SHA
    116f36a View commit details
    Browse the repository at this point in the history

  3. add ReduceLROnPlateau scheduler

    @tung-nd
    tung-nd committed May 29, 2023
    Configuration menu
    Copy the full SHA
    f520ead View commit details
    Browse the repository at this point in the history

  4. update gitignore

    @tung-nd
    tung-nd committed May 29, 2023
    Configuration menu
    Copy the full SHA
    cb80d74 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2023

  1. fix resnet to match with weatherbench implementation

    @tung-nd
    tung-nd committed May 30, 2023
    Configuration menu
    Copy the full SHA
    08a129e View commit details
    Browse the repository at this point in the history

  2. current best setting

    @tung-nd
    tung-nd committed May 30, 2023
    Configuration menu
    Copy the full SHA
    7966523 View commit details
    Browse the repository at this point in the history

  3. update projection and prediction layers for unet

    @tung-nd
    tung-nd committed May 30, 2023
    Configuration menu
    Copy the full SHA
    7ec0ad0 View commit details
    Browse the repository at this point in the history

  4. update run scripts for resnet and unet

    @tung-nd
    tung-nd committed May 30, 2023
    Configuration menu
    Copy the full SHA
    b52122a View commit details
    Browse the repository at this point in the history

Commits on May 31, 2023

  1. avoid spiking loss

    @tung-nd
    tung-nd committed May 31, 2023
    Configuration menu
    Copy the full SHA
    c1ce550 View commit details
    Browse the repository at this point in the history

  2. update vit models and scripts

    @tung-nd
    tung-nd committed May 31, 2023
    Configuration menu
    Copy the full SHA
    8b5e37c View commit details
    Browse the repository at this point in the history

  3. Downscaling exp changes

    @jasonjewik
    jasonjewik committed May 31, 2023
    Configuration menu
    Copy the full SHA
    0de7344 View commit details
    Browse the repository at this point in the history

  4. Downscaling changes

    @jasonjewik
    jasonjewik committed May 31, 2023
    Configuration menu
    Copy the full SHA
    6432325 View commit details
    Browse the repository at this point in the history

  5. rollback resnet and unet architectures

    @tung-nd
    tung-nd committed May 31, 2023
    Configuration menu
    Copy the full SHA
    7fbe021 View commit details
    Browse the repository at this point in the history

  6. Merge Tung's changes

    @jasonjewik
    jasonjewik committed May 31, 2023
    Configuration menu
    Copy the full SHA
    e0d1b0c View commit details
    Browse the repository at this point in the history

Commits on Jun 1, 2023

  1. Downscaling updates

    @jasonjewik
    jasonjewik committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    7335b5e View commit details
    Browse the repository at this point in the history

  2. use 16 precision

    @tung-nd
    tung-nd committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    73d9382 View commit details
    Browse the repository at this point in the history

  3. CMIP6 running with iterdatamodule

    @prakhar6sharma
    prakhar6sharma committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    543eb8c View commit details
    Browse the repository at this point in the history

Commits on Jun 2, 2023

  1. add continuous data modules

    @tung-nd
    tung-nd committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    402afec View commit details
    Browse the repository at this point in the history

  2. update nc2npz to accumulate precipitation data

    @tung-nd
    tung-nd committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    d9027d4 View commit details
    Browse the repository at this point in the history

  3. merge tung exps (#105) 

    * avoid spiking loss

* update vit models and scripts

* rollback resnet and unet architectures

* use 16 precision

* add continuous data modules

* update nc2npz to accumulate precipitation data

---------

Co-authored-by: Tung Nguyen <ductungnguyen1997@gmail.com>
    @prakhar6sharma @tung-nd
    prakhar6sharma and tung-nd authored Jun 2, 2023
    Configuration menu
    Copy the full SHA
    5047224 View commit details
    Browse the repository at this point in the history

  4. ERA5 downscaling updates

    @jasonjewik
    jasonjewik committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    b31ff20 View commit details
    Browse the repository at this point in the history

  5. use 1 worker, somehone increasing # workers affects performance

    @tung-nd
    tung-nd committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    1cf32b1 View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2023

  1. update scripts to be consistent

    @tung-nd
    tung-nd committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    66cbd77 View commit details
    Browse the repository at this point in the history

  2. prepare iterative exps

    @tung-nd
    tung-nd committed Jun 3, 2023
    Configuration menu
    Copy the full SHA
    2d5cf8e View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2023

  1. Downscaling checkpoint: PRISM implemented

    @jasonjewik
    jasonjewik committed Jun 4, 2023
    Configuration menu
    Copy the full SHA
    b8c3887 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2023

  1. evaluate iterative models

    @tung-nd
    tung-nd committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    2d5a1f4 View commit details
    Browse the repository at this point in the history

  2. summarize results

    @tung-nd
    tung-nd committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    23f040c View commit details
    Browse the repository at this point in the history

  3. update json results and add plot scripts

    @tung-nd
    tung-nd committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    b50c8a9 View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2023

  1. Add probabilistic metrics

    @jasonjewik
    jasonjewik committed Jun 11, 2023
    Configuration menu
    Copy the full SHA
    73e3e3b View commit details
    Browse the repository at this point in the history

  2. Add class metrics

    @jasonjewik
    jasonjewik committed Jun 11, 2023
    Configuration menu
    Copy the full SHA
    aca9b8c View commit details
    Browse the repository at this point in the history

  3. Add rank histogram visualization

    @jasonjewik
    jasonjewik committed Jun 11, 2023
    Configuration menu
    Copy the full SHA
    8cecb86 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2023

  1. update plot script

    @tung-nd
    tung-nd committed Jun 12, 2023
    Configuration menu
    Copy the full SHA
    b78f111 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2023

  1. add climatebench experiments

    @tung-nd
    tung-nd committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    9e9b0ff View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2023

  1. Resolve merge conflicts

    @jasonjewik
    jasonjewik committed Jun 18, 2023
    Configuration menu
    Copy the full SHA
    bdeabb2 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'tung_exps' into v1-release

    @jasonjewik
    jasonjewik committed Jun 18, 2023
    Configuration menu
    Copy the full SHA
    efe7f88 View commit details
    Browse the repository at this point in the history

  3. Disable all data tests

    @jasonjewik
    jasonjewik committed Jun 18, 2023
    Configuration menu
    Copy the full SHA
    13b5fed View commit details
    Browse the repository at this point in the history

  4. Formatting

    @jasonjewik
    jasonjewik committed Jun 18, 2023
    Configuration menu
    Copy the full SHA
    3284421 View commit details
    Browse the repository at this point in the history

  5. Fix trainer

    @jasonjewik
    jasonjewik committed Jun 18, 2023
    Configuration menu
    Copy the full SHA
    17f8cbb View commit details
    Browse the repository at this point in the history

  6. Cleanup files

    @jasonjewik
    jasonjewik committed Jun 18, 2023
    Configuration menu
    Copy the full SHA
    53f0a9f View commit details
    Browse the repository at this point in the history

  7. Moved processing scripts, added PRISM processing

    @jasonjewik
    jasonjewik committed Jun 18, 2023
    Configuration menu
    Copy the full SHA
    045c59f View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2023

  1. Cleanup data downloading

    @jasonjewik
    jasonjewik committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    f9ee0c5 View commit details
    Browse the repository at this point in the history

  2. Add CLI utility for downloads, processing scripts

    @jasonjewik
    jasonjewik committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    2978346 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2023

  1. Combine iter modules

    @jasonjewik
    jasonjewik committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    c12caf6 View commit details
    Browse the repository at this point in the history

  2. Add data modules

    @jasonjewik
    jasonjewik committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    31da4e7 View commit details
    Browse the repository at this point in the history

  3. Reorganize files

    @jasonjewik
    jasonjewik committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    ee95af9 View commit details
    Browse the repository at this point in the history

  4. Remove unused notebooks

    @jasonjewik
    jasonjewik committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    2aa61c3 View commit details
    Browse the repository at this point in the history

  5. Cleaning utilities

    @jasonjewik
    jasonjewik committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    065e6a7 View commit details
    Browse the repository at this point in the history

  6. Add visualizations for bias and mean bias

    @jasonjewik
    jasonjewik committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    b9af64f View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2023

  1. Add rank histogram visualization

    @jasonjewik
    jasonjewik committed Jun 22, 2023
    Configuration menu
    Copy the full SHA
    97cde8a View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2023

  1. Organize experiments, add ERA5 crop script

    @jasonjewik
    jasonjewik committed Jun 23, 2023
    Configuration menu
    Copy the full SHA
    1d04977 View commit details
    Browse the repository at this point in the history

  2. Clean up downscaling and climate projection

    @jasonjewik
    jasonjewik committed Jun 23, 2023
    Configuration menu
    Copy the full SHA
    b473aea View commit details
    Browse the repository at this point in the history

  3. Add forecasting baselines

    @jasonjewik
    jasonjewik committed Jun 23, 2023
    Configuration menu
    Copy the full SHA
    c817b49 View commit details
    Browse the repository at this point in the history

  4. Cleanup forecasting experiments

    @jasonjewik
    jasonjewik committed Jun 23, 2023
    Configuration menu
    Copy the full SHA
    486db13 View commit details
    Browse the repository at this point in the history

  5. Removed unneeded tables

    @jasonjewik
    jasonjewik committed Jun 23, 2023
    Configuration menu
    Copy the full SHA
    755ae4a View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2023

  1. Add climate projection experiments

    @jasonjewik
    jasonjewik committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    4c163ab View commit details
    Browse the repository at this point in the history

  2. Iterative forecasting experiments

    @jasonjewik
    jasonjewik committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    694b2ca View commit details
    Browse the repository at this point in the history

  3. Iterative forecasting experiments

    @jasonjewik
    jasonjewik committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    5893a26 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2023

  1. Add extreme ERA5

    @jasonjewik
    jasonjewik committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    647bc49 View commit details
    Browse the repository at this point in the history

  2. Changes for quickstart notebook

    @jasonjewik
    jasonjewik committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    02470a6 View commit details
    Browse the repository at this point in the history

  3. Update notebooks

    @jasonjewik
    jasonjewik committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    0ae1ce6 View commit details
    Browse the repository at this point in the history

  4. Formatting

    @jasonjewik
    jasonjewik committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    813d0cb View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2023

  1. Update era5_constants.py 

    Add units for variables
    @jasonjewik
    jasonjewik authored Jun 29, 2023
    Configuration menu
    Copy the full SHA
    c0c32d8 View commit details
    Browse the repository at this point in the history

  2. Update cmip6_constants.py 

    Add units for variables.
    @jasonjewik
    jasonjewik authored Jun 29, 2023
    Configuration menu
    Copy the full SHA
    8b090ee View commit details
    Browse the repository at this point in the history

  3. Add units for visualizations

    @jasonjewik
    jasonjewik committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    d3a9896 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2023

  1. Updates for notebook

    @jasonjewik
    jasonjewik committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    e73a031 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2023

  1. Update docs and notebook

    @jasonjewik
    jasonjewik committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    64bcf1b View commit details
    Browse the repository at this point in the history

  2. Update docs

    @jasonjewik
    jasonjewik committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    f271d2e View commit details
    Browse the repository at this point in the history

  3. Finish tasks and datasets

    @jasonjewik
    jasonjewik committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    fc2e456 View commit details
    Browse the repository at this point in the history

  4. Finish docs

    @jasonjewik
    jasonjewik committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    a720f1d View commit details
    Browse the repository at this point in the history

  5. Update configs

    @jasonjewik
    jasonjewik committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    2ff90b6 View commit details
    Browse the repository at this point in the history

  6. Fix pyproject.toml

    @jasonjewik
    jasonjewik committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    eb18b5a View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2023

  1. Remove rasterio version for rtd

    @jasonjewik
    jasonjewik committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    1f24ead View commit details
    Browse the repository at this point in the history

  2. Change rtd python version

    @jasonjewik
    jasonjewik committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    f721886 View commit details
    Browse the repository at this point in the history

  3. Add OS

    @jasonjewik
    jasonjewik committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    8f17d59 View commit details
    Browse the repository at this point in the history

  4. Add images

    @jasonjewik
    jasonjewik committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    70f3025 View commit details
    Browse the repository at this point in the history

  5. v1 release

    @jasonjewik
    jasonjewik committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    ae0353d View commit details
    Browse the repository at this point in the history