Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adds option for parallel weight generation with xESMF #145

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

norlandrhagen
Copy link
Contributor

With ~0.8 release of xESMF, you can now specify parallel=True to the weight generation which will generate weights with Dask instead of MPI.

Thanks for the xESMF knowledge drop @keewis!

@keewis
Copy link

keewis commented Aug 14, 2024

to be more precise, before 0.8 xesmf would compute the weights on a single machine (the jupyterhub instance, for example), and if that ran out of memory you'd have to manually save both source and destination grid to netcdf files and call a command line tool on those to do the computation using MPI (possibly on a bigger machine).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants