metplotpy userscript for plotting cross spectra on Hera

[mgehne]

Hi,

I'm trying to run the user script (UserScript_obsPrecip_obsOnly_CrossSpectraPlot.conf) on HERA to plot cross spectra and I'm getting the error that the python module Ngl cannot be imported because the module can't be found. I assume it's something with me not pointing to the correct module library or similar?
I put the log file output, .conf file and my settings for MET/METplus below.

Any help is appreciated!

Thank you,
Maria

Run command:

run_metplus.py -c UserScript_obsPrecip_obsOnly_CrossSpectraPlot.conf

The log file output:

06/23 15:38:40.875 metplus INFO: Running METplus v4.1.1 called with command: /contrib/METplus/METplus-4.1.1/ush/run_metplus.py UserScript_obsPrecip_obsOnly_CrossSpectraPlot.conf
06/23 15:38:40.876 metplus INFO: Log file: /scratch2/BMC/gsienkf/Maria.Gehne/METplus/output/logs/metplus.log.20220623153840
06/23 15:38:40.876 metplus INFO: METplus Base: /contrib/METplus/METplus-4.1.1
06/23 15:38:40.876 metplus INFO: Final Conf: /scratch2/BMC/gsienkf/Maria.Gehne/METplus/output/metplus_final.conf
06/23 15:38:40.876 metplus INFO: Config Input: /scratch2/BMC/gsienkf/Maria.Gehne/METplus/METplus/parm/metplus_config/defaults.conf
06/23 15:38:40.876 metplus INFO: Config Input: /scratch2/BMC/gsienkf/Maria.Gehne/METplus/output/Spectra/UserScript_obsPrecip_obsOnly_CrossSpectraPlot.conf
06/23 15:38:40.883 metplus (config_metplus.py:1486) WARNING: METPLOTPY_BASE is already set in the environment. Overwriting from conf file
06/23 15:38:40.888 metplus INFO: ENVIRONMENT FOR NEXT COMMAND:
06/23 15:38:40.888 metplus INFO: INPUT_FILE_NAMES=/scratch2/BMC/gsienkf/Maria.Gehne/METplus/output/Spectra/data/SpaceTimeSpectra_ufs_p5_P_D200_symm_4spd.nc,/scratch2/BMC/gsienkf/Maria.Gehne/METplus/output/Spectra/data/SpaceTimeSpectra_ERAI_ufs_p5_P_symm_2spd.nc,/scratch2/BMC/gsienkf/Maria.Gehne/METplus/output/Spectra/data/SpaceTimeSpectra_ufs_p5_P_D850_symm_4spd.nc
06/23 15:38:40.888 metplus INFO: LOG_FILE="cross_spectra_plot.log"
06/23 15:38:40.888 metplus INFO: LOG_LEVEL="INFO"
06/23 15:38:40.888 metplus INFO: METPLOTPY_BASE=/contrib/METplus/METplus-4.1.1/METplotpy
06/23 15:38:40.888 metplus INFO: MET_TMP_DIR=/scratch2/BMC/gsienkf/Maria.Gehne/METplus/output/tmp
06/23 15:38:40.888 metplus INFO: OMP_NUM_THREADS=1
06/23 15:38:40.888 metplus INFO: OUTPUT_DIR=/scratch2/BMC/gsienkf/Maria.Gehne/METplus/output/plots/
06/23 15:38:40.888 metplus INFO: YAML_CONFIG_NAME=/contrib/METplus/METplus-4.1.1/parm/use_cases/model_applications/s2s/UserScript_obsPrecip_obsOnly_CrossSpectraPlot/spectra_plot.yaml
06/23 15:38:40.888 metplus INFO: COMMAND: /scratch2/BMC/gsienkf/Maria.Gehne/METplus/METplus/parm/use_cases/model_applications/s2s/UserScript_obsPrecip_obsOnly_CrossSpectraPlot/cross_spectra_plot.py
OUTPUT:
Traceback (most recent call last):
  File "/scratch2/BMC/gsienkf/Maria.Gehne/METplus/METplus/parm/use_cases/model_applications/s2s/UserScript_obsPrecip_obsOnly_CrossSpectraPlot/cross_spectra_plot.py", line 12, in <module>
    import metplotpy.contributed.spacetime_plot.spacetime_plot as stp
  File "/contrib/METplotpy/METplotpy-1.1.0/metplotpy/contributed/spacetime_plot/spacetime_plot.py", line 23, in <module>
    import Ngl as ngl
ModuleNotFoundError: No module named 'Ngl'
06/23 15:38:46.255 metplus (command_builder.py:265) ERROR: (command_builder.py:1362) MET command returned a non-zero return code:/scratch2/BMC/gsienkf/Maria.Gehne/METplus/METplus/parm/use_cases/model_applications/s2s/UserScript_obsPrecip_obsOnly_CrossSpectraPlot/cross_spectra_plot.py
06/23 15:38:46.255 metplus INFO: Check the logfile for more information on why it failed: /scratch2/BMC/gsienkf/Maria.Gehne/METplus/output/logs/metplus.log.20220623153840
06/23 15:38:46.257 metplus.UserScript (met_util.py:167) ERROR: UserScript had 1 error.
06/23 15:38:46.259 metplus INFO: Overwrite final conf here: /scratch2/BMC/gsienkf/Maria.Gehne/METplus/output/metplus_final.conf
06/23 15:38:46.260 metplus (met_util.py:210) ERROR: METplus has finished running but had 1 error.
06/23 15:38:46.261 metplus INFO: Check the log file for more information: /scratch2/BMC/gsienkf/Maria.Gehne/METplus/output/logs/metplus.log.20220623153840

The .conf file I'm using:

[config]

PROCESS_LIST = UserScript

# Note: time looping is not used in this use case
LOOP_BY = REALTIME
VALID_TIME_FMT = %Y
VALID_BEG = 2014

USER_SCRIPT_RUNTIME_FREQ = RUN_ONCE

USER_SCRIPT_COMMAND = {PARM_BASE}/use_cases/model_applications/s2s/UserScript_obsPrecip_obsOnly_CrossSpectraPlot/cross_spectra_plot.py


[user_env_vars]

# Difficulty index specific variables

LOG_FILE = "cross_spectra_plot.log"

LOG_LEVEL = "INFO"

#INPUT_FILE_NAMES = {INPUT_BASE}/model_applications/s2s/UserScript_obsPrecip_obsOnly_CrossSpectraPlot/SpaceTimeSpectra_ERAI_P_D200_symm_2spd.nc,{INPUT_BASE}/model_applications/s2s/UserScript_obsPrecip_obsOnly_CrossSpectraPlot/SpaceTimeSpectra_ERAI_TRMM_P_symm_2spd.nc,{INPUT_BASE}/model_applications/s2s/UserScript_obsPrecip_obsOnly_CrossSpectraPlot/SpaceTimeSpectra_ERAI_P_D850_symm_2spd.nc
INPUT_FILE_NAMES = {OUTPUT_BASE}/Spectra/data/SpaceTimeSpectra_ufs_p5_P_D200_symm_4spd.nc,{OUTPUT_BASE}/Spectra/data/SpaceTimeSpectra_ERAI_ufs_p5_P_symm_2spd.nc,{OUTPUT_BASE}/Spectra/data/SpaceTimeSpectra_ufs_p5_P_D850_symm_4spd.nc

METPLOTPY_BASE = {METPLUS_BASE}/METplotpy

YAML_CONFIG_NAME = {METPLUS_BASE}/parm/use_cases/model_applications/s2s/UserScript_obsPrecip_obsOnly_CrossSpectraPlot/spectra_plot.yaml

OUTPUT_DIR = {OUTPUT_BASE}/plots/

And here are the relevant settings in my .cshrc:

# environment variables for MET/METplus
setenv METPLUS_TUTORIAL_DIR /scratch2/BMC/gsienkf/Maria.Gehne/METplus
setenv METPLUS_BUILD_BASE /contrib/METplus/METplus-4.1.1
setenv MET_BUILD_BASE /contrib/met/10.1.1
setenv METPLUS_DATA /scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus-4.0_sample_data

# MODULES for MET/METplus
module use -a /contrib/anaconda/modulefiles
module load anaconda/latest
module use -a /contrib/met/modulefiles/
module load met/10.1.1

module use /contrib/METplus/modulefiles
module load metplus/4.1.1

module use /contrib/METcalcpy/modulefiles
module load metcalcpy/1.1.0
module use /contrib/METplotpy/modulefiles
module load metplotpy/1.1.0

setenv PATH ${METPLUS_BUILD_BASE}/ush:${PATH}
setenv METPLUS_PARM_BASE ${METPLUS_TUTORIAL_DIR}/METplus/parm
setenv LD_LIBRARY_PATH /contrib/met/10.1.1/external_libs/lib:${LD_LIBRARY_PATH}

[jprestop]

HI @mgehne. Thank you for the detailed information. It was very helpful.

I have installed pyngl in the conda environment being used by the modules. Please reload the modules and try again. I was able to get past the error above after installing pyngl.

Please let us know how it goes.

[mgehne]

That works now! Thank you!! Maria

…

On Fri, Jun 24, 2022 at 10:54 AM jprestop ***@***.***> wrote: HI @mgehne <https://github.com/mgehne>. Thank you for the detailed information. It was very helpful. I have installed pyngl in the conda environment being used by the modules. Please reload the modules and try again. I was able to get past the error above after installing pyngl. Please let us know how it goes. — Reply to this email directly, view it on GitHub <#1675 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ALAWF754R67DOCA3PZ3XTULVQXR4NANCNFSM5ZU25BCQ> . You are receiving this because you were mentioned.Message ID: ***@***.***>