Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add files for C96C48 JEDI ATM CI case to central ICSDIR_ROOT #2393

Closed
RussTreadon-NOAA opened this issue Mar 12, 2024 · 9 comments
Closed

Add files for C96C48 JEDI ATM CI case to central ICSDIR_ROOT #2393

RussTreadon-NOAA opened this issue Mar 12, 2024 · 9 comments
Assignees
@KateFriedman-NOAA
Labels
feature New feature or request

Comments

@RussTreadon-NOAA
Copy link
Contributor

What new functionality do you need?

PR #2357 added a JEDI ATM CI case to g-w develop. While JEDI ATM CI is turned off, it would be good to stage the files needed to run JEDI ATM CI in the centrally maintained ICSDIR_ROOT.

What are the requirements for the new functionality?

In order for automated g-w CI to run JEDI ATM CI, the required initial condition files need to be copied to the centrally maintained ICSDIR_ROOT.

Acceptance Criteria

Once the required files are copied to ICSDIR_ROOT, automated g-w CI should successfully run JEDI ATM CI if it is activated.

Suggest a solution (optional)

To stage JEDI ATM CI files on Hera

  1. export JEDIATM_ROOT=/scratch1/NCEPDEV/da/Russ.Treadon/CASES/gfs/prod/C96C48
  2. export ICSDIR_ROOT=/scratch1/NCEPDEV/global/glopara/data/ICSDIR/C96C48
  3. cp -rp $JEDIATM_ROOT/gdas.20240223 $ICSDIR_ROOT/
  4. cp -rp $JEDIATM_ROOT/enkfgdas.20240223 $ICDIR_ROOT/
  5. rsync Hera $ICSROOT_DIR to other platforms
@RussTreadon-NOAA RussTreadon-NOAA added feature New feature or request triage Issues that are triage labels Mar 12, 2024
@RussTreadon-NOAA
Copy link
Contributor Author

If this is not the correct way to make this request, what is the correct procedure?

@WalterKolczynski-NOAA WalterKolczynski-NOAA removed the triage Issues that are triage label Mar 12, 2024
@RussTreadon-NOAA
Copy link
Contributor Author

The C96C48L127 initial condition files use about 1.545 Gb of disk space

Hera(hfe02):/scratch1/NCEPDEV/da/Russ.Treadon/CASES/gfs/prod/C96C48$ du -ks gdas.20240223 enkfgdas.20240223
1072664 gdas.20240223
547080  enkfgdas.20240223

@KateFriedman-NOAA KateFriedman-NOAA self-assigned this Mar 13, 2024
@KateFriedman-NOAA
Copy link
Member

@RussTreadon-NOAA I have copied the new 20240223 JEDI ATM CI IC set into the ../ICSDIR/C96C48 folder on Hera:

[role.glopara@hfe05 C96C48]$ pwd
/scratch1/NCEPDEV/global/glopara/data/ICSDIR/C96C48
[role.glopara@hfe05 C96C48]$ ll | grep 2024
drwxr-sr-x 3 role.glopara global 4096 Mar 12 15:46 enkfgdas.20240223
drwxr-sr-x 4 role.glopara global 4096 Mar 12 15:46 gdas.20240223

Please confirm they look good there and you are able to access them. We will sync them to the other supported platforms next.

@KateFriedman-NOAA KateFriedman-NOAA mentioned this issue Mar 13, 2024
Closed
@RussTreadon-NOAA
Copy link
Contributor Author

Thank you, @KateFriedman-NOAA . Let me trigger JEDI ATM CI on Hera and report back to this issue.

@RussTreadon-NOAA
Copy link
Contributor Author

JEDI ATM CI ran overnight on Hera with ICSDIR_ROOT=/scratch1/NCEPDEV/global/glopara/data/ICSDIR. All jobs successfully ran to completion.

Hera(hfe05):/scratch1/NCEPDEV/stmp2/Russ.Treadon/EXPDIR/prtest$ rocotostat -d prtest.db -w prtest.xml
       CYCLE                    TASK                       JOBID               STATE         EXIT STATUS     TRIES      DURATION
================================================================================================================================
202402231800                gdasfcst                    57146977           SUCCEEDED                   0         1         515.0
202402231800    gdasatmos_prod_f000-f002                    57148286           SUCCEEDED                   0         1         136.0
202402231800    gdasatmos_prod_f003-f005                    57148287           SUCCEEDED                   0         1         140.0
202402231800    gdasatmos_prod_f006-f007                    57148288           SUCCEEDED                   0         1          96.0
202402231800    gdasatmos_prod_f008-f009                    57148391           SUCCEEDED                   0         1          95.0
202402231800                gdasarch                    57151089           SUCCEEDED                   0         1          40.0
202402231800         enkfgdasechgres                    57148289           SUCCEEDED                   0         1          29.0
202402231800     enkfgdasfcst_mem001                    57146978           SUCCEEDED                   0         1         302.0
202402231800     enkfgdasfcst_mem002                    57146979           SUCCEEDED                   0         1         278.0
202402231800         enkfgdasepos000                    57148290           SUCCEEDED                   0         1          33.0
202402231800         enkfgdasepos001                    57148291           SUCCEEDED                   0         1          32.0
202402231800         enkfgdasepos002                    57148292           SUCCEEDED                   0         1          32.0
202402231800         enkfgdasepos003                    57148293           SUCCEEDED                   0         1          33.0
202402231800         enkfgdasepos004                    57148294           SUCCEEDED                   0         1          32.0
202402231800         enkfgdasepos005                    57148295           SUCCEEDED                   0         1          32.0
202402231800         enkfgdasepos006                    57148296           SUCCEEDED                   0         1          33.0
202402231800          enkfgdasearc00                    57150435           SUCCEEDED                   0         1          33.0
================================================================================================================================
202402240000                gdasprep                    57151090           SUCCEEDED                   0         1         263.0
202402240000      gdasprepatmiodaobs                    57154065           SUCCEEDED                   0         1         319.0
202402240000          gdasatmanlinit                    57154209           SUCCEEDED                   0         1          45.0
202402240000           gdasatmanlrun                    57154310           SUCCEEDED                   0         1         636.0
202402240000         gdasatmanlfinal                    57154585           SUCCEEDED                   0         1         121.0
202402240000              gdassfcanl                    57154762           SUCCEEDED                   0         1         158.0
202402240000            gdasanalcalc                    57154877           SUCCEEDED                   0         1          69.0
202402240000           gdasatmanlupp                    57154942           SUCCEEDED                   0         1          24.0
202402240000          gdasatmanlprod                    57155064           SUCCEEDED                   0         1          50.0
202402240000                gdasfcst                    57154878           SUCCEEDED                   0         1         456.0
202402240000    gdasatmos_prod_f000-f002                    57155068           SUCCEEDED                   0         1         143.0
202402240000    gdasatmos_prod_f003-f005                    57155065           SUCCEEDED                   0         1         139.0
202402240000    gdasatmos_prod_f006-f007                    57155071           SUCCEEDED                   0         1          99.0
202402240000    gdasatmos_prod_f008-f009                    57155067           SUCCEEDED                   0         1          97.0
202402240000             gdasfit2obs                    57155384           SUCCEEDED                   0         1          11.0
202402240000                gdasarch                    57155569           SUCCEEDED                   0         1          62.0
202402240000             gdascleanup                    57155666           SUCCEEDED                   0         1          12.0
202402240000    enkfgdasatmensanlinit                    57154210           SUCCEEDED                   0         1          24.0
202402240000    enkfgdasatmensanlrun                    57154311           SUCCEEDED                   0         1         420.0
202402240000    enkfgdasatmensanlfinal                    57154472           SUCCEEDED                   0         1          92.0
202402240000         enkfgdasechgres                    57155385           SUCCEEDED                   0         1          22.0
202402240000         enkfgdasecen000                    57154946           SUCCEEDED                   0         1          36.0
202402240000            enkfgdasesfc                    57154947           SUCCEEDED                   0         1          76.0
202402240000     enkfgdasfcst_mem001                    57155069           SUCCEEDED                   0         1         262.0
202402240000     enkfgdasfcst_mem002                    57155070           SUCCEEDED                   0         1         265.0
202402240000         enkfgdasepos000                    57155386           SUCCEEDED                   0         1          34.0
202402240000         enkfgdasepos001                    57155383           SUCCEEDED                   0         1          31.0
202402240000         enkfgdasepos002                    57155387           SUCCEEDED                   0         1          34.0
202402240000         enkfgdasepos003                    57155382           SUCCEEDED                   0         1          33.0
202402240000         enkfgdasepos004                    57155388           SUCCEEDED                   0         1          32.0
202402240000         enkfgdasepos005                    57155389           SUCCEEDED                   0         1          34.0
202402240000         enkfgdasepos006                    57155390           SUCCEEDED                   0         1          32.0
202402240000          enkfgdasearc00                    57155570           SUCCEEDED                   0         1          24.0
202402240000         enkfgdascleanup                    57155667           SUCCEEDED                   0         1          13.0
202402240000                 gfsprep                    57151091           SUCCEEDED                   0         1         247.0
202402240000       gfsprepatmiodaobs                    57154066           SUCCEEDED                   0         1         295.0
202402240000           gfsatmanlinit                    57154211           SUCCEEDED                   0         1          30.0
202402240000            gfsatmanlrun                    57154312           SUCCEEDED                   0         1         533.0
202402240000          gfsatmanlfinal                    57154586           SUCCEEDED                   0         1         102.0
202402240000               gfssfcanl                    57154761           SUCCEEDED                   0         1         148.0
202402240000             gfsanalcalc                    57154879           SUCCEEDED                   0         1          68.0
202402240000            gfsatmanlupp                    57154948           SUCCEEDED                   0         1          24.0
202402240000           gfsatmanlprod                    57155066           SUCCEEDED                   0         1          73.0
202402240000                 gfsfcst                    57154880           SUCCEEDED                   0         1        4094.0
202402240000    gfsatmos_prod_f000-f006                    57155072           SUCCEEDED                   0         1         222.0
202402240000    gfsatmos_prod_f009-f015                    57155266           SUCCEEDED                   0         1         222.0
202402240000    gfsatmos_prod_f018-f024                    57155391           SUCCEEDED                   0         1         228.0
202402240000    gfsatmos_prod_f027-f033                    57155434           SUCCEEDED                   0         1         222.0
202402240000    gfsatmos_prod_f036-f042                    57155538           SUCCEEDED                   0         1         224.0
202402240000    gfsatmos_prod_f045-f051                    57155574           SUCCEEDED                   0         1         226.0
202402240000    gfsatmos_prod_f054-f060                    57155668           SUCCEEDED                   0         1         219.0
202402240000    gfsatmos_prod_f063-f069                    57155806           SUCCEEDED                   0         1         221.0
202402240000    gfsatmos_prod_f072-f078                    57155866           SUCCEEDED                   0         1         272.0
202402240000    gfsatmos_prod_f081-f087                    57155952           SUCCEEDED                   0         1         256.0
202402240000    gfsatmos_prod_f090-f096                    57156097           SUCCEEDED                   0         1         244.0
202402240000    gfsatmos_prod_f099-f105                    57156206           SUCCEEDED                   0         1         230.0
202402240000    gfsatmos_prod_f108-f114                    57156322           SUCCEEDED                   0         1         229.0
202402240000    gfsatmos_prod_f117-f120                    57156395           SUCCEEDED                   0         1         151.0
202402240000              gfstracker                    57156589           SUCCEEDED                   0         1          15.0
202402240000              gfsgenesis                    57156590           SUCCEEDED                   0         1         426.0
202402240000             gfsmetpg2g1                    57156965           SUCCEEDED                   0         1          86.0
202402240000             gfsmetpg2o1                    57156966           SUCCEEDED                   0         1         245.0
202402240000             gfsmetppcp1                    57156967           SUCCEEDED                   0         1          16.0
202402240000                 gfsarch                    57156865           SUCCEEDED                   0         1         282.0
202402240000              gfscleanup                    57156968           SUCCEEDED                   0         1          15.0
Hera(hfe05):/scratch1/NCEPDEV/stmp2/Russ.Treadon/EXPDIR/prtest$

@RussTreadon-NOAA
Copy link
Contributor Author

@KateFriedman-NOAA , given the successful Hera JEDI ATM CI run, we can rsync the JEDI ATM CI initial conditions to other supported platforms.

@KateFriedman-NOAA
Copy link
Member

Will do! @WalterKolczynski-NOAA please sync the C96C48 ICSDIR set to Orion. I'm syncing the other platforms.

@WalterKolczynski-NOAA
Copy link
Contributor

Synchronized to Orion

@KateFriedman-NOAA
Copy link
Member

Synced to WCOSS2 and Jet. Closing as complete.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@KateFriedman-NOAA KateFriedman-NOAA

Labels
feature New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@RussTreadon-NOAA @WalterKolczynski-NOAA @KateFriedman-NOAA