Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement script to reprocess a list of dates #125

Merged
merged 3 commits into from
Feb 25, 2022
Merged

Conversation

morcuended
Copy link
Member

This script can be used to process a list of nights specified in the input file. the dates should be listed one per line in the format YYYY_MM_DD like:

2000_01_01
2000_01_04
2001_12_19
...

The script will check the status of the queue and wait if too many jobs are still pending to not overwhelm SLURM.

The script can be used along with nohup keeping the log output as follows:

nohup reprocessing --no-dl2 -c cfg/sequencer_v0.1.cfg dates_reprocess_May2001.csv > reprocessing_v0.1_May2001.log 2>&1 &

@codecov
Copy link

codecov bot commented Feb 25, 2022

Codecov Report

Merging #125 (0c6beca) into main (e3c7cd5) will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##             main     #125   +/-   ##
=======================================
  Coverage   82.16%   82.16%           
=======================================
  Files          51       51           
  Lines        4811     4811           
=======================================
  Hits         3953     3953           
  Misses        858      858           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e3c7cd5...0c6beca. Read the comment docs.

@morcuended morcuended merged commit f7fb948 into main Feb 25, 2022
@morcuended morcuended deleted the reprocess-script branch February 25, 2022 19:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant