Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add script for scraping stats from GCClassic cloud benchmarks #335

Merged
merged 4 commits into from
Aug 27, 2024

Commits on Aug 22, 2024

  1. Add script for scraping stats from GCClassic cloud benchmarks

    gcpy/benchmark/modules/benchmark_gcclassic_stats.py
    - Script to scrape statistics (Wall time, memory, OH metrics, timers)
      from the GEOS-Chem Classic cloud benchmarks on AWS
    
    CHANGELOG.md
    - Updated accordingly
    
    Signed-off-by: Bob Yantosca <yantosca@seas.harvard.edu>
    yantosca committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    55379c0 View commit details
    Browse the repository at this point in the history
  2. Bug fix: Swap order of MCF lifetime and CH4 lifetime

    gcpy/benchmark/modules/benchmark_gcclassic_stats.py
    - Now print MCF (aka CH3CCl3) lifetime before CH4 lifetime, which is the
      proper order in the "GEOS-Chem 1-month benchmark stats" spreadsheet.
    
    Signed-off-by: Bob Yantosca <yantosca@seas.harvard.edu>
    yantosca committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    2c577f0 View commit details
    Browse the repository at this point in the history
  3. Now separate stats with commas instead of spaces

    gcpy/benchmark/modules/benchmark_gcclassic_stats.py
    - Now write output in comma-separated format
    
    Signed-off-by: Bob Yantosca <yantosca@seas.harvard.edu>
    yantosca committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    ea826f3 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. Update GCClassic benchmark statas output to spreadsheet format

    gcpy/benchmark/modules/benchmark_gcclassic_stats.py
    - Add 2 blank columns after "Wall Time"
    - Add 2 blank columns after "CH4"
    - Remove "blank" after "Mean OH"
    
    This now allows you to cut-n-paste the output into the Google sheet
    and then pick Data -> Split cell into columns.
    
    Signed-off-by: Bob Yantosca <yantosca@seas.harvard.edu>
    yantosca committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    a146193 View commit details
    Browse the repository at this point in the history