Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Actions job to concatenate tutorials data to one CSV and run analysis notebook #1703

Closed
wants to merge 22 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
fdd9d54
Notebook to visualize runtime and memory data from tutorials
esantorella Feb 21, 2023
5f208d5
re-ran notebook
esantorella Feb 23, 2023
3db6a2c
Merge remote-tracking branch 'origin' into tutorials_analytics
esantorella Feb 24, 2023
adce7a6
Workflow to visualize tutorials output
esantorella Feb 25, 2023
05f0135
avoid explicit reference to branch name in workflow file
esantorella Feb 25, 2023
9408a85
temporarily taking out csv logic to fail fast otherwise
esantorella Feb 25, 2023
4379114
put everything back in except for running all the tutorials
esantorella Feb 25, 2023
ce00604
Add seaborn to tutorials_requires
esantorella Feb 25, 2023
8bfc1ae
use papermill to run tutorial
esantorella Feb 27, 2023
3e3990b
fix path
esantorella Feb 27, 2023
31830e3
add papermill to tutorials dependencies
esantorella Feb 27, 2023
f0155c5
set cwd for papermill
esantorella Feb 27, 2023
f37a0a1
remove break statement
esantorella Feb 27, 2023
23ef9eb
lint
esantorella Feb 27, 2023
be4627a
Merge remote-tracking branch 'origin' into tutorials_analytics
esantorella Mar 10, 2023
6a2d36e
Apply suggestions from code review
esantorella Mar 10, 2023
1da367c
Save figures as SVG + run black on notebook
esantorella Mar 11, 2023
350a967
smaller figures
esantorella Mar 11, 2023
addf060
strip outputs
esantorella Mar 11, 2023
56cfd37
Merge branch 'main' into tutorials_analytics
esantorella Mar 13, 2023
e2b9e52
Merge branch 'main' into tutorials_analytics
esantorella Mar 14, 2023
e42fd75
Update scripts/analyze_tutorials_performance.py
esantorella Mar 14, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 13 additions & 3 deletions .github/workflows/reusable_tutorials.yml
Original file line number Diff line number Diff line change
Expand Up @@ -90,12 +90,22 @@ jobs:
python scripts/run_tutorials.py -p "$(pwd)"
- if: ${{ inputs.upload_artifact }}
name: Upload performance data to artifacts branch
# Upload any csv files (the tutorials script ensures there is only one)
# 1) Switch to artifacts branch
# 2) Add the new CSV file
# 3) Get .py and .ipynb files needed for analyzing tutorials data from main
# 4) Run `scripts/analyze_tutorials_performance.py` to merge CSVs and
# update notebook
# 5) Commit updated notebook and new CSVs to artifacts branch
run: |
git config user.email "github-actions@github.com"
git config user.name "github-actions"
cp scripts/analyze_tutorials_performance.py analyze_tutorials_performance.py
cp notebooks/tutorials_performance_tracking.ipynb tutorials_performance_tracking.ipynb
git switch artifacts
mv *.csv tutorial_performance_data/
git add tutorial_performance_data/*.csv
git commit tutorial_performance_data/*.csv -m "Adding most recent tutorials output"
mv tutorials_performance_tracking.ipynb notebooks/
pip install seaborn
python analyze_tutorials_performance.py
git add tutorial_performance_data/*.csv notebooks/tutorials_performance_tracking.ipynb
git commit -a -m "Adding most recent tutorials CSVs and performance analytics notebook"
git push origin artifacts
Loading