-
Notifications
You must be signed in to change notification settings - Fork 479
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Moved Script Evaluation Test to GHA #5095
Changes from all commits
c60718d
78c42b1
4669bc2
fcc5ac4
dd93a97
78a2cee
ebca464
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,15 +1,19 @@ | ||
name: "Tests" | ||
name: Pre Commit Check | ||
on: | ||
pull_request: | ||
jobs: | ||
nix-sanity-checks: | ||
pre-commit-check: | ||
runs-on: [ubuntu-latest] | ||
steps: | ||
- uses: actions/checkout@v3 | ||
- uses: nixbuild/nix-quick-install-action@v21 | ||
- name: Checkout | ||
uses: actions/checkout@v3 | ||
|
||
- name: Quick Install Nix | ||
uses: nixbuild/nix-quick-install-action@v21 | ||
with: | ||
nix_conf: | | ||
experimental-features = nix-command flakes | ||
accept-flake-config = true | ||
- name: Pre-commit check | ||
|
||
- name: Run | ||
run: nix build .#pre-commit-check |
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,40 @@ | ||
# A nightly job which downloads script evaluation dumps from S3 and runs a regression test. | ||
name: Script Evaluation Test | ||
on: | ||
schedule: | ||
- cron: 30 3 * * * # 3:30am every day | ||
|
||
concurrency: | ||
group: script-evaluation-test | ||
# We only want at most one evaluation test running at a time | ||
cancel-in-progress: true | ||
|
||
jobs: | ||
script-evaluation-test: | ||
runs-on: [self-hosted, plutus-benchmark] | ||
|
||
steps: | ||
- name: Checkout | ||
uses: actions/checkout@v3.3.0 | ||
|
||
- name: Download and Unzip Dump Files | ||
run: | | ||
export LOCAL_DIR="$HOME/mainnet-script-dump-downloaded" | ||
nix develop --no-warn-dirty --accept-flake-config --command \ | ||
bash ./scripts/s3-sync-unzip.sh s3://plutus/mainnet-script-dump/ \*.event.bz2 | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Since we're running on a persistent machine, is there a way we can save this somewhere persistent and only sync the remainder? There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I think the file There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
||
env: | ||
AWS_ACCESS_KEY_ID: ${{ secrets.AWS_ACCESS_KEY_ID }} | ||
AWS_SECRET_ACCESS_KEY: ${{ secrets.AWS_SECRET_ACCESS_KEY }} | ||
AWS_DEFAULT_REGION: us-east-1 | ||
AWS_ENDPOINT_URL: https://s3.devx.iog.io | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Can someone confirm that these two are correct? |
||
|
||
- name: Run | ||
# Run the test cases sequentially. This ensures we don't need to simultaneously store | ||
# multiple `ScriptEvaluationEvents`, which are large, in memory. Each test case | ||
# contains many script evaluation events, and those are run in parallel based on | ||
# the number of available processors. | ||
run: | | ||
export EVENT_DUMP_DIR="$HOME/mainnet-script-dump-downloaded" | ||
nix run .#x86_64-linux.plutus.library.plutus-project-924.hsPkgs.plutus-ledger-api.components.exes.evaluation-test -- --num-threads=1 | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. We should test this, I'm not 100% sure whether it will work. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. tested locally |
||
|
||
|
This file was deleted.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I chose at random, happy to change