-
Notifications
You must be signed in to change notification settings - Fork 40
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
11 changed files
with
28 additions
and
111 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,24 +1,21 @@ | ||
# "Golden" Templates | ||
# Testing Maturity Model | ||
|
||
[Here](https://github.com/smartcontractkit/chainlink-testing-framework/actions/runs/11739154666/job/32703095118?pr=1311) are our "golden" templates for end-to-end tests, covering every test type: | ||
|
||
- `Smoke` | ||
- `Performance` | ||
- `PerformanceBaseline` | ||
- `Chaos` | ||
- `Upgrade` | ||
|
||
These tests act as a maturity model and are implemented across all our products. | ||
|
||
Run them locally: | ||
Refer to this README to understand the rationale behind our testing approach and to explore the stages of maturity in end-to-end testing. | ||
|
||
## Developing | ||
Run the tests locally | ||
``` | ||
CTF_CONFIGS=smoke.toml go test -v -run TestSmoke | ||
CTF_CONFIGS=load.toml go test -v -run TestLoad | ||
CTF_CONFIGS=performance_baseline.toml go test -v -run TestPerformanceBaseline | ||
CTF_CONFIGS=chaos.toml go test -v -run TestChaos | ||
CTF_CONFIGS=upgrade_some.toml go test -v -run TestUpgradeSome | ||
CTF_CONFIGS=upgrade.toml go test -v -run TestUpgrade | ||
``` | ||
|
||
Use this [workflow](https://github.com/smartcontractkit/chainlink-testing-framework/actions/runs/11739154666/workflow?pr=1311) as a starting point for developing a new end-to-end integration test. | ||
|
||
Set the count to 5-10 during development, and once stable, set the timeout and proceed to merge. | ||
|
||
If you need to structure a lot of different tests (not only end-to-end) follow [this](https://github.com/smartcontractkit/.github/tree/main/.github/workflows) guide. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,7 +1,3 @@ | ||
export LOKI_TENANT_ID=promtail | ||
export LOKI_URL=http://localhost:3030/loki/api/v1/push | ||
export TESTCONTAINERS_RYUK_DISABLED=true | ||
export PRIVATE_KEY="..." | ||
# load test | ||
#export LOKI_TENANT_ID=promtail | ||
#export LOKI_URL=http://localhost:3030/loki/api/v1/push | ||
#export RESTY_DEBUG=true | ||
export CTF_LOG_LEVEL=info |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1 +1,10 @@ | ||
# End-to-End Testing Project Maturity Model | ||
# End-to-End Testing Project Maturity Model | ||
|
||
## Developing | ||
Run the tests locally | ||
``` | ||
CTF_CONFIGS=smoke.toml go test -v -run TestSmoke | ||
CTF_CONFIGS=performance_baseline.toml go test -v -run TestPerformanceBaseline | ||
CTF_CONFIGS=chaos.toml go test -v -run TestChaos | ||
CTF_CONFIGS=upgrade.toml go test -v -run TestUpgrade | ||
``` |
File renamed without changes.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
File renamed without changes.
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters