-
Notifications
You must be signed in to change notification settings - Fork 919
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improvements to the integration tests build #1313
Conversation
Signed-off-by: Leonardo Di Donato <leodidonato@gmail.com>
Signed-off-by: Leonardo Di Donato <leodidonato@gmail.com>
Signed-off-by: Leonardo Di Donato <leodidonato@gmail.com>
This make target calls the `trace-files-psp`, `trace-files-k8s-audit`, `trace-files-base-scap` targets to place all the integration test fixtures in the proper position. Signed-off-by: Leonardo Di Donato <leodidonato@gmail.com>
…t suites Signed-off-by: Leonardo Di Donato <leodidonato@gmail.com>
…suite Signed-off-by: Leonardo Di Donato <leodidonato@gmail.com>
options The following options have been added: * -v (verbose) * -p (prepare falco_traces test suite) * -b (specify custom branch for downloading trace files) * -d (specify the build directory) Signed-off-by: Leonardo Di Donato <leodidonato@gmail.com>
…uite locally Signed-off-by: Leonardo Di Donato <leodidonato@gmail.com>
…ite in a non-interactive way Signed-off-by: Leonardo Di Donato <leodidonato@gmail.com>
Signed-off-by: Leonardo Di Donato <leodidonato@gmail.com>
Signed-off-by: Leonardo Di Donato <leodidonato@gmail.com>
Signed-off-by: Leonardo Di Donato <leodidonato@gmail.com>
/hold cancel |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
SGTM,
though I still got some errors.
- When running locally using
virtualenv
andfalco_test.yaml
, although I executed all preparation steps (including ones forfalco_traces
),
virtualenv venv
source venv/bin/activate
pip install -r requirements.txt
BUILD_DIR="../build" avocado run --mux-yaml falco_tests.yaml --job-results-dir /tmp/job-results -- falco_test.py
deactivate
just one test is not passing:
(83/96) falco_test.py:FalcoTest.test;in_operator_netmasks-ea28: ERROR: Falco command "../build/userspace/falco/falco -r /home/leogr/code/github.com/falcosecurity/falco/test/rules/detect_connect_using_in.yaml -c /home/leogr/code/github.com/falcosecurity/falco/test/../falco.yaml -e ../build/test/trace_files/connect_localhost... (0.36 s)
- Also, when using
./run_regression_tests.sh -v
although I executed all preparation (including ones forfalco_tests_package
) many tests are not passing.
I'm still investigating to figure out the problems
Verify your local build is a |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This works very good for me. You made it very easy now (again) - Thanks for crafting this PR.
LGTM
LGTM label has been added. Git tree hash: a84fd9c3ece72a7d70b52137243cb50ea08e5f39
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I have posted just two suggestions to avoid headaches when using this.
Could we include these clarifications before merging this?
…ild of Falco Signed-off-by: Leonardo Di Donato <leodidonato@gmail.com> Co-authored-by: Leonardo Grasso <me@leonardograsso.com>
LGTM label has been added. Git tree hash: 2cd60f1671d7db0e4b39d9d27d83a3e6ecb06f4c
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: fntlnz, Kaizhe The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
What type of PR is this?
/kind cleanup
/kind documentation
/kind feature
Any specific area of the project related to this PR?
/area build
/area tests
What this PR does / why we need it:
run_regression_tests.sh
scriptfalcosecurity/falco-tester
imageupdate-integration-tests-build
)falcosecurity/falco-tester:update-integration-tests-build
imagelatest
and switch back the CI to normal flowrun_regression_tests.sh
changes into the Falco website (update instructions to run integration test locally falco-website#227)Which issue(s) this PR fixes:
Special notes for your reviewer:
Ready for review.
/cc @fntlnz
/cc @leogr
Does this PR introduce a user-facing change?: