Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Test] Build only enabled LTP tests #812

Merged
merged 6 commits into from
Aug 20, 2020
Merged

[Test] Build only enabled LTP tests #812

merged 6 commits into from
Aug 20, 2020

Conversation

hukoyu
Copy link
Collaborator

@hukoyu hukoyu commented Aug 20, 2020

Fixes #811

With this PR we will build only enabled LTP tests. Not enabled syscall folders are determined at run time by looking at enabled ltp tests files and ltp/testcases/kernel/syscalls folders. If a syscall folder doesn't have any enabled LTP test(s), this folder will be skipped during build and will be reported in skipped binaries and folders statistics.

Also improved the statistics reporting for syscall folders and test binaries.
In addition to Success, Failed status we have Skipped status as well for each syscall folder.

The current results stats is like that:

Syscalls/Folders => Total: 344, Success: 237, Fail: 1, Skip: 106
Tests/Binaries   => Total: 1046, Success: 774, Fail: 2, Skip: 270

Generated 774/1046 binaries in 237/344 folders in /ltp/testcases/kernel/syscalls
Skipped 270/1046 binaries in 106/344 folders since LTP tests not enabled
Failed to generate 2/1046 binaries in 1/344 folders

Here is the complete build log:
ltp_build_log.txt

The only two failures are:
[Test #255/359] Building /ltp/testcases/kernel/syscalls/ptrace Success
WARNING !! ./ptrace06 is not generated
WARNING !! ./simple_tracer is not generated
These two tests are not enabled and Makefile of ptrace returns 0 evenif these two binaries not generated. (There are enabled tests in this syscall folder, that's why it is built)

@davidchisnall
Copy link
Contributor

Looks good to me, but @letmaik / @SeanTAllen are more familiar with this bit of build system than me.

@hukoyu
Copy link
Collaborator Author

hukoyu commented Aug 20, 2020

The fix working as expected. The a few faliures are shutdown timeout related random failures that @prp 's PR #788 will fix.

@hukoyu hukoyu merged commit 611577c into lsds:oe_port Aug 20, 2020
@hukoyu hukoyu deleted the hukoyu/ltp-build branch August 20, 2020 21:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Test] Build only enabled LTP tests
4 participants