Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Add test case identifiers for tests being executed to console output and more informative console output #1958

Closed
martin-mat opened this issue Apr 8, 2024 · 3 comments
Assignees
Labels
enhancement New feature or request

Comments

@martin-mat
Copy link
Collaborator

martin-mat commented Apr 8, 2024

Is your feature request related to a problem? Please describe.
Currently, console output does not provide any information about what testcase is being executed/has been executed.
Example:

  1. start test execution

$ ./cnf-testsuite single_process_type

(test is being executed, user is not informed about any action ongoing)

  1. tests finishes

$ ./cnf-testsuite single_process_type
✔️ 🏆PASSED: Only one process type used ⚖👀
$

(test execution finished, user is informed about the test result, but no explicit test identifier (single_process_type) given. User needs to guess what test case it was (from the result note "Only one process type used")

Describe the solution you'd like
Give more information about what is going on and an exact test description.
Example:

  1. start test execution

$ ./cnf-testsuite single_process_type
🎬 Testing "single_process_type"

(test is being executed, user is not informed about any action ongoing)

  1. tests finishes

$ ./cnf-testsuite single_process_type
🎬 Testing: single_process_type
✔️ 🏆PASSED: single_process_type ⚖👀
$

or

$ ./cnf-testsuite single_process_type
🎬 Testing: single_process_type
✖️ 🏆FAILED: single_process_type ⚖👀
$

Eventually, the "Testing" line can be replaced on then console with the result line after the test is executed. But that is probably not feasible now as the console output is mixed with logs.

Where needed, keep additional information for failed tests (where it is now)

Note that this is related to "console output". Increasing log level is not a solution for this as logging is (or rather should be) a different mechanism with potentially routing to different files than the console output.

@martin-mat martin-mat added the enhancement New feature or request label Apr 8, 2024
@HashNuke
Copy link
Collaborator

HashNuke commented Apr 9, 2024

Yes this would help ~!

  • We can prefix it "PASSED: [test name] Hello world"
  • Or we can suffix it to the end of the message Like "PASSED: Hello world (test name)"

@HashNuke
Copy link
Collaborator

HashNuke commented Apr 9, 2024

+1 for the "Testing" line.

@martin-mat
Copy link
Collaborator Author

Yes this would help ~!

  • We can prefix it "PASSED: [test name] Hello world"
  • Or we can suffix it to the end of the message Like "PASSED: Hello world (test name)"

"PASSED: [test name] Hello world"
looks good.

kosstennbl pushed a commit to kosstennbl/cnf-testsuite that referenced this issue Apr 10, 2024
Ref: lfn-cnti#1958
Add information of which test is starting to the console output
Add test name to test result console output

Signed-off-by: Konstantin Yarovoy <konstantin.yarovoy@tietoevry.com>
kosstennbl pushed a commit to kosstennbl/cnf-testsuite that referenced this issue Apr 19, 2024
Ref: lfn-cnti#1958
Add information of which test is starting to the console output
Add test name to test result console output

Signed-off-by: Konstantin Yarovoy <konstantin.yarovoy@tietoevry.com>
kosstennbl pushed a commit to kosstennbl/cnf-testsuite that referenced this issue Apr 19, 2024
Ref: lfn-cnti#1958
Add information of which test is starting to the console output
Add test name to test result console output

Signed-off-by: Konstantin Yarovoy <konstantin.yarovoy@tietoevry.com>
kosstennbl referenced this issue in kosstennbl/cnf-testsuite Apr 23, 2024
Ref: cnti-testcatalog#1958
Add information of which test is starting to the console output
Add test name to test result console output

Signed-off-by: Konstantin Yarovoy <konstantin.yarovoy@tietoevry.com>
@lixuna lixuna moved this to In Progress in CNTI Test Catalog Apr 23, 2024
@lixuna lixuna moved this from In Progress to Peer Review in CNTI Test Catalog Apr 23, 2024
kosstennbl referenced this issue in kosstennbl/cnf-testsuite Apr 25, 2024
Ref: cnti-testcatalog#1958
Add information of which test is starting to the console output
Add test name to test result console output

Signed-off-by: Konstantin Yarovoy <konstantin.yarovoy@tietoevry.com>
kosstennbl referenced this issue in kosstennbl/cnf-testsuite Apr 27, 2024
Ref: cnti-testcatalog#1958
Add information of which test is starting to the console output
Add test name to test result console output

Signed-off-by: Konstantin Yarovoy <konstantin.yarovoy@tietoevry.com>
@github-project-automation github-project-automation bot moved this from Peer Review to Done in CNTI Test Catalog May 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants