adding pre-checks based on regex to fail the tests

[sbdtu5498]

Refactored run-all.go so that regex checks can be run without running the whole test cases, thus detecting the test failure early.

Checklist

• Commits are signed with Developer Certificate of Origin (DCO - learn more)

Fixes #4750

cc: @JorTurFer

[github-actions]

Thank you for your contribution! 🙏 We will review your PR as soon as possible.

🏖️ Over the summer, the response time will be longer than usual due to maintainers taking time off so please bear with us.

While you are waiting, make sure to:

• Add an entry in our changelog in alphabetical order and link related issue
• Update the documentation, if needed
• Add unit & e2e tests for your changes
• GitHub checks are passing
• Is the DCO check failing? Here is how you can fix DCO issues

Learn more about:

• Our contribution guide

[JorTurFer]

Nice improvement!
One question , will this work with any amount of test cases? I afraid about any limitation on env variables :/
Can't we just move the parsing code to the utils package and call it from run-all.go and run-regex.go? Doing that, we don't need to manage env variables and checking the files twice isn't a problem because it's something super fast and light. This change also would remove the requirement of setting env variables

[sbdtu5498]

Sorry for the delays @JorTurFer. I will take a look on this today and will let you know.

[JorTurFer]

Any update? We aim to cut a release next week

[JorTurFer]

Any update about this?

[zroubalik]

@sbdtu5498 any update here?

[tomkerkhove]

Closing due to inactivity for a long period, feel free to re-open if you have time to complete it anyway.