Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clean up indicated checks #975

Open
mickmis opened this issue Feb 27, 2025 · 0 comments
Open

Clean up indicated checks #975

mickmis opened this issue Feb 27, 2025 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@mickmis
Copy link
Contributor

mickmis commented Feb 27, 2025

As reported by @BenjaminPelletier on 2025-02-12:

Test documentation should not indicate that a check may be performed in a test step if that check will never be performed in that test step. So, it's ok (for instance) for there to be a lot of gray checks for NET0730 because notifications could be performed in any of those steps, it's just that there were no notifications to deliver because there were no entities to delete in the nominal case. But, it seems like the "Slow updates flight" test case of the "ASTM NetRID Service Provider operator notification under slow update rate" test scenario documents that it will perform many checks that it does not actually perform -- for instance, it seems like the gray checks in NET0710,1 should not be conditional so they should either be performed or else not documented as part of the scenario. There is also a lot of gray for DSS0030,a. It's ok to remove a lot of documented checks -- we don't need to check everything we possibly could at every possible opportunity. But, when a regulator asks why a particular check wasn't performed in a given test run, we should be prepared to give a good answer (as above in the NET0730 case).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants