New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Monitoring for tests with precondition failures, harness errors, or other problems with the tests #659

Open

foolip opened this issue May 2, 2024 · 1 comment

Member

foolip commented May 2, 2024

In #319 there was a problem with "PRECONDITION_FAILED" in some WebCodecs tests.

I think the conclusion is that we can't have tests like these in Interop, because there's no good way to score them.

We should have a system for finding such tests and periodically review it. It could be as simple as a (very long) wpt.fyi query.

Member Author

foolip commented May 2, 2024

Something like https://wpt.fyi/results/?label=master&label=experimental&aligned&view=interop&q=label%3Ainterop-2024-indexeddb%20status%3Aerror is a small subset of such a query, currently reveling a harness error in Chrome.

nairnandu mentioned this issue

Agenda for May 2nd, 2024 #658

Closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment