Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Perform partial test discovery with pytest in the face of other test discovery errors #14116

Closed
baiyyee opened this issue Sep 26, 2020 · 2 comments
Assignees
Labels
area-testing feature-request Request for new features or functionality

Comments

@baiyyee
Copy link

baiyyee commented Sep 26, 2020

For Example, I have 1000 pytest testcases in my project, but only one of them got error (like code defect, or logic issues, and so on...) cause testcase discorvery failed, For now, looks all testcases will not shown in Python Test Explorer List, and CodeLens adornments also not appeared within my testcase code, So It's hard for me to run or debug a normal (not the error testcase), I have to use other debuger tools like ipdb to debug my code. In this case, can we show the normal testcase and just exclude the error(s) in Python Test Explorer List? It's really hard for me if one case failures cause all testcases collect failed.

screenshots:
image

Version: 1.49.2 (user setup)
Commit: e5e9e69aed6e1984f7499b7af85b3d05f9a6883a
Date: 2020-09-24T16:29:41.983Z
Electron: 9.2.1
Chrome: 83.0.4103.122
Node.js: 12.14.1
V8: 8.3.110.13-electron.0
OS: Windows_NT x64 10.0.19041

Related Links: kondratyev-nv/vscode-python-test-adapter#179

@baiyyee baiyyee added triage-needed Needs assignment to the proper sub-team bug Issue identified by VS Code Team member as probable bug labels Sep 26, 2020
@ghost ghost removed the triage-needed Needs assignment to the proper sub-team label Sep 28, 2020
@ghost ghost added the triage-needed Needs assignment to the proper sub-team label Sep 28, 2020
@brettcannon brettcannon added area-testing needs decision feature-request Request for new features or functionality and removed triage-needed Needs assignment to the proper sub-team bug Issue identified by VS Code Team member as probable bug labels Sep 28, 2020
@brettcannon brettcannon changed the title TestCase not show in Python Test Explorer and CodeLens adornments If one of pytest testcases got error during testcase discorver process Perform partial test discovery with pytest in the face of other test discovery errors Sep 28, 2020
@brettcannon
Copy link
Member

This would require us to replicate the test discovery of pytest in order to work around pytest erroring out when there's a discovery failure. I have marked this issue as "needs decision" to make sure we have a conversation about your idea. We plan to leave this feature request open for at least a month to see how many 👍 votes the opening comment gets to help us make our decision.

@luabud luabud added needs proposal Need to make some design decisions and removed needs decision labels Nov 4, 2020
@luabud luabud self-assigned this Nov 4, 2020
@eleanorjboyd
Copy link
Member

closing as it is the same as #13301. We have issue 13301 on our schedule for this iteration so hopefully the fix is coming soon!

@github-actions github-actions bot removed the needs proposal Need to make some design decisions label Jul 7, 2023
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Aug 7, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
area-testing feature-request Request for new features or functionality
Projects
None yet
Development

No branches or pull requests

6 participants