A test file can affect a test in which it is not used.

[troizet]

Apache NetBeans version

Apache NetBeans 18

What happened

A test file can affect a test in which it is not used.

How to reproduce

• create a test file named testFailureTesting.php in the directory
  php/php.editor/test/unit/data/testfiles/completion/documentation/

• copy the contents of the test file php/php.editor/test/unit/data/testfiles/completion/documentation/arrayReturnType.php into the newly created file

• run testArrayReturnType in php/php.editor/test/unit/src/org/netbeans/modules/php/editor/completion/PHPCCDocumentationTest.java

• We will get a failed test for a reason:

Actual content contains following lines which are missing in expected content: 
	------------------------------------
	METHOD     functionName()                  [PUBLIC]   testFailureTesting.php
Expected content contains following lines which are missing in actual content: 
	METHOD     functionName()                  [PUBLIC]   arrayReturnType.php

although testFailureTesting.php has nothing to do with this test.

Did this work correctly in an earlier version?

No / Don't know

Operating System

Ubuntu 22.04.2 LTS

JDK

OpenJDK Runtime Environment 11.0.19+7-post-Ubuntu-0ubuntu122.04.1

Apache NetBeans packaging

Apache NetBeans binary zip

Anything else

It seems that the test execution indexes test files that are not related to the test being executed.

Are you willing to submit a pull request?

No

[junichi11]

Not a bug. Please use another function name.
The class path is /testfiles/completion/documentation.
Both functionName() is valid in it.