Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing tests under Linux #790

Open
mrbean-bremen opened this issue Jan 9, 2021 · 0 comments
Open

Failing tests under Linux #790

mrbean-bremen opened this issue Jan 9, 2021 · 0 comments
Labels
bug

Comments

@mrbean-bremen
Copy link
Member

mrbean-bremen commented Jan 9, 2021 •
edited
Loading

If running the CI tests under Ubuntu (not yet active), 36 tests fail. 28 of them are image comparison failures, some of the others may be errors in the tests themselves.

Here ist the relevant part of the test result output (for one of the targets, same result for other targets):

  Failed TestBoundsIndempotent [737 ms]
  Error Message:
     Expected: -2.0799999237060547d +/- 0.0099999997764825821d
  But was:  -2.1059131622314453d
  Off by:   0.025913238525390625d

  Failed TestTextBounds [1 ms]
  Error Message:
     Expected: 9.9200000762939453d +/- 0.0099999997764825821d
  But was:  10.15625d
  Off by:   -0.23624992370605469d

  Failed TestOpenWithEntities [5 ms]
  Error Message:
   System.IO.FileNotFoundException : The specified document cannot be found.
  Stack Trace:
     at Svg.SvgDocument.Open[T](String path, Dictionary`2 entities) in /home/runner/work/SVG/SVG/Source/SvgDocument.cs:line 326
   at Svg.UnitTests.EntitiesTests.TestOpenWithEntities() in /home/runner/work/SVG/SVG/Tests/Svg.UnitTests/EntitiesTests.cs:line 28
  Failed TestOpenWithoutEntities [50 ms]
  Error Message:
     Expected: <System.Xml.XmlException> and property Message containing "entity"
  But was:  <System.IO.FileNotFoundException: The specified document cannot be found.
File name: '/home/runner/work/SVG/SVG/Tests/..\Samples\Entities\sample.svg'
   at Svg.SvgDocument.Open[T](String path, Dictionary`2 entities) in /home/runner/work/SVG/SVG/Source/SvgDocument.cs:line 326
   at Svg.UnitTests.EntitiesTests.<>c__DisplayClass3_0.<TestOpenWithoutEntities>b__0() in /home/runner/work/SVG/SVG/Tests/Svg.UnitTests/EntitiesTests.cs:line 37
--- End of stack trace from previous location where exception was thrown ---
   at NUnit.Framework.Internal.ExceptionHelper.Rethrow(Exception exception) in D:\a\1\s\src\NUnitFramework\framework\Internal\ExceptionHelper.cs:line 72
   at NUnit.Framework.Internal.Reflect.DynamicInvokeWithTransparentExceptions(Delegate delegate) in D:\a\1\s\src\NUnitFramework\framework\Internal\Reflect.cs:line 438
   at NUnit.Framework.Internal.ExceptionHelper.RecordException(Delegate parameterlessDelegate, String parameterName) in D:\a\1\s\src\NUnitFramework\framework\Internal\ExceptionHelper.cs:line 227>

  Stack Trace:
     at Svg.UnitTests.EntitiesTests.TestOpenWithoutEntities() in /home/runner/work/SVG/SVG/Tests/Svg.UnitTests/EntitiesTests.cs:line 37

  Failed CompareSvgImageWithReference(TestDataSource - color-prop-02-f) [41 ms]
  Error Message:
     color-prop-02-f: Difference is 5.5419921875%

  Failed CompareSvgImageWithReference(TestDataSource - painting-marker-04-f) [59 ms]
  Error Message:
     painting-marker-04-f: Difference is 5.5908203125%

  Failed CompareSvgImageWithReference(TestDataSource - pservers-grad-02-b) [49 ms]
  Error Message:
     pservers-grad-02-b: Difference is 17.9931640625%

  Failed CompareSvgImageWithReference(TestDataSource - pservers-grad-06-b) [68 ms]
  Error Message:
     pservers-grad-06-b: Difference is 6.396484375%

  Failed CompareSvgImageWithReference(TestDataSource - pservers-grad-11-b) [49 ms]
  Error Message:
     pservers-grad-11-b: Difference is 19.0673828125%

  Failed CompareSvgImageWithReference(TestDataSource - pservers-grad-12-b) [92 ms]
  Error Message:
     pservers-grad-12-b: Difference is 17.4560546875%

  Failed CompareSvgImageWithReference(TestDataSource - pservers-grad-14-b) [101 ms]
  Error Message:
     pservers-grad-14-b: Difference is 18.115234375%

  Failed CompareSvgImageWithReference(TestDataSource - pservers-grad-15-b) [39 ms]
  Error Message:
     pservers-grad-15-b: Difference is 14.2578125%

  Failed CompareSvgImageWithReference(TestDataSource - pservers-grad-16-b) [37 ms]
  Error Message:
     pservers-grad-16-b: Difference is 14.84375%

  Failed CompareSvgImageWithReference(TestDataSource - pservers-pattern-01-b) [53 ms]
  Error Message:
     pservers-pattern-01-b: Difference is 10.9375%

  Failed CompareSvgImageWithReference(TestDataSource - styling-inherit-01-b) [42 ms]
  Error Message:
     styling-inherit-01-b: Difference is 18.1640625%

  Failed CompareSvgImageWithReference(TestDataSource - text-align-01-b) [80 ms]
  Error Message:
     text-align-01-b: Difference is 5.2001953125%

  Failed CompareSvgImageWithReference(TestDataSource - text-align-02-b) [141 ms]
  Error Message:
     text-align-02-b: Difference is 5.2734375%

  Failed CompareSvgImageWithReference(TestDataSource - text-text-08-b) [55 ms]
  Error Message:
     text-text-08-b: Difference is 18.26171875%

  Failed CompareSvgImageWithReference(TestDataSource - __issue-280-01) [25 ms]
  Error Message:
     __issue-280-01: Difference is 6.7626953125%

  Failed CompareSvgImageWithReference(TestDataSource - __issue-280-02) [27 ms]
  Error Message:
     __issue-280-02: Difference is 19.7998046875%

  Failed CompareSvgImageWithReference(TestDataSource - __issue-318-01) [24 ms]
  Error Message:
     __issue-318-01: Difference is 7.2998046875%

  Failed CompareSvgImageWithReference(TestDataSource - __issue-329-01) [20 ms]
  Error Message:
     __issue-329-01: Difference is 6.103515625%

  Failed CompareSvgImageWithReference(TestDataSource - __issue-338-01_stroke_width) [20 ms]
  Error Message:
     __issue-338-01_stroke_width: Difference is 9.423828125%

  Failed CompareSvgImageWithReference(TestDataSource - __issue-363-01) [74 ms]
  Error Message:
     __issue-363-01: Difference is 10.05859375%

  Failed CompareSvgImageWithReference(TestDataSource - __issue-385-01_Test_text-anchor-middle) [1 ms]
  Error Message:
   System.IO.FileNotFoundException : /home/runner/work/SVG/SVG/Tests/W3CTestSuite/png/__issue-385-01_Test_text-anchor-middle.png
  Stack Trace:
     at System.Drawing.Image.FromFile(String filename, Boolean useEmbeddedColorManagement)
   at Svg.UnitTests.ImageComparisonTest.CompareSvgImageWithReferenceImpl(String baseName, String svgPath, String pngPath, Boolean testSaveLoad) in /home/runner/work/SVG/SVG/Tests/Svg.UnitTests/ImageComparisonTest.cs:line 69
   at Svg.UnitTests.ImageComparisonTest.CompareSvgImageWithReference(TestData testData) in /home/runner/work/SVG/SVG/Tests/Svg.UnitTests/ImageComparisonTest.cs:line 40

  Failed CompareSvgImageWithReference(TestDataSource - __issue-419-01) [9 ms]
  Error Message:
     __issue-419-01: Difference is 6.4697265625%

  Failed CompareSvgImageWithReference(TestDataSource - __issue-626-01) [11 ms]
  Error Message:
     __issue-626-01: Difference is 24.8779296875%

  Failed CompareSvgImageWithReference(TestDataSource - __issue-747-01) [7 ms]
  Error Message:
     __issue-747-01: Difference is 50%

  Failed CompareSvgImageWithReference(TestDataSource - __issue-769-01) [7 ms]
  Error Message:
     __issue-769-01: Difference is 10.693359375%

  Failed CompareSvgImageWithReference(TestDataSource - __pull_request-414-01) [77 ms]
  Error Message:
     __pull_request-414-01: Difference is 25%

  Failed CompareSvgImageWithReference(TestDataSource - __pull_request-551-01) [7 ms]
  Error Message:
     __pull_request-551-01: Difference is 7.7880859375%

  Failed CompareSvgImageWithReference(TestDataSource - __pull_request-706-01) [8 ms]
  Error Message:
     __pull_request-706-01: Difference is 12.40234375%

  Failed TestImageIsRendered [48 ms]
  Error Message:
     Svg file size 120505 does not match expected minimum size (expected 160000).

  Failed TestMetafileRendering [11 s]
  Error Message:
   System.ArgumentException : Parameter is not valid.
  Stack Trace:
     at System.Drawing.Image.Save(Stream stream, ImageCodecInfo encoder, EncoderParameters encoderParams)
   at Svg.UnitTests.SvgTestHelper.CheckSvg(SvgDocument svgDoc, Image img) in /home/runner/work/SVG/SVG/Tests/Svg.UnitTests/SvgTestHelper.cs:line 249
   at Svg.UnitTests.SvgTestHelper.LoadSvg(XmlDocument xml) in /home/runner/work/SVG/SVG/Tests/Svg.UnitTests/SvgTestHelper.cs:line 217
   at Svg.UnitTests.MetafileRenderingTest.TestMetafileRendering() in /home/runner/work/SVG/SVG/Tests/Svg.UnitTests/MetafileRenderingTest.cs:line 26

  Failed LoadAllW3CSvg [2 ms]
  Error Message:
   System.UriFormatException : Invalid URI: The hostname could not be parsed.
  Stack Trace:
     at System.Uri.CreateThis(String uri, Boolean dontEscape, UriKind uriKind)
   at System.Uri..ctor(String uriString)
   at System.UriBuilder..ctor(String uri)
   at Svg.UnitTests.PerformanceTest.get_AssemblyDirectory() in /home/runner/work/SVG/SVG/Tests/Svg.UnitTests/PerformanceTest.cs:line 20
   at Svg.UnitTests.PerformanceTest.LoadAllW3CSvg() in /home/runner/work/SVG/SVG/Tests/Svg.UnitTests/PerformanceTest.cs:line 35

  Failed TestImageIsRendered [52 ms]
  Error Message:
     Svg file size 78954 does not match expected minimum size (expected 160000).

Total tests: 389
     Passed: 353
     Failed: 36
 Total time: 46.8489 Seconds
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@mrbean-bremen