Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

Mark test_batchnorm_with_type as flaky #19492

Merged
merged 1 commit into from
Nov 8, 2020
Merged

Mark test_batchnorm_with_type as flaky #19492

merged 1 commit into from
Nov 8, 2020

Conversation

leezu
Copy link
Contributor

@leezu leezu commented Nov 7, 2020 

[2020-11-06T21:37:09.831Z]       # V2, 1D
[2020-11-06T21:37:09.831Z]       for fix_gamma, cudnn_off in itertools.product(bools, bools):
[2020-11-06T21:37:09.831Z]           sym = mx.sym.BatchNorm(name='norm', fix_gamma=fix_gamma, cudnn_off=cudnn_off)
[2020-11-06T21:37:09.831Z] >         check_consistency(sym, ctx_list_v2_1D)
[...]
[2020-11-06T21:37:09.831Z] E       AssertionError: 
[2020-11-06T21:37:09.831Z] E       Items are not equal:
[2020-11-06T21:37:09.831Z] E       Error 8317.657381 exceeds tolerance rtol=1.000000e-05, atol=1.000000e-20 (mismatch 50.000000%).
[2020-11-06T21:37:09.831Z] E       Location of maximum error: (0,), a=-0.00000000, b=-0.00000000
[2020-11-06T21:37:09.831Z] E        ACTUAL: array([ -0.        , -39.62720511])
[2020-11-06T21:37:09.831Z] E        DESIRED: array([ -0.        , -39.62720511])

@leezu
Mark test_batchnorm_with_type as flaky
de34332 
[2020-11-06T21:37:09.831Z]       # V2, 1D
[2020-11-06T21:37:09.831Z]       for fix_gamma, cudnn_off in itertools.product(bools, bools):
[2020-11-06T21:37:09.831Z]           sym = mx.sym.BatchNorm(name='norm', fix_gamma=fix_gamma, cudnn_off=cudnn_off)
[2020-11-06T21:37:09.831Z] >         check_consistency(sym, ctx_list_v2_1D)
[...]
[2020-11-06T21:37:09.831Z] E       AssertionError: 
[2020-11-06T21:37:09.831Z] E       Items are not equal:
[2020-11-06T21:37:09.831Z] E       Error 8317.657381 exceeds tolerance rtol=1.000000e-05, atol=1.000000e-20 (mismatch 50.000000%).
[2020-11-06T21:37:09.831Z] E       Location of maximum error: (0,), a=-0.00000000, b=-0.00000000
[2020-11-06T21:37:09.831Z] E        ACTUAL: array([ -0.        , -39.62720511])
[2020-11-06T21:37:09.831Z] E        DESIRED: array([ -0.        , -39.62720511])
@mxnet-bot
Copy link

Hey @leezu , Thanks for submitting the PR
All tests are already queued to run once. If tests fail, you can trigger one or more tests again with the following commands:

  • To trigger all jobs: @mxnet-bot run ci [all]
  • To trigger specific jobs: @mxnet-bot run ci [job1, job2]

CI supported jobs: [centos-cpu, windows-cpu, unix-gpu, website, unix-cpu, windows-gpu, edge, sanity, clang, miscellaneous, centos-gpu]

Note:
Only following 3 categories can trigger CI :PR Author, MXNet Committer, Jenkins Admin.
All CI tests must pass before the PR can be merged.

@lanking520 lanking520 added pr-awaiting-testing PR is reviewed and waiting CI build and test pr-awaiting-review PR is waiting for code review and removed pr-awaiting-testing PR is reviewed and waiting CI build and test labels Nov 7, 2020
@leezu
Copy link
Contributor Author

leezu commented Nov 8, 2020

@mxnet-bot run ci [centos-gpu]

@mxnet-bot
Copy link

Jenkins CI successfully triggered : [centos-gpu]

@lanking520 lanking520 added pr-awaiting-testing PR is reviewed and waiting CI build and test pr-awaiting-review PR is waiting for code review and removed pr-awaiting-review PR is waiting for code review pr-awaiting-testing PR is reviewed and waiting CI build and test labels Nov 8, 2020
@leezu leezu merged commit 545e117 into master Nov 8, 2020
@leezu leezu deleted the leezu-patch-3 branch November 8, 2020 02:30
vidyaravipati pushed a commit to vidyaravipati/incubator-mxnet that referenced this pull request Nov 11, 2020
@leezu
Mark test_batchnorm_with_type as flaky (apache#19492)
4d1ab2f 
[2020-11-06T21:37:09.831Z]       # V2, 1D
[2020-11-06T21:37:09.831Z]       for fix_gamma, cudnn_off in itertools.product(bools, bools):
[2020-11-06T21:37:09.831Z]           sym = mx.sym.BatchNorm(name='norm', fix_gamma=fix_gamma, cudnn_off=cudnn_off)
[2020-11-06T21:37:09.831Z] >         check_consistency(sym, ctx_list_v2_1D)
[...]
[2020-11-06T21:37:09.831Z] E       AssertionError: 
[2020-11-06T21:37:09.831Z] E       Items are not equal:
[2020-11-06T21:37:09.831Z] E       Error 8317.657381 exceeds tolerance rtol=1.000000e-05, atol=1.000000e-20 (mismatch 50.000000%).
[2020-11-06T21:37:09.831Z] E       Location of maximum error: (0,), a=-0.00000000, b=-0.00000000
[2020-11-06T21:37:09.831Z] E        ACTUAL: array([ -0.        , -39.62720511])
[2020-11-06T21:37:09.831Z] E        DESIRED: array([ -0.        , -39.62720511])
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers
No reviews
Assignees
No one assigned
Labels
pr-awaiting-review PR is waiting for code review
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@leezu @mxnet-bot @lanking520