example/gmres: Switch scalar to bhalf_t #1300

e10harvey · 2022-02-02T18:00:53Z

Most of the diff in this PR is due to running clang-format. I only changed the ST typedefs from double to bhalf and added the fabs wrappers for bhalf.

I used cuda 11.2.0 for these tests with the .mtx files that are hard coded in these gmres example files.

Note that bhalf falls back to float prior to cuda 11 since bhalf support was first added in cuda 11.

Real numbers - Convergence with double

$ ./gmres_ex_real_A.d
<snip>
True relative residual for iteration 2271 is : 9.90513e-11
Ending relative residual is: 9.90513e-11
Solver converged! 
The solver completed 2272 iterations.
=========================================
Verify from main: Ending residual is 9.90513e-11
Number of iterations is: 2272
Diff of residual from main - residual from solver: 0
Convergence flag is : Converged

Real numbers - Convergence with bhalf

$ ./gmres_ex_real_A
<snip>
True relative residual for iteration 2264 is : 9.98052e-11
Ending relative residual is: 9.98052e-11
Solver converged! 
The solver completed 2265 iterations.
=========================================
Verify from main: Ending residual is 9.98052e-11
Number of iterations is: 2265
Diff of residual from main - residual from solver: 0
Convergence flag is : Converged

Complex numbers - Convergence with double

$ ./gmres_test_cmplx_A.d
<snip>
True relative residual for iteration 505 is : 9.894e-06
Ending relative residual is: 9.894e-06
Solver converged! 
The solver completed 506 iterations.
=======================================
Verify from main: Ending residual is 9.894e-06
Number of iterations is: 506
Diff of residual from main - residual from solver: 0
Convergence flag is : Converged
Solver did not converge within the expected number of iterations. 
MGS Test Failed.
=======================================


One or more tests has failed.

Complex numbers - Convergence with bhalf

$ ./gmres_test_cmplx_A
<snip>
True relative residual for iteration 505 is : 9.894e-06
Ending relative residual is: 9.894e-06
Solver converged! 
The solver completed 506 iterations.
=======================================
Verify from main: Ending residual is 9.894e-06
Number of iterations is: 506
Diff of residual from main - residual from solver: 0
Convergence flag is : Converged
Solver did not converge within the expected number of iterations. 
MGS Test Failed.
=======================================


One or more tests has failed.

Fixes #1250.

kokkos-devops-admin · 2022-02-02T18:34:29Z

Status Flag 'Pre-Test Inspection' - Auto Inspected - Inspection Is Not Necessary for this Pull Request.

kokkos-devops-admin · 2022-02-02T18:38:21Z

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_CUDA9_Tpls_CUDA10_Tpls_CUDA10_LayoutRight_GCC720_Light_GCC720_GCC740

Build Num: 36
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`9ae5c4f`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC720

Build Num: 807
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`9ae5c4f`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC720_Light_LayoutRight

Build Num: 454
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`9ae5c4f`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC720

Build Num: 798
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`9ae5c4f`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL18

Build Num: 786
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`9ae5c4f`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

Build Num: 191
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`9ae5c4f`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Using Repos:

Repo: KOKKOSKERNELS (e10harvey/kokkos-kernels)

Pull Request Author: e10harvey

kokkos-devops-admin · 2022-02-02T19:11:23Z

Status Flag 'Pull Request AutoTester' - Jenkins Testing: 1 or more Jobs FAILED

Note: Testing will normally be attempted again in approx. 2 Hrs 30 Mins. If a change to the PR source branch occurs, the testing will be attempted again on next available autotester run.

Pull Request Auto Testing has FAILED (click to expand)

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_CUDA9_Tpls_CUDA10_Tpls_CUDA10_LayoutRight_GCC720_Light_GCC720_GCC740

Build Num: 36
Status: FAILED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`9ae5c4f`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC720

Build Num: 807
Status: FAILED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`9ae5c4f`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC720_Light_LayoutRight

Build Num: 454
Status: FAILED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`9ae5c4f`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC720

Build Num: 798
Status: FAILED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`9ae5c4f`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL18

Build Num: 786
Status: FAILED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`9ae5c4f`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

Build Num: 191
Status: FAILED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`9ae5c4f`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Console Output (last 100 lines) : KokkosKernels_PullRequest_Tpls_CUDA9_Tpls_CUDA10_Tpls_CUDA10_LayoutRight_GCC720_Light_GCC720_GCC740 # 36 (click to expand)


Shortcut relative residual for iteration 753 is: 1.02194e-09
Shortcut relative residual for iteration 754 is: 4.33242e-10
Shortcut relative residual for iteration 755 is: 1.86074e-10
Shortcut relative residual for iteration 756 is: 8.00205e-11
True relative residual for iteration 756 is : 4.22311e-08
Shortcut relative residual for iteration 757 is: 3.55923e-11
True relative residual for iteration 757 is : 4.22311e-08
Shortcut relative residual for iteration 758 is: 1.59747e-11
True relative residual for iteration 758 is : 4.22311e-08
Shortcut relative residual for iteration 759 is: 7.32679e-12
True relative residual for iteration 759 is : 4.22311e-08
Shortcut relative residual for iteration 760 is: 3.53092e-12
True relative residual for iteration 760 is : 4.22311e-08
Shortcut relative residual for iteration 761 is: 1.72805e-12
True relative residual for iteration 761 is : 4.22311e-08
Shortcut relative residual for iteration 762 is: 8.47534e-13
True relative residual for iteration 762 is : 4.22311e-08
Shortcut relative residual for iteration 763 is: 4.15979e-13
True relative residual for iteration 763 is : 4.22311e-08
Shortcut relative residual for iteration 764 is: 1.9909e-13
True relative residual for iteration 764 is : 4.22311e-08
Ending relative residual is: 4.22311e-08
Shortcut residual converged, but solver experienced a loss of accuracy.
The solver completed 765 iterations.
=======================================
Verify from main: Ending residual is 4.22311e-08
Number of iterations is: 765
Diff of residual from main - residual from solver: 4.33706e-16
Convergence flag is : Solver has had loss of accuracy.
Solver did not converge within the expected number of iterations. 
MGS Test Failed.
=======================================
One or more tests has failed.
test 23

Start 23: gmres_test_prec
23: Test command: /home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_Tpls_CUDA10_Tpls_CUDA10_LayoutRight_GCC720_Light_GCC720_GCC740/KokkosKernels_PullRequest_Tpls_CUDA9_Tpls_CUDA10_Tpls_CUDA10_LayoutRight_GCC720_Light_GCC720_GCC740.36/TestAll_2022-02-02_11.36.47/cuda/9.2.88/Cuda_OpenMP-release/example/gmres/KokkosKernels_gmres_test_prec

23: Test timeout computed to be: 2500

23: Convergence tolerance is: 1e-10

23:

23: Kokkos::Cuda::initialize WARNING: Cuda is allocating into UVMSpace by default

23:                                   without setting CUDA_MANAGED_FORCE_DEVICE_ALLOC=1 or

23:                                   setting CUDA_VISIBLE_DEVICES.

23:                                   This could on multi GPU systems lead to severe performance"

23:                                   penalties.

23: Convergence tolerance is: 1e-10

23: Initial relative residual is: 332.144

23: Shortcut relative residual for iteration 0 is: 2.64818e-14

23: True relative residual for iteration 0 is : 3.48957e-14

23: Ending relative residual is: 3.48957e-14

23: Solver converged!

23: The solver completed 1 iterations.

23: =========================================

23: Verify from main: Ending residual is 3.48957e-14

23: Number of iterations is: 1

23: Diff of residual from main - residual from solver: 0

23: Convergence flag is : Converged

23: Test passed!

23/23 Test #23: gmres_test_prec ..................   Passed    0.36 sec
96% tests passed, 1 tests failed out of 23
Total Test time (real) = 383.12 sec
The following tests FAILED:

22 - gmres_test_real_A (Failed)

Errors while running CTest

#######################################################

PASSED TESTS

#######################################################

#######################################################

FAILED TESTS

#######################################################

cuda-9.2.88-Cuda_OpenMP-release (test failed)

#######################################################
Reproducer instructions:
Load modules:
    source /etc/profile.d/modules.sh
    module purge
    module load cmake/3.19.3 cuda/9.2.88 gcc/7.2.0 netlib/3.8.0/gcc/7.2.0

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=Cuda,OpenMP --arch=Power9,Volta70 --compiler=/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_Tpls_CUDA10_Tpls_CUDA10_LayoutRight_GCC720_Light_GCC720_GCC740/kokkos/bin/nvcc_wrapper --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wuninitialized " --cxxstandard="14" --ldflags="" --with-cuda=/home/projects/ppc64le-pwr9-nvidia/cuda/9.2.88  --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutLeft --with-tpls=blas,cublas,cusparse --user-blas-path=/home/projects/ppc64le-pwr9/netlib/3.8.0/gcc/7.2.0/lib --user-lapack-path=/home/projects/ppc64le-pwr9/netlib/3.8.0/gcc/7.2.0/lib --user-blas-lib=blas --user-lapack-lib=lapack --extra-linker-flags=-lgfortran,-lm --with-options= --with-cuda-options=force_uvm,enable_lambda   --no-examples
To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:
  # Move to the build directory
    cd /home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_Tpls_CUDA10_Tpls_CUDA10_LayoutRight_GCC720_Light_GCC720_GCC740/KokkosKernels_PullRequest_Tpls_CUDA9_Tpls_CUDA10_Tpls_CUDA10_LayoutRight_GCC720_Light_GCC720_GCC740.36/TestAll_2022-02-02_11.36.47/cuda/9.2.88/Cuda_OpenMP-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################

Build step 'Execute shell' marked build as failure

Finished: FAILURE

Console Output (last 100 lines) : KokkosKernels_PullRequest_GCC720 # 807 (click to expand)


Shortcut relative residual for iteration 763 is: 2.73793e-13
True relative residual for iteration 763 is : 2.87712e-08
Shortcut relative residual for iteration 764 is: 1.35385e-13
True relative residual for iteration 764 is : 2.87712e-08
Ending relative residual is: 2.87712e-08
Shortcut residual converged, but solver experienced a loss of accuracy.
The solver completed 765 iterations.
=======================================
Verify from main: Ending residual is 2.87712e-08
Number of iterations is: 765
Diff of residual from main - residual from solver: 8.24361e-16
Convergence flag is : Solver has had loss of accuracy.
Solver did not converge within the expected number of iterations. 
MGS Test Failed.
=======================================
One or more tests has failed.
test 17

Start 17: gmres_test_prec
17: Test command: /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.807/TestAll_2022-02-02_11.37.48/gcc/7.2.0/OpenMP-release/example/gmres/KokkosKernels_gmres_test_prec

17: Test timeout computed to be: 2500

17: Convergence tolerance is: 1e-10

17: Convergence tolerance is: 1e-10

17: Initial relative residual is: 332.144

17: Shortcut relative residual for iteration 0 is: 2.64818e-14

17: True relative residual for iteration 0 is : 3.48957e-14

17: Ending relative residual is: 3.48957e-14

17: Solver converged!

17: The solver completed 1 iterations.

17: =========================================

17: Verify from main: Ending residual is 3.48957e-14

17: Number of iterations is: 1

17: Diff of residual from main - residual from solver: 0

17: Convergence flag is : Converged

17: Test passed!

17/17 Test #17: gmres_test_prec ..................   Passed    0.09 sec
94% tests passed, 1 tests failed out of 17
Total Test time (real) =  62.22 sec
The following tests FAILED:

16 - gmres_test_real_A (Failed)

Errors while running CTest

#######################################################

PASSED TESTS

#######################################################

#######################################################

FAILED TESTS

#######################################################

gcc-7.2.0-OpenMP-release (test failed)

#######################################################
Reproducer instructions:
Load modules:
    source /etc/profile.d/modules.sh
    module purge
    module load cmake/3.19.3 gcc/7.2.0

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=OpenMP --arch=SKX --compiler=/home/projects/x86-64/gcc/7.2.0/bin/g++ --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wignored-qualifiers -Wempty-body -Wclobbered -Wuninitialized " --cxxstandard="14" --ldflags=""   --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutLeft --with-tpls=    --with-options= --with-cuda-options=   --no-examples
To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:
  # Move to the build directory
    cd /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.807/TestAll_2022-02-02_11.37.48/gcc/7.2.0/OpenMP-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################

gcc-7.2.0-Pthread_Serial-release (test failed)

#######################################################
Reproducer instructions:
Load modules:
    source /etc/profile.d/modules.sh
    module purge
    module load cmake/3.19.3 gcc/7.2.0

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=Pthread,Serial --arch=SKX --compiler=/home/projects/x86-64/gcc/7.2.0/bin/g++ --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wignored-qualifiers -Wempty-body -Wclobbered -Wuninitialized " --cxxstandard="14" --ldflags=""   --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutLeft --with-tpls=    --with-options= --with-cuda-options=   --no-examples
To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:
  # Move to the build directory
    cd /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.807/TestAll_2022-02-02_11.37.48/gcc/7.2.0/Pthread_Serial-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################

salloc: Relinquishing job allocation 1015931

Build step 'Execute shell' marked build as failure

Finished: FAILURE

Console Output (last 100 lines) : KokkosKernels_PullRequest_GCC720_Light_LayoutRight # 454 (click to expand)


Shortcut relative residual for iteration 763 is: 2.73793e-13
True relative residual for iteration 763 is : 2.87712e-08
Shortcut relative residual for iteration 764 is: 1.35385e-13
True relative residual for iteration 764 is : 2.87712e-08
Ending relative residual is: 2.87712e-08
Shortcut residual converged, but solver experienced a loss of accuracy.
The solver completed 765 iterations.
=======================================
Verify from main: Ending residual is 2.87712e-08
Number of iterations is: 765
Diff of residual from main - residual from solver: 8.24361e-16
Convergence flag is : Solver has had loss of accuracy.
Solver did not converge within the expected number of iterations. 
MGS Test Failed.
=======================================
One or more tests has failed.
test 17

Start 17: gmres_test_prec
17: Test command: /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/KokkosKernels_PullRequest_GCC720_Light_LayoutRight.454/TestAll_2022-02-02_11.37.56/gcc/7.2.0/OpenMP-release/example/gmres/KokkosKernels_gmres_test_prec

17: Test timeout computed to be: 2500

17: Convergence tolerance is: 1e-10

17: Convergence tolerance is: 1e-10

17: Initial relative residual is: 332.144

17: Shortcut relative residual for iteration 0 is: 2.64818e-14

17: True relative residual for iteration 0 is : 3.48957e-14

17: Ending relative residual is: 3.48957e-14

17: Solver converged!

17: The solver completed 1 iterations.

17: =========================================

17: Verify from main: Ending residual is 3.48957e-14

17: Number of iterations is: 1

17: Diff of residual from main - residual from solver: 0

17: Convergence flag is : Converged

17: Test passed!

17/17 Test #17: gmres_test_prec ..................   Passed    0.01 sec
94% tests passed, 1 tests failed out of 17
Total Test time (real) =  60.09 sec
The following tests FAILED:

16 - gmres_test_real_A (Failed)

Errors while running CTest

#######################################################

PASSED TESTS

#######################################################

#######################################################

FAILED TESTS

#######################################################

gcc-7.2.0-OpenMP-release (test failed)

#######################################################
Reproducer instructions:
Load modules:
    source /etc/profile.d/modules.sh
    module purge
    module load cmake/3.19.3 gcc/7.2.0

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=OpenMP --arch=SKX --compiler=/home/projects/x86-64/gcc/7.2.0/bin/g++ --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wignored-qualifiers -Wempty-body -Wclobbered -Wuninitialized " --cxxstandard="14" --ldflags=""   --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutRight --with-tpls=    --with-options= --with-cuda-options=  --with-spaces=hostspace --no-examples  --no-default-eti
To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:
  # Move to the build directory
    cd /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/KokkosKernels_PullRequest_GCC720_Light_LayoutRight.454/TestAll_2022-02-02_11.37.56/gcc/7.2.0/OpenMP-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################

gcc-7.2.0-Pthread_Serial-release (test failed)

#######################################################
Reproducer instructions:
Load modules:
    source /etc/profile.d/modules.sh
    module purge
    module load cmake/3.19.3 gcc/7.2.0

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=Pthread,Serial --arch=SKX --compiler=/home/projects/x86-64/gcc/7.2.0/bin/g++ --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wignored-qualifiers -Wempty-body -Wclobbered -Wuninitialized " --cxxstandard="14" --ldflags=""   --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutRight --with-tpls=    --with-options= --with-cuda-options=  --with-spaces=hostspace --no-examples  --no-default-eti
To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:
  # Move to the build directory
    cd /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/KokkosKernels_PullRequest_GCC720_Light_LayoutRight.454/TestAll_2022-02-02_11.37.56/gcc/7.2.0/Pthread_Serial-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################

salloc: Relinquishing job allocation 1015932

Build step 'Execute shell' marked build as failure

Finished: FAILURE

Console Output (last 100 lines) : KokkosKernels_PullRequest_Tpls_GCC720 # 798 (click to expand)


True relative residual for iteration 749 is : 3.99573e-08
Shortcut relative residual for iteration 750 is: 1.38793e-08
Shortcut relative residual for iteration 751 is: 5.49963e-09
Shortcut relative residual for iteration 752 is: 2.24451e-09
Shortcut relative residual for iteration 753 is: 9.27248e-10
Shortcut relative residual for iteration 754 is: 3.83461e-10
Shortcut relative residual for iteration 755 is: 1.61819e-10
Shortcut relative residual for iteration 756 is: 6.98777e-11
True relative residual for iteration 756 is : 3.92577e-08
Shortcut relative residual for iteration 757 is: 3.07985e-11
True relative residual for iteration 757 is : 3.92215e-08
Shortcut relative residual for iteration 758 is: 1.37935e-11
True relative residual for iteration 758 is : 3.92215e-08
Shortcut relative residual for iteration 759 is: 6.29154e-12
True relative residual for iteration 759 is : 3.92577e-08
Shortcut relative residual for iteration 760 is: 2.84093e-12
True relative residual for iteration 760 is : 3.92577e-08
Shortcut relative residual for iteration 761 is: 1.34741e-12
True relative residual for iteration 761 is : 3.92577e-08
Shortcut relative residual for iteration 762 is: 6.42858e-13
True relative residual for iteration 762 is : 3.92577e-08
Shortcut relative residual for iteration 763 is: 3.0956e-13
True relative residual for iteration 763 is : 3.92577e-08
Shortcut relative residual for iteration 764 is: 1.50743e-13
True relative residual for iteration 764 is : 3.92577e-08
Ending relative residual is: 3.92577e-08
Shortcut residual converged, but solver experienced a loss of accuracy.
The solver completed 765 iterations.
=======================================
Verify from main: Ending residual is 3.92577e-08
Number of iterations is: 765
Diff of residual from main - residual from solver: -2.83228e-16
Convergence flag is : Solver has had loss of accuracy.
Solver did not converge within the expected number of iterations. 
MGS Test Failed.
=======================================
One or more tests has failed.
test 23

Start 23: gmres_test_prec
23: Test command: /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_GCC720/KokkosKernels_PullRequest_Tpls_GCC720.798/TestAll_2022-02-02_11.38.06/gcc/7.2.0/OpenMP_Serial-release/example/gmres/KokkosKernels_gmres_test_prec

23: Test timeout computed to be: 2500

23: Convergence tolerance is: 1e-10

23: Convergence tolerance is: 1e-10

23: Initial relative residual is: 332.144

23: Shortcut relative residual for iteration 0 is: 2.64818e-14

23: True relative residual for iteration 0 is : 3.48957e-14

23: Ending relative residual is: 3.48957e-14

23: Solver converged!

23: The solver completed 1 iterations.

23: =========================================

23: Verify from main: Ending residual is 3.48957e-14

23: Number of iterations is: 1

23: Diff of residual from main - residual from solver: 0

23: Convergence flag is : Converged

23: Test passed!

23/23 Test #23: gmres_test_prec ..................   Passed    0.02 sec
96% tests passed, 1 tests failed out of 23
Total Test time (real) = 128.17 sec
The following tests FAILED:

22 - gmres_test_real_A (Failed)

Errors while running CTest

#######################################################

PASSED TESTS

#######################################################

#######################################################

FAILED TESTS

#######################################################

gcc-7.2.0-OpenMP_Serial-release (test failed)

#######################################################
Reproducer instructions:
Load modules:
    source /etc/profile.d/modules.sh
    module purge
    module load cmake/3.19.3 gcc/7.2.0 openblas/0.2.20/gcc/7.2.0

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=OpenMP,Serial --arch=SKX --compiler=/home/projects/x86-64/gcc/7.2.0/bin/g++ --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wignored-qualifiers -Wempty-body -Wclobbered -Wuninitialized " --cxxstandard="14" --ldflags=""   --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutLeft --with-tpls=blas --user-blas-path=/home/projects/x86-64-skylake/openblas/0.2.20/gcc/7.2.0/lib --user-lapack-path=/home/projects/x86-64-skylake/openblas/0.2.20/gcc/7.2.0/lib --user-blas-lib=blas --user-lapack-lib=lapack --extra-linker-flags=-lgfortran,-lm --with-options= --with-cuda-options=   --no-examples
To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:
  # Move to the build directory
    cd /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_GCC720/KokkosKernels_PullRequest_Tpls_GCC720.798/TestAll_2022-02-02_11.38.06/gcc/7.2.0/OpenMP_Serial-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################

salloc: Relinquishing job allocation 1015933

salloc: Job allocation 1015933 has been revoked.

Build step 'Execute shell' marked build as failure

Finished: FAILURE

Console Output (last 100 lines) : KokkosKernels_PullRequest_Tpls_INTEL18 # 786 (click to expand)


True relative residual for iteration 763 is : 3.95642e-08
Shortcut relative residual for iteration 764 is: 1.81445e-13
True relative residual for iteration 764 is : 3.95642e-08
Ending relative residual is: 3.95642e-08
Shortcut residual converged, but solver experienced a loss of accuracy.
The solver completed 765 iterations.
=======================================
Verify from main: Ending residual is 3.95642e-08
Number of iterations is: 765
Diff of residual from main - residual from solver: -9.76594e-16
Convergence flag is : Solver has had loss of accuracy.
Solver did not converge within the expected number of iterations. 
MGS Test Failed.
=======================================
One or more tests has failed.
test 17

Start 17: gmres_test_prec
17: Test command: /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/KokkosKernels_PullRequest_Tpls_INTEL18.786/TestAll_2022-02-02_11.38.17/intel/18.1.163/Pthread-release/example/gmres/KokkosKernels_gmres_test_prec

17: Test timeout computed to be: 2500

17: Convergence tolerance is: 1e-10

17: Convergence tolerance is: 1e-10

17: Initial relative residual is: 335.08

17: Shortcut relative residual for iteration 0 is: 2.62642e-14

17: True relative residual for iteration 0 is : 4.25123e-14

17: Ending relative residual is: 4.25123e-14

17: Solver converged!

17: The solver completed 1 iterations.

17: =========================================

17: Verify from main: Ending residual is 4.25123e-14

17: Number of iterations is: 1

17: Diff of residual from main - residual from solver: 0

17: Convergence flag is : Converged

17: Test passed!

17/17 Test #17: gmres_test_prec ..................   Passed    0.04 sec
94% tests passed, 1 tests failed out of 17
Total Test time (real) =  69.50 sec
The following tests FAILED:

16 - gmres_test_real_A (Failed)

Errors while running CTest

#######################################################

PASSED TESTS

#######################################################

#######################################################

FAILED TESTS

#######################################################

intel-18.1.163-OpenMP-release (test failed)

#######################################################
Reproducer instructions:
Load modules:
    source /etc/profile.d/modules.sh
    module purge
    module load cmake/3.19.3 intel/compilers/18.1.163

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=OpenMP --arch=SKX --compiler=/home/projects/x86-64/intel/compilers/2018/compilers_and_libraries_2018.1.163/linux/bin/intel64/icpc --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wuninitialized " --cxxstandard="14" --ldflags=""   --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutLeft --with-tpls=mkl    --with-options= --with-cuda-options=   --no-examples
To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:
  # Move to the build directory
    cd /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/KokkosKernels_PullRequest_Tpls_INTEL18.786/TestAll_2022-02-02_11.38.17/intel/18.1.163/OpenMP-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################

intel-18.1.163-Pthread-release (test failed)

#######################################################
Reproducer instructions:
Load modules:
    source /etc/profile.d/modules.sh
    module purge
    module load cmake/3.19.3 intel/compilers/18.1.163

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=Pthread --arch=SKX --compiler=/home/projects/x86-64/intel/compilers/2018/compilers_and_libraries_2018.1.163/linux/bin/intel64/icpc --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wuninitialized " --cxxstandard="14" --ldflags=""   --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutLeft --with-tpls=mkl    --with-options= --with-cuda-options=   --no-examples
To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:
  # Move to the build directory
    cd /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/KokkosKernels_PullRequest_Tpls_INTEL18.786/TestAll_2022-02-02_11.38.17/intel/18.1.163/Pthread-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################

salloc: Relinquishing job allocation 1015934

salloc: Job allocation 1015934 has been revoked.

Build step 'Execute shell' marked build as failure

Finished: FAILURE

Console Output (last 100 lines) : KokkosKernels_PullRequest_CLANG1001 # 191 (click to expand)


Shortcut relative residual for iteration 749 is: 1.26694e-13
True relative residual for iteration 749 is : 3.18425e-08
Shortcut relative residual for iteration 750 is: 1.13372e-08
Shortcut relative residual for iteration 751 is: 4.69717e-09
Shortcut relative residual for iteration 752 is: 1.94096e-09
Shortcut relative residual for iteration 753 is: 7.92618e-10
Shortcut relative residual for iteration 754 is: 3.33254e-10
Shortcut relative residual for iteration 755 is: 1.41904e-10
Shortcut relative residual for iteration 756 is: 6.21592e-11
True relative residual for iteration 756 is : 3.14496e-08
Shortcut relative residual for iteration 757 is: 2.83456e-11
True relative residual for iteration 757 is : 3.14496e-08
Shortcut relative residual for iteration 758 is: 1.30951e-11
True relative residual for iteration 758 is : 3.14496e-08
Shortcut relative residual for iteration 759 is: 6.18562e-12
True relative residual for iteration 759 is : 3.14496e-08
Shortcut relative residual for iteration 760 is: 2.89328e-12
True relative residual for iteration 760 is : 3.14496e-08
Shortcut relative residual for iteration 761 is: 1.32325e-12
True relative residual for iteration 761 is : 3.14496e-08
Shortcut relative residual for iteration 762 is: 6.23888e-13
True relative residual for iteration 762 is : 3.14496e-08
Shortcut relative residual for iteration 763 is: 2.92427e-13
True relative residual for iteration 763 is : 3.14496e-08
Shortcut relative residual for iteration 764 is: 1.40982e-13
True relative residual for iteration 764 is : 3.14496e-08
Ending relative residual is: 3.14496e-08
Shortcut residual converged, but solver experienced a loss of accuracy.
The solver completed 765 iterations.
=======================================
Verify from main: Ending residual is 3.14496e-08
Number of iterations is: 765
Diff of residual from main - residual from solver: -1.0904e-15
Convergence flag is : Solver has had loss of accuracy.
Solver did not converge within the expected number of iterations. 
MGS Test Failed.
=======================================
One or more tests has failed.
test 23

Start 23: gmres_test_prec
23: Test command: /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.191/TestAll_2022-02-02_11.38.26/clang/10.0.1/Pthread_Serial-release/example/gmres/KokkosKernels_gmres_test_prec

23: Test timeout computed to be: 2500

23: Convergence tolerance is: 1e-10

23: Convergence tolerance is: 1e-10

23: Initial relative residual is: 335.08

23: Shortcut relative residual for iteration 0 is: 3.10431e-14

23: True relative residual for iteration 0 is : 3.19821e-14

23: Ending relative residual is: 3.19821e-14

23: Solver converged!

23: The solver completed 1 iterations.

23: =========================================

23: Verify from main: Ending residual is 3.19821e-14

23: Number of iterations is: 1

23: Diff of residual from main - residual from solver: 0

23: Convergence flag is : Converged

23: Test passed!

23/23 Test #23: gmres_test_prec ..................   Passed    0.01 sec
96% tests passed, 1 tests failed out of 23
Total Test time (real) = 148.31 sec
The following tests FAILED:

22 - gmres_test_real_A (Failed)

Errors while running CTest

#######################################################

PASSED TESTS

#######################################################

#######################################################

FAILED TESTS

#######################################################

clang-10.0.1-Pthread_Serial-release (test failed)

#######################################################
Reproducer instructions:
Load modules:
    source /etc/profile.d/modules.sh
    module purge
    module load cmake/3.19.3 clang/10.0.1

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=Pthread,Serial --arch=SKX --compiler=/home/projects/x86-64/spack/opt/spack/linux-rhel7-x86_64/gcc-10.2.0/llvm-10.0.1-nldepabrxk2zcykcq7rlky5sr53hnm63/bin/clang++ --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wuninitialized " --cxxstandard="14" --ldflags=""   --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutLeft --with-tpls=    --with-options= --with-cuda-options=   --no-examples
To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:
  # Move to the build directory
    cd /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.191/TestAll_2022-02-02_11.38.26/clang/10.0.1/Pthread_Serial-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################

salloc: Relinquishing job allocation 1015935

Build step 'Execute shell' marked build as failure

Finished: FAILURE

jennloe · 2022-02-02T19:51:51Z

This is interesting! I am surprised at such good initial results from bfloat16.
I don't understand why the MGS test is saying it failed... those numbers look fine.

I will look this over in more detail.

jennloe

Triple-checking: bhalf = bfloat16, yes?
What system did you run this on? I checked the double precision numbers on Vortex with both CUDA 11.2.0 and CUDA 10.2.89. In both cases, the test_complex with ST=double converges in 652 iterations. I am wondering why your run converges in 506? That seems like too much of a change for simple rounding errors.
Can we add some sort of option to those example files so that the user can pick a scalar type? I don't really want the double versions to be overwritten with bhalf.

Beyond that, everything looks great! :)

e10harvey · 2022-02-03T20:30:13Z

Triple-checking: bhalf = bfloat16, yes?

Yes.

What system did you run this on? I checked the double precision numbers on Vortex with both CUDA 11.2.0 and CUDA 10.2.89. In both cases, the test_complex with ST=double converges in 652 iterations. I am wondering why your run converges in 506? That seems like too much of a change for simple rounding errors.

Vortex. I used the .mtx from https://math.nist.gov/MatrixMarket/data/Harwell-Boeing/acoust/young1c.html, could that be why?

Can we add some sort of option to those example files so that the user can pick a scalar type? I don't really want the double versions to be overwritten with bhalf.

Shall we leave them as double like we did when testing half? If so, I can update the PR.

jennloe · 2022-02-03T21:56:18Z

@e10harvey

about Young1c.mtx : Weird, you are right! I downloaded the file from NIST and now mine is also using 506 iterations. I don't understand why this is different from the file I pulled via ssget (Gingko utility that connects to SuiteSparse).

Yes, if you change the default back to double, I will approve the PR.
Thanks for your help with this!

jennloe · 2022-02-04T00:58:53Z

As a side note- I've figured out the young1c issues. Apparently there was confusion in the original Harwell-Boeing matrix collection about this matrix data. The NIST website interprets it as symmetric and ignores some data, while SuiteSparse uses all the data and interprets the matrix as nonsymmetric. [This is all documented in the note at the top here: nist-young1c and the note at the bottom here: suitesparce-young1c ] So that seems to be why the matrices are different. Very unusual!

kokkos-devops-admin · 2022-02-05T05:50:28Z

Status Flag 'Pre-Test Inspection' - Auto Inspected - Inspection Is Not Necessary for this Pull Request.

kokkos-devops-admin · 2022-02-05T05:51:38Z

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_CUDA9_Tpls_CUDA10_Tpls_CUDA10_LayoutRight_GCC720_Light_GCC720_GCC740

Build Num: 47
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`2e27125`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC720

Build Num: 818
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`2e27125`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC720_Light_LayoutRight

Build Num: 465
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`2e27125`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC720

Build Num: 809
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`2e27125`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL18

Build Num: 797
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`2e27125`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

Build Num: 202
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`2e27125`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Using Repos:

Repo: KOKKOSKERNELS (e10harvey/kokkos-kernels)

Pull Request Author: e10harvey

kokkos-devops-admin · 2022-02-05T08:13:12Z

Status Flag 'Pull Request AutoTester' - Jenkins Testing: all Jobs PASSED

Pull Request Auto Testing has PASSED (click to expand)

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_CUDA9_Tpls_CUDA10_Tpls_CUDA10_LayoutRight_GCC720_Light_GCC720_GCC740

Build Num: 47
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`2e27125`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC720

Build Num: 818
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`2e27125`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC720_Light_LayoutRight

Build Num: 465
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`2e27125`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC720

Build Num: 809
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`2e27125`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL18

Build Num: 797
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`2e27125`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

Build Num: 202
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	issue1250
KOKKOSKERNELS_SOURCE_REPO	https://github.com/e10harvey/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`2e27125`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`30a4c4e`
PR_LABELS	feature request
PULLREQUESTNUM	1300
TEST_REPO_ALIAS	KOKKOSKERNELS

kokkos-devops-admin · 2022-02-05T08:13:29Z

Status Flag 'Pre-Merge Inspection' - SUCCESS: The last commit to this Pull Request has been INSPECTED AND APPROVED by [ jennloe ]!

kokkos-devops-admin · 2022-02-05T08:13:36Z

Status Flag 'Pull Request AutoTester' - Pull Request MUST BE MERGED MANUALLY BY Project Team - This Repo does not support Automerge

kokkos-devops-admin · 2022-02-06T08:18:18Z

Status Flag 'Pull Request AutoTester' - Pull Request MUST BE MERGED MANUALLY BY Project Team - This Repo does not support Automerge

kokkos-devops-admin · 2022-02-07T08:23:57Z

Status Flag 'Pull Request AutoTester' - Pull Request MUST BE MERGED MANUALLY BY Project Team - This Repo does not support Automerge

jennloe · 2022-02-08T17:35:11Z

@lucbv @srajama1 Can someone merge this? Thanks!

example/gmres: Switch scalar to bhalf_t

9ae5c4f

e10harvey added the feature request label Feb 2, 2022

e10harvey requested review from srajama1 and jennloe February 2, 2022 18:00

e10harvey self-assigned this Feb 2, 2022

jennloe suggested changes Feb 3, 2022

View reviewed changes

example/gmres: Switch scalar back to double

2e27125

jennloe approved these changes Feb 3, 2022

View reviewed changes

e10harvey merged commit 43a0398 into kokkos:develop Feb 8, 2022

example/gmres: Switch scalar to bhalf_t #1300

example/gmres: Switch scalar to bhalf_t #1300

Conversation

e10harvey commented Feb 2, 2022

Real numbers - Convergence with double

Real numbers - Convergence with bhalf

Complex numbers - Convergence with double

Complex numbers - Convergence with bhalf

kokkos-devops-admin commented Feb 2, 2022

kokkos-devops-admin commented Feb 2, 2022

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_CUDA9_Tpls_CUDA10_Tpls_CUDA10_LayoutRight_GCC720_Light_GCC720_GCC740

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_GCC720

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_GCC720_Light_LayoutRight

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC720

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL18

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

Jenkins Parameters

Using Repos:

kokkos-devops-admin commented Feb 2, 2022

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_CUDA9_Tpls_CUDA10_Tpls_CUDA10_LayoutRight_GCC720_Light_GCC720_GCC740

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_GCC720

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_GCC720_Light_LayoutRight

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC720

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL18

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

Jenkins Parameters

Reproducer instructions:

Load modules:

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

Reproducer instructions:

Load modules:

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

Reproducer instructions:

Load modules:

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

Reproducer instructions:

Load modules:

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

Reproducer instructions:

Load modules:

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

Reproducer instructions:

Load modules:

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

Reproducer instructions:

Load modules:

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

Reproducer instructions:

Load modules:

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

Reproducer instructions:

Load modules:

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

jennloe commented Feb 2, 2022

jennloe left a comment

Choose a reason for hiding this comment

e10harvey commented Feb 3, 2022

jennloe commented Feb 3, 2022