Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BLAS: fixing test that access results before synching #1472

Merged
merged 1 commit into from
Jul 21, 2022

Conversation

lucbv
Copy link
Contributor

@lucbv lucbv commented Jul 19, 2022

For some kernels that return results in host views the implementation is non-blocking and requires to do a Kokkos::fence() before checking the value against the reference value.

@lucbv lucbv added the bug label Jul 19, 2022
@lucbv lucbv requested a review from brian-kelley July 19, 2022 22:39
@lucbv lucbv self-assigned this Jul 19, 2022
@kokkos-devops-admin
Copy link

Status Flag 'Pre-Test Inspection' - Auto Inspected - Inspection Is Not Necessary for this Pull Request.

@kokkos-devops-admin
Copy link

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740

  • Build Num: 317
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA c53ff75
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 8a368d0
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight

  • Build Num: 310
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA c53ff75
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 8a368d0
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC720

  • Build Num: 1125
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA c53ff75
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 8a368d0
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC720_Light_LayoutRight

  • Build Num: 769
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA c53ff75
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 8a368d0
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC720

  • Build Num: 1113
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA c53ff75
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 8a368d0
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL18

  • Build Num: 1100
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA c53ff75
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 8a368d0
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

  • Build Num: 505
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA c53ff75
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 8a368d0
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Using Repos:

Repo: KOKKOSKERNELS (lucbv/kokkos-kernels)
  • Branch: blas_mv_fix
  • SHA: c53ff75
  • Mode: TEST_REPO

Pull Request Author: lucbv

@kokkos-devops-admin
Copy link

Status Flag 'Pull Request AutoTester' - Jenkins Testing: 1 or more Jobs FAILED

Note: Testing will normally be attempted again in approx. 2 Hrs 30 Mins. If a change to the PR source branch occurs, the testing will be attempted again on next available autotester run.

Pull Request Auto Testing has FAILED (click to expand)

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740

  • Build Num: 317
  • Status: FAILED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA c53ff75
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 8a368d0
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight

  • Build Num: 310
  • Status: FAILED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA c53ff75
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 8a368d0
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC720

  • Build Num: 1125
  • Status: FAILED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA c53ff75
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 8a368d0
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC720_Light_LayoutRight

  • Build Num: 769
  • Status: FAILED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA c53ff75
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 8a368d0
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC720

  • Build Num: 1113
  • Status: FAILED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA c53ff75
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 8a368d0
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL18

  • Build Num: 1100
  • Status: FAILED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA c53ff75
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 8a368d0
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

  • Build Num: 505
  • Status: FAILED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA c53ff75
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 8a368d0
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS
Console Output (last 100 lines) : KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740 # 317 (click to expand)

          detected during:
            instantiation of "void KokkosBatched::Impl::BatchedDblBufGemm::__run() [with ArgTransA=KokkosBatched::Trans::NoTranspose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Right, HandleType=KokkosBatched::BatchedGemmHandle, ScalarType=double, AViewType=Kokkos::View, BViewType=Kokkos::View, CViewType=Kokkos::View, ArgBoundsCheck=KokkosBatched::BoundsCheck::No, ArgAlphaFmaTag=KokkosBatched::AlphaTag::No, TILE_M=32, TILE_N=32, TILE_K=8]" 
(114): here
            instantiation of "int KokkosBatched::Impl::BatchedDblBufGemm::invoke() [with ArgTransA=KokkosBatched::Trans::NoTranspose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Right, HandleType=KokkosBatched::BatchedGemmHandle, ScalarType=double, AViewType=Kokkos::View, BViewType=Kokkos::View, CViewType=Kokkos::View, ArgBoundsCheck=KokkosBatched::BoundsCheck::No, ArgAlphaFmaTag=KokkosBatched::AlphaTag::No, TILE_M=32, TILE_N=32, TILE_K=8]" 
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/kokkos-kernels/src/batched/dense/KokkosBatched_Gemm_Decl.hpp(547): here
            instantiation of "int KokkosBatched::BatchedGemm(BatchedGemmHandleType *, ScalarType, const AViewType &, const BViewType &, ScalarType, const CViewType &) [with ArgTransA=KokkosBatched::Trans::NoTranspose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Right, BatchedGemmHandleType=KokkosBatched::BatchedGemmHandle, ScalarType=double, AViewType=Kokkos::View, BViewType=Kokkos::View, CViewType=Kokkos::View]" 
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp(278): here
            instantiation of "void Test::impl_test_batched_gemm(int, int, int, int, int, int, int) [with DeviceType=Kokkos::Cuda, ViewType=Kokkos::View, ScalarType=Test::bhalfScalarType, ParamTagType=Test::SharedParamTag]" 
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp(306): here
            instantiation of "void test_batched_gemm_with_layout(int) [with ViewType=Kokkos::View, DeviceType=Kokkos::Cuda, ValueType=Test::bhalfScalarType, ScalarType=Test::bhalfScalarType, ParamTagType=Test::SharedParamTag]" 
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp(369): here
            instantiation of "int test_batched_gemm() [with DeviceType=Kokkos::Cuda, ValueType=Test::bhalfScalarType, ScalarType=Test::bhalfScalarType, ParamTagType=Test::SharedParamTag]" 
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm_Real.hpp(69): here

/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/kokkos-kernels/src/batched/dense/impl/KokkosBatched_Gemm_DblBuf_Impl.hpp(156): error: no instance of function template "Kokkos::TeamPolicy<Properties...>::team_size_max [with Properties=<std::conditional_t<true, Kokkos::Cuda::array_layout, Kokkos::Cuda::array_layout>, Kokkos::CudaUVMSpace::execution_space>]" matches the argument list
argument types are: (functor_type, Kokkos::ParallelForTag)
object type is: policy_type
detected during:
instantiation of "void KokkosBatched::Impl::BatchedDblBufGemm<ArgTransA, ArgTransB, ArgBatchSzDim, HandleType, ScalarType, AViewType, BViewType, CViewType, ArgBoundsCheck, ArgAlphaFmaTag, TILE_M, TILE_N, TILE_K>::__run() [with ArgTransA=KokkosBatched::Trans::NoTranspose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Right, HandleType=KokkosBatched::BatchedGemmHandle, ScalarType=double, AViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, BViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, CViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, ArgBoundsCheck=KokkosBatched::BoundsCheck::Yes, ArgAlphaFmaTag=KokkosBatched::AlphaTag::Yes, TILE_M=32, TILE_N=32, TILE_K=8]"
(114): here
instantiation of "int KokkosBatched::Impl::BatchedDblBufGemm<ArgTransA, ArgTransB, ArgBatchSzDim, HandleType, ScalarType, AViewType, BViewType, CViewType, ArgBoundsCheck, ArgAlphaFmaTag, TILE_M, TILE_N, TILE_K>::invoke() [with ArgTransA=KokkosBatched::Trans::NoTranspose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Right, HandleType=KokkosBatched::BatchedGemmHandle, ScalarType=double, AViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, BViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, CViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, ArgBoundsCheck=KokkosBatched::BoundsCheck::Yes, ArgAlphaFmaTag=KokkosBatched::AlphaTag::Yes, TILE_M=32, TILE_N=32, TILE_K=8]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/kokkos-kernels/src/batched/dense/KokkosBatched_Gemm_Decl.hpp(557): here
instantiation of "int KokkosBatched::BatchedGemm<ArgTransA,ArgTransB,ArgBatchSzDim,BatchedGemmHandleType,ScalarType,AViewType,BViewType,CViewType>(BatchedGemmHandleType *, ScalarType, const AViewType &, const BViewType &, ScalarType, const CViewType &) [with ArgTransA=KokkosBatched::Trans::NoTranspose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Right, BatchedGemmHandleType=KokkosBatched::BatchedGemmHandle, ScalarType=double, AViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, BViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, CViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp(278): here
instantiation of "void Test::impl_test_batched_gemm<DeviceType,ViewType,ScalarType,ParamTagType>(int, int, int, int, int, int, int) [with DeviceType=Kokkos::Cuda, ViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, ScalarType=Test::bhalfScalarType, ParamTagType=Test::SharedParamTag<KokkosBatched::Trans::NoTranspose, KokkosBatched::Trans::Transpose, KokkosBatched::BatchLayout::Right>]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp(306): here
instantiation of "void test_batched_gemm_with_layout<ViewType,DeviceType,ValueType,ScalarType,ParamTagType>(int) [with ViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, DeviceType=Kokkos::Cuda, ValueType=Test::bhalfScalarType, ScalarType=Test::bhalfScalarType, ParamTagType=Test::SharedParamTag<KokkosBatched::Trans::NoTranspose, KokkosBatched::Trans::Transpose, KokkosBatched::BatchLayout::Right>]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp(369): here
instantiation of "int test_batched_gemm<DeviceType,ValueType,ScalarType,ParamTagType>() [with DeviceType=Kokkos::Cuda, ValueType=Test::bhalfScalarType, ScalarType=Test::bhalfScalarType, ParamTagType=Test::SharedParamTag<KokkosBatched::Trans::NoTranspose, KokkosBatched::Trans::Transpose, KokkosBatched::BatchLayout::Right>]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm_Real.hpp(69): here

/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/kokkos-kernels/src/batched/dense/impl/KokkosBatched_Gemm_DblBuf_Impl.hpp(156): error: no instance of function template "Kokkos::TeamPolicy<Properties...>::team_size_max [with Properties=<std::conditional_t<true, Kokkos::Cuda::array_layout, Kokkos::Cuda::array_layout>, Kokkos::CudaUVMSpace::execution_space>]" matches the argument list
argument types are: (functor_type, Kokkos::ParallelForTag)
object type is: policy_type
detected during:
instantiation of "void KokkosBatched::Impl::BatchedDblBufGemm<ArgTransA, ArgTransB, ArgBatchSzDim, HandleType, ScalarType, AViewType, BViewType, CViewType, ArgBoundsCheck, ArgAlphaFmaTag, TILE_M, TILE_N, TILE_K>::__run() [with ArgTransA=KokkosBatched::Trans::NoTranspose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Right, HandleType=KokkosBatched::BatchedGemmHandle, ScalarType=double, AViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, BViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, CViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, ArgBoundsCheck=KokkosBatched::BoundsCheck::Yes, ArgAlphaFmaTag=KokkosBatched::AlphaTag::No, TILE_M=32, TILE_N=32, TILE_K=8]"
(114): here
instantiation of "int KokkosBatched::Impl::BatchedDblBufGemm<ArgTransA, ArgTransB, ArgBatchSzDim, HandleType, ScalarType, AViewType, BViewType, CViewType, ArgBoundsCheck, ArgAlphaFmaTag, TILE_M, TILE_N, TILE_K>::invoke() [with ArgTransA=KokkosBatched::Trans::NoTranspose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Right, HandleType=KokkosBatched::BatchedGemmHandle, ScalarType=double, AViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, BViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, CViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, ArgBoundsCheck=KokkosBatched::BoundsCheck::Yes, ArgAlphaFmaTag=KokkosBatched::AlphaTag::No, TILE_M=32, TILE_N=32, TILE_K=8]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/kokkos-kernels/src/batched/dense/KokkosBatched_Gemm_Decl.hpp(565): here
instantiation of "int KokkosBatched::BatchedGemm<ArgTransA,ArgTransB,ArgBatchSzDim,BatchedGemmHandleType,ScalarType,AViewType,BViewType,CViewType>(BatchedGemmHandleType *, ScalarType, const AViewType &, const BViewType &, ScalarType, const CViewType &) [with ArgTransA=KokkosBatched::Trans::NoTranspose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Right, BatchedGemmHandleType=KokkosBatched::BatchedGemmHandle, ScalarType=double, AViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, BViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, CViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp(278): here
instantiation of "void Test::impl_test_batched_gemm<DeviceType,ViewType,ScalarType,ParamTagType>(int, int, int, int, int, int, int) [with DeviceType=Kokkos::Cuda, ViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, ScalarType=Test::bhalfScalarType, ParamTagType=Test::SharedParamTag<KokkosBatched::Trans::NoTranspose, KokkosBatched::Trans::Transpose, KokkosBatched::BatchLayout::Right>]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp(306): here
instantiation of "void test_batched_gemm_with_layout<ViewType,DeviceType,ValueType,ScalarType,ParamTagType>(int) [with ViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, DeviceType=Kokkos::Cuda, ValueType=Test::bhalfScalarType, ScalarType=Test::bhalfScalarType, ParamTagType=Test::SharedParamTag<KokkosBatched::Trans::NoTranspose, KokkosBatched::Trans::Transpose, KokkosBatched::BatchLayout::Right>]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp(369): here
instantiation of "int test_batched_gemm<DeviceType,ValueType,ScalarType,ParamTagType>() [with DeviceType=Kokkos::Cuda, ValueType=Test::bhalfScalarType, ScalarType=Test::bhalfScalarType, ParamTagType=Test::SharedParamTag<KokkosBatched::Trans::NoTranspose, KokkosBatched::Trans::Transpose, KokkosBatched::BatchLayout::Right>]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm_Real.hpp(69): here

Error limit reached.
100 errors detected in the compilation of "/tmp/tmpxft_00008c5e_00000000-6_Test_Cuda_Batched_Dense.cpp1.ii".
Compilation terminated.
make[2]: *** [unit_test/CMakeFiles/KokkosKernels_batched_dla_cuda.dir/cuda/Test_Cuda_Batched_Dense.cpp.o] Error 1
make[1]: *** [unit_test/CMakeFiles/KokkosKernels_batched_dla_cuda.dir/all] Error 2
[ 86%] Linking CXX executable KokkosBlas2_gemv_perf_test
[ 86%] Built target KokkosBlas2_gemv_perf_test
[ 87%] Linking CXX executable KokkosKernels_batched_sla_cuda
[ 87%] Linking CXX executable KokkosBlas3_gemm_perf_test
[ 87%] Built target KokkosKernels_batched_sla_cuda
[ 87%] Built target KokkosBlas3_gemm_perf_test
[ 87%] Linking CXX executable KokkosKernels_graph_openmp
[ 87%] Built target KokkosKernels_graph_openmp
[ 87%] Linking CXX executable KokkosKernels_common_cuda
[ 87%] Built target KokkosKernels_common_cuda
[ 87%] Linking CXX executable KokkosKernels_blas_cuda
[ 87%] Built target KokkosKernels_blas_cuda
[ 88%] Linking CXX executable KokkosKernels_sparse_openmp
[ 88%] Built target KokkosKernels_sparse_openmp
[ 88%] Linking CXX executable KokkosKernels_sparse_cuda
[ 88%] Built target KokkosKernels_sparse_cuda
make: *** [all] Error 2
#######################################################
PASSED TESTS
#######################################################
#######################################################
FAILED TESTS
#######################################################
cuda-9.2.88-Cuda_OpenMP-release (build failed)
#######################################################

Reproducer instructions:

Load modules:

    source /etc/profile.d/modules.sh
    module purge
    module load cmake/3.19.3 cuda/9.2.88 gcc/7.2.0 netlib/3.8.0/gcc/7.2.0

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=Cuda,OpenMP --arch=Power9,Volta70 --compiler=/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/kokkos/bin/nvcc_wrapper --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wuninitialized " --cxxstandard="14" --ldflags="" --with-cuda=/home/projects/ppc64le-pwr9-nvidia/cuda/9.2.88 --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutLeft --with-tpls=blas,cublas,cusparse --user-blas-path=/home/projects/ppc64le-pwr9/netlib/3.8.0/gcc/7.2.0/lib --user-lapack-path=/home/projects/ppc64le-pwr9/netlib/3.8.0/gcc/7.2.0/lib --user-blas-lib=blas --user-lapack-lib=lapack --extra-linker-flags=-lgfortran,-lm --with-options= --with-cuda-options=force_uvm,enable_lambda --no-examples

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

  # Move to the build directory
    cd /home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740/KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740.317/TestAll_2022-07-19_16.52.16/cuda/9.2.88/Cuda_OpenMP-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################
Build step 'Execute shell' marked build as failure
Finished: FAILURE

Console Output (last 100 lines) : KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight # 310 (click to expand)

            argument types are: (functor_type, Kokkos::ParallelForTag)
            object type is: policy_type
          detected during:
            instantiation of "void KokkosBatched::Impl::BatchedDblBufGemm::__run() [with ArgTransA=KokkosBatched::Trans::NoTranspose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Right, HandleType=KokkosBatched::BatchedGemmHandle, ScalarType=double, AViewType=Kokkos::View, BViewType=Kokkos::View, CViewType=Kokkos::View, ArgBoundsCheck=KokkosBatched::BoundsCheck::No, ArgAlphaFmaTag=KokkosBatched::AlphaTag::No, TILE_M=32, TILE_N=32, TILE_K=8]" 
(114): here
            instantiation of "int KokkosBatched::Impl::BatchedDblBufGemm::invoke() [with ArgTransA=KokkosBatched::Trans::NoTranspose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Right, HandleType=KokkosBatched::BatchedGemmHandle, ScalarType=double, AViewType=Kokkos::View, BViewType=Kokkos::View, CViewType=Kokkos::View, ArgBoundsCheck=KokkosBatched::BoundsCheck::No, ArgAlphaFmaTag=KokkosBatched::AlphaTag::No, TILE_M=32, TILE_N=32, TILE_K=8]" 
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/kokkos-kernels/src/batched/dense/KokkosBatched_Gemm_Decl.hpp(547): here
            instantiation of "int KokkosBatched::BatchedGemm(BatchedGemmHandleType *, ScalarType, const AViewType &, const BViewType &, ScalarType, const CViewType &) [with ArgTransA=KokkosBatched::Trans::NoTranspose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Right, BatchedGemmHandleType=KokkosBatched::BatchedGemmHandle, ScalarType=double, AViewType=Kokkos::View, BViewType=Kokkos::View, CViewType=Kokkos::View]" 
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp(278): here
            instantiation of "void Test::impl_test_batched_gemm(int, int, int, int, int, int, int) [with DeviceType=Kokkos::Cuda, ViewType=Kokkos::View, ScalarType=Test::bhalfScalarType, ParamTagType=Test::SharedParamTag]" 
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp(306): here
            instantiation of "void test_batched_gemm_with_layout(int) [with ViewType=Kokkos::View, DeviceType=Kokkos::Cuda, ValueType=Test::bhalfScalarType, ScalarType=Test::bhalfScalarType, ParamTagType=Test::SharedParamTag]" 
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp(369): here
            instantiation of "int test_batched_gemm() [with DeviceType=Kokkos::Cuda, ValueType=Test::bhalfScalarType, ScalarType=Test::bhalfScalarType, ParamTagType=Test::SharedParamTag]" 
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm_Real.hpp(69): here

/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/kokkos-kernels/src/batched/dense/impl/KokkosBatched_Gemm_DblBuf_Impl.hpp(156): error: no instance of function template "Kokkos::TeamPolicy<Properties...>::team_size_max [with Properties=<std::conditional_t<true, Kokkos::Cuda::array_layout, Kokkos::Cuda::array_layout>, Kokkos::CudaSpace::execution_space>]" matches the argument list
argument types are: (functor_type, Kokkos::ParallelForTag)
object type is: policy_type
detected during:
instantiation of "void KokkosBatched::Impl::BatchedDblBufGemm<ArgTransA, ArgTransB, ArgBatchSzDim, HandleType, ScalarType, AViewType, BViewType, CViewType, ArgBoundsCheck, ArgAlphaFmaTag, TILE_M, TILE_N, TILE_K>::__run() [with ArgTransA=KokkosBatched::Trans::NoTranspose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Right, HandleType=KokkosBatched::BatchedGemmHandle, ScalarType=double, AViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, BViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, CViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, ArgBoundsCheck=KokkosBatched::BoundsCheck::Yes, ArgAlphaFmaTag=KokkosBatched::AlphaTag::Yes, TILE_M=32, TILE_N=32, TILE_K=8]"
(114): here
instantiation of "int KokkosBatched::Impl::BatchedDblBufGemm<ArgTransA, ArgTransB, ArgBatchSzDim, HandleType, ScalarType, AViewType, BViewType, CViewType, ArgBoundsCheck, ArgAlphaFmaTag, TILE_M, TILE_N, TILE_K>::invoke() [with ArgTransA=KokkosBatched::Trans::NoTranspose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Right, HandleType=KokkosBatched::BatchedGemmHandle, ScalarType=double, AViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, BViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, CViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, ArgBoundsCheck=KokkosBatched::BoundsCheck::Yes, ArgAlphaFmaTag=KokkosBatched::AlphaTag::Yes, TILE_M=32, TILE_N=32, TILE_K=8]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/kokkos-kernels/src/batched/dense/KokkosBatched_Gemm_Decl.hpp(557): here
instantiation of "int KokkosBatched::BatchedGemm<ArgTransA,ArgTransB,ArgBatchSzDim,BatchedGemmHandleType,ScalarType,AViewType,BViewType,CViewType>(BatchedGemmHandleType *, ScalarType, const AViewType &, const BViewType &, ScalarType, const CViewType &) [with ArgTransA=KokkosBatched::Trans::NoTranspose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Right, BatchedGemmHandleType=KokkosBatched::BatchedGemmHandle, ScalarType=double, AViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, BViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, CViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp(278): here
instantiation of "void Test::impl_test_batched_gemm<DeviceType,ViewType,ScalarType,ParamTagType>(int, int, int, int, int, int, int) [with DeviceType=Kokkos::Cuda, ViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, ScalarType=Test::bhalfScalarType, ParamTagType=Test::SharedParamTag<KokkosBatched::Trans::NoTranspose, KokkosBatched::Trans::Transpose, KokkosBatched::BatchLayout::Right>]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp(306): here
instantiation of "void test_batched_gemm_with_layout<ViewType,DeviceType,ValueType,ScalarType,ParamTagType>(int) [with ViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, DeviceType=Kokkos::Cuda, ValueType=Test::bhalfScalarType, ScalarType=Test::bhalfScalarType, ParamTagType=Test::SharedParamTag<KokkosBatched::Trans::NoTranspose, KokkosBatched::Trans::Transpose, KokkosBatched::BatchLayout::Right>]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp(369): here
instantiation of "int test_batched_gemm<DeviceType,ValueType,ScalarType,ParamTagType>() [with DeviceType=Kokkos::Cuda, ValueType=Test::bhalfScalarType, ScalarType=Test::bhalfScalarType, ParamTagType=Test::SharedParamTag<KokkosBatched::Trans::NoTranspose, KokkosBatched::Trans::Transpose, KokkosBatched::BatchLayout::Right>]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm_Real.hpp(69): here

/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/kokkos-kernels/src/batched/dense/impl/KokkosBatched_Gemm_DblBuf_Impl.hpp(156): error: no instance of function template "Kokkos::TeamPolicy<Properties...>::team_size_max [with Properties=<std::conditional_t<true, Kokkos::Cuda::array_layout, Kokkos::Cuda::array_layout>, Kokkos::CudaSpace::execution_space>]" matches the argument list
argument types are: (functor_type, Kokkos::ParallelForTag)
object type is: policy_type
detected during:
instantiation of "void KokkosBatched::Impl::BatchedDblBufGemm<ArgTransA, ArgTransB, ArgBatchSzDim, HandleType, ScalarType, AViewType, BViewType, CViewType, ArgBoundsCheck, ArgAlphaFmaTag, TILE_M, TILE_N, TILE_K>::__run() [with ArgTransA=KokkosBatched::Trans::NoTranspose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Right, HandleType=KokkosBatched::BatchedGemmHandle, ScalarType=double, AViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, BViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, CViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, ArgBoundsCheck=KokkosBatched::BoundsCheck::Yes, ArgAlphaFmaTag=KokkosBatched::AlphaTag::No, TILE_M=32, TILE_N=32, TILE_K=8]"
(114): here
instantiation of "int KokkosBatched::Impl::BatchedDblBufGemm<ArgTransA, ArgTransB, ArgBatchSzDim, HandleType, ScalarType, AViewType, BViewType, CViewType, ArgBoundsCheck, ArgAlphaFmaTag, TILE_M, TILE_N, TILE_K>::invoke() [with ArgTransA=KokkosBatched::Trans::NoTranspose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Right, HandleType=KokkosBatched::BatchedGemmHandle, ScalarType=double, AViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, BViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, CViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, ArgBoundsCheck=KokkosBatched::BoundsCheck::Yes, ArgAlphaFmaTag=KokkosBatched::AlphaTag::No, TILE_M=32, TILE_N=32, TILE_K=8]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/kokkos-kernels/src/batched/dense/KokkosBatched_Gemm_Decl.hpp(565): here
instantiation of "int KokkosBatched::BatchedGemm<ArgTransA,ArgTransB,ArgBatchSzDim,BatchedGemmHandleType,ScalarType,AViewType,BViewType,CViewType>(BatchedGemmHandleType *, ScalarType, const AViewType &, const BViewType &, ScalarType, const CViewType &) [with ArgTransA=KokkosBatched::Trans::NoTranspose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Right, BatchedGemmHandleType=KokkosBatched::BatchedGemmHandle, ScalarType=double, AViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, BViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, CViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp(278): here
instantiation of "void Test::impl_test_batched_gemm<DeviceType,ViewType,ScalarType,ParamTagType>(int, int, int, int, int, int, int) [with DeviceType=Kokkos::Cuda, ViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, ScalarType=Test::bhalfScalarType, ParamTagType=Test::SharedParamTag<KokkosBatched::Trans::NoTranspose, KokkosBatched::Trans::Transpose, KokkosBatched::BatchLayout::Right>]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp(306): here
instantiation of "void test_batched_gemm_with_layout<ViewType,DeviceType,ValueType,ScalarType,ParamTagType>(int) [with ViewType=Kokkos::View<Test::bhalfScalarType ***, Kokkos::LayoutLeft, Kokkos::Cuda>, DeviceType=Kokkos::Cuda, ValueType=Test::bhalfScalarType, ScalarType=Test::bhalfScalarType, ParamTagType=Test::SharedParamTag<KokkosBatched::Trans::NoTranspose, KokkosBatched::Trans::Transpose, KokkosBatched::BatchLayout::Right>]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp(369): here
instantiation of "int test_batched_gemm<DeviceType,ValueType,ScalarType,ParamTagType>() [with DeviceType=Kokkos::Cuda, ValueType=Test::bhalfScalarType, ScalarType=Test::bhalfScalarType, ParamTagType=Test::SharedParamTag<KokkosBatched::Trans::NoTranspose, KokkosBatched::Trans::Transpose, KokkosBatched::BatchLayout::Right>]"
/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm_Real.hpp(69): here

Error limit reached.
100 errors detected in the compilation of "/tmp/tmpxft_000256fd_00000000-6_Test_Cuda_Batched_Dense.cpp1.ii".
Compilation terminated.
make[2]: *** [unit_test/CMakeFiles/KokkosKernels_batched_dla_cuda.dir/cuda/Test_Cuda_Batched_Dense.cpp.o] Error 1
make[1]: *** [unit_test/CMakeFiles/KokkosKernels_batched_dla_cuda.dir/all] Error 2
[ 86%] Linking CXX executable KokkosBlas2_gemv_perf_test
[ 86%] Built target KokkosBlas2_gemv_perf_test
[ 86%] Linking CXX executable KokkosKernels_common_serial
[ 86%] Built target KokkosKernels_common_serial
[ 87%] Linking CXX executable KokkosKernels_batched_sla_cuda
[ 87%] Built target KokkosKernels_batched_sla_cuda
[ 87%] Linking CXX executable KokkosBlas3_gemm_perf_test
[ 87%] Built target KokkosBlas3_gemm_perf_test
[ 87%] Linking CXX executable KokkosKernels_common_cuda
[ 87%] Built target KokkosKernels_common_cuda
[ 88%] Linking CXX executable KokkosKernels_sparse_serial
[ 88%] Built target KokkosKernels_sparse_serial
[ 88%] Linking CXX executable KokkosKernels_sparse_cuda
[ 88%] Built target KokkosKernels_sparse_cuda
make: *** [all] Error 2
#######################################################
PASSED TESTS
#######################################################
#######################################################
FAILED TESTS
#######################################################
cuda-10.1.243-Cuda_Serial-release (build failed)
#######################################################

Reproducer instructions:

Load modules:

    source /etc/profile.d/modules.sh
    module purge
    module load cmake/3.19.3 cuda/10.1.243 gcc/7.2.0 openblas/0.2.20/gcc/7.2.0

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=Cuda,Serial --arch=Power9,Volta70 --compiler=/home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/kokkos/bin/nvcc_wrapper --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wuninitialized " --cxxstandard="14" --ldflags="" --with-cuda=/home/projects/ppc64le-pwr9-nvidia/cuda/10.1.243 --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutLeft --with-tpls=blas,cublas,cusparse --user-blas-path=/home/projects/ppc64le-pwr9/openblas/0.2.20/gcc/7.2.0/lib --user-lapack-path=/home/projects/ppc64le-pwr9/openblas/0.2.20/gcc/7.2.0/lib --user-blas-lib=blas --user-lapack-lib=lapack --extra-linker-flags=-lgfortran,-lm --with-options= --with-cuda-options=,enable_lambda --no-examples

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

  # Move to the build directory
    cd /home/jenkins/weaver-new/workspace/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight/KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight.310/TestAll_2022-07-19_16.52.27/cuda/10.1.243/Cuda_Serial-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################
Build step 'Execute shell' marked build as failure
Finished: FAILURE

Console Output (last 100 lines) : KokkosKernels_PullRequest_GCC720 # 1125 (click to expand)

/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:156:8:   required from struct Kokkos::Impl::AnalyzeExecPolicyUseMatcher, Kokkos::LayoutLeft, Kokkos::OpenMP>
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:91:8:   required from struct Kokkos::Impl::AnalyzeExecPolicy
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:194:8:   required from struct Kokkos::Impl::ExecPolicyTraitsWithDefaults >
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:218:8:   required from struct Kokkos::Impl::PolicyTraits
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release/kokkos-install/include/Kokkos_ExecPolicy.hpp:546:7:   required from class Kokkos::TeamPolicy
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/kokkos-kernels/src/batched/dense/impl/KokkosBatched_Gemm_DblBuf_Impl.hpp:121:58:   required from void KokkosBatched::Impl::BatchedDblBufGemm::__run() [with ArgTransA = KokkosBatched::Trans::NoTranspose; ArgTransB = KokkosBatched::Trans::NoTranspose; ArgBatchSzDim = KokkosBatched::BatchLayout::Right; HandleType = KokkosBatched::BatchedGemmHandle; ScalarType = double; AViewType = Kokkos::View, 8>***, Kokkos::LayoutLeft, Kokkos::OpenMP>; BViewType = Kokkos::View, 8>***, Kokkos::LayoutLeft, Kokkos::OpenMP>; CViewType = Kokkos::View, 8>***, Kokkos::LayoutLeft, Kokkos::OpenMP>; ArgBoundsCheck = KokkosBatched::BoundsCheck::No; ArgAlphaFmaTag = KokkosBatched::AlphaTag::Yes; int TILE_M = 32; int TILE_N = 32; int TILE_K = 8]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/kokkos-kernels/src/batched/dense/impl/KokkosBatched_Gemm_DblBuf_Impl.hpp:114:10:   required from int KokkosBatched::Impl::BatchedDblBufGemm::invoke() [with ArgTransA = KokkosBatched::Trans::NoTranspose; ArgTransB = KokkosBatched::Trans::NoTranspose; ArgBatchSzDim = KokkosBatched::BatchLayout::Right; HandleType = KokkosBatched::BatchedGemmHandle; ScalarType = double; AViewType = Kokkos::View, 8>***, Kokkos::LayoutLeft, Kokkos::OpenMP>; BViewType = Kokkos::View, 8>***, Kokkos::LayoutLeft, Kokkos::OpenMP>; CViewType = Kokkos::View, 8>***, Kokkos::LayoutLeft, Kokkos::OpenMP>; ArgBoundsCheck = KokkosBatched::BoundsCheck::No; ArgAlphaFmaTag = KokkosBatched::AlphaTag::Yes; int TILE_M = 32; int TILE_N = 32; int TILE_K = 8]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/kokkos-kernels/src/batched/dense/KokkosBatched_Gemm_Decl.hpp:533:17:   required from int KokkosBatched::BatchedGemm(BatchedGemmHandleType*, ScalarType, const AViewType&, const BViewType&, ScalarType, const CViewType&) [with ArgTransA = KokkosBatched::Trans::NoTranspose; ArgTransB = KokkosBatched::Trans::NoTranspose; ArgBatchSzDim = KokkosBatched::BatchLayout::Right; BatchedGemmHandleType = KokkosBatched::BatchedGemmHandle; ScalarType = double; AViewType = Kokkos::View, 8>***, Kokkos::LayoutLeft, Kokkos::OpenMP>; BViewType = Kokkos::View, 8>***, Kokkos::LayoutLeft, Kokkos::OpenMP>; CViewType = Kokkos::View, 8>***, Kokkos::LayoutLeft, Kokkos::OpenMP>]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_gemm_perf_test.hpp:497:61:   required from void __do_gemm_parallel_batched_heuristic_template(options_t, gemm_args_t) [with algo_tag = void; blocking_type = void; device_type = Kokkos::OpenMP; algo_mode = void; options_t = perf_test_options; gemm_args_t = gemm_args]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_gemm_perf_test.hpp:590:74:   required from void __do_gemm_parallel_batched_heuristic(options_t, gemm_args_t) [with algo_tag = void; blocking_type = void; device_type = Kokkos::OpenMP; algo_mode = void; options_t = perf_test_options; gemm_args_t = gemm_args]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_gemm_perf_test.hpp:2270:71:   required from here
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:171:25: error: invalid use of incomplete type struct Kokkos::Impl::show_name_of_invalid_execution_policy_trait
   static constexpr auto trigger_error_message =
                         ^~~~~~~~~~~~~~~~~~~~~
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:168:8: note: declaration of struct Kokkos::Impl::show_name_of_invalid_execution_policy_trait
 struct show_name_of_invalid_execution_policy_trait;
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp: In instantiation of constexpr Kokkos::Impl::AnalyzeExecPolicyUseMatcher, Kokkos::LayoutLeft, Kokkos::OpenMP>::trigger_error_message:
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:171:25:   required from struct Kokkos::Impl::AnalyzeExecPolicyUseMatcher, Kokkos::LayoutLeft, Kokkos::OpenMP>
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:156:8:   [ skipping 2 instantiation contexts, use -ftemplate-backtrace-limit=0 to disable ]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:156:8:   recursively required from struct Kokkos::Impl::AnalyzeExecPolicyUseMatcher, Kokkos::LayoutLeft, Kokkos::OpenMP>
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:156:8:   required from struct Kokkos::Impl::AnalyzeExecPolicyUseMatcher, Kokkos::LayoutLeft, Kokkos::OpenMP>
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:91:8:   required from struct Kokkos::Impl::AnalyzeExecPolicy
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:194:8:   required from struct Kokkos::Impl::ExecPolicyTraitsWithDefaults >
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:218:8:   required from struct Kokkos::Impl::PolicyTraits
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release/kokkos-install/include/Kokkos_ExecPolicy.hpp:546:7:   required from class Kokkos::TeamPolicy
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/kokkos-kernels/src/batched/dense/impl/KokkosBatched_Gemm_DblBuf_Impl.hpp:121:58:   required from void KokkosBatched::Impl::BatchedDblBufGemm::__run() [with ArgTransA = KokkosBatched::Trans::NoTranspose; ArgTransB = KokkosBatched::Trans::NoTranspose; ArgBatchSzDim = KokkosBatched::BatchLayout::Right; HandleType = KokkosBatched::BatchedGemmHandle; ScalarType = double; AViewType = Kokkos::View, 8>***, Kokkos::LayoutLeft, Kokkos::OpenMP>; BViewType = Kokkos::View, 8>***, Kokkos::LayoutLeft, Kokkos::OpenMP>; CViewType = Kokkos::View, 8>***, Kokkos::LayoutLeft, Kokkos::OpenMP>; ArgBoundsCheck = KokkosBatched::BoundsCheck::No; ArgAlphaFmaTag = KokkosBatched::AlphaTag::Yes; int TILE_M = 32; int TILE_N = 32; int TILE_K = 8]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/kokkos-kernels/src/batched/dense/impl/KokkosBatched_Gemm_DblBuf_Impl.hpp:114:10:   required from int KokkosBatched::Impl::BatchedDblBufGemm::invoke() [with ArgTransA = KokkosBatched::Trans::NoTranspose; ArgTransB = KokkosBatched::Trans::NoTranspose; ArgBatchSzDim = KokkosBatched::BatchLayout::Right; HandleType = KokkosBatched::BatchedGemmHandle; ScalarType = double; AViewType = Kokkos::View, 8>***, Kokkos::LayoutLeft, Kokkos::OpenMP>; BViewType = Kokkos::View, 8>***, Kokkos::LayoutLeft, Kokkos::OpenMP>; CViewType = Kokkos::View, 8>***, Kokkos::LayoutLeft, Kokkos::OpenMP>; ArgBoundsCheck = KokkosBatched::BoundsCheck::No; ArgAlphaFmaTag = KokkosBatched::AlphaTag::Yes; int TILE_M = 32; int TILE_N = 32; int TILE_K = 8]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/kokkos-kernels/src/batched/dense/KokkosBatched_Gemm_Decl.hpp:533:17:   required from int KokkosBatched::BatchedGemm(BatchedGemmHandleType*, ScalarType, const AViewType&, const BViewType&, ScalarType, const CViewType&) [with ArgTransA = KokkosBatched::Trans::NoTranspose; ArgTransB = KokkosBatched::Trans::NoTranspose; ArgBatchSzDim = KokkosBatched::BatchLayout::Right; BatchedGemmHandleType = KokkosBatched::BatchedGemmHandle; ScalarType = double; AViewType = Kokkos::View, 8>***, Kokkos::LayoutLeft, Kokkos::OpenMP>; BViewType = Kokkos::View, 8>***, Kokkos::LayoutLeft, Kokkos::OpenMP>; CViewType = Kokkos::View, 8>***, Kokkos::LayoutLeft, Kokkos::OpenMP>]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_gemm_perf_test.hpp:497:61:   required from void __do_gemm_parallel_batched_heuristic_template(options_t, gemm_args_t) [with algo_tag = void; blocking_type = void; device_type = Kokkos::OpenMP; algo_mode = void; options_t = perf_test_options; gemm_args_t = gemm_args]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_gemm_perf_test.hpp:590:74:   required from void __do_gemm_parallel_batched_heuristic(options_t, gemm_args_t) [with algo_tag = void; blocking_type = void; device_type = Kokkos::OpenMP; algo_mode = void; options_t = perf_test_options; gemm_args_t = gemm_args]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_gemm_perf_test.hpp:2270:71:   required from here
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:171:25: error: invalid use of incomplete type struct Kokkos::Impl::show_name_of_invalid_execution_policy_trait
   static constexpr auto trigger_error_message =
                         ^~~~~~~~~~~~~~~~~~~~~
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:168:8: note: declaration of struct Kokkos::Impl::show_name_of_invalid_execution_policy_trait
 struct show_name_of_invalid_execution_policy_trait;
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[ 79%] Linking CXX executable sparse_spmv_bsr
[ 79%] Built target sparse_spmv_bsr
make[2]: *** [perf_test/blas/blas3/CMakeFiles/KokkosBlas3_perf_test.dir/KokkosBlas3_perf_test.cpp.o] Error 1
make[1]: *** [perf_test/blas/blas3/CMakeFiles/KokkosBlas3_perf_test.dir/all] Error 2
[ 79%] Linking CXX executable KokkosBlas2_gemv_perf_test
[ 79%] Built target KokkosBlas2_gemv_perf_test
[ 79%] Linking CXX executable sparse_kk_spmv
[ 79%] Built target sparse_kk_spmv
make: *** [all] Error 2
#######################################################
PASSED TESTS
#######################################################
#######################################################
FAILED TESTS
#######################################################
gcc-7.2.0-OpenMP-release (build failed)
#######################################################
  # Reproducer instructions:
  #   Load modules:
        source /etc/profile.d/modules.sh
        module purge
        module load cmake/3.19.3 gcc/7.2.0

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=OpenMP --arch=SKX --compiler=/home/projects/x86-64/gcc/7.2.0/bin/g++ --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wignored-qualifiers -Wempty-body -Wclobbered -Wuninitialized " --cxxstandard="14" --ldflags="" --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutLeft --with-tpls= --with-options= --with-cuda-options= --no-examples

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

  # Move to the build directory
    cd /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/OpenMP-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################
gcc-7.2.0-Threads_Serial-release (build failed)
#######################################################

Reproducer instructions:

Load modules:

    source /etc/profile.d/modules.sh
    module purge
    module load cmake/3.19.3 gcc/7.2.0

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=Threads,Serial --arch=SKX --compiler=/home/projects/x86-64/gcc/7.2.0/bin/g++ --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wignored-qualifiers -Wempty-body -Wclobbered -Wuninitialized " --cxxstandard="14" --ldflags="" --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutLeft --with-tpls= --with-options= --with-cuda-options= --no-examples

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

  # Move to the build directory
    cd /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720/KokkosKernels_PullRequest_GCC720.1125/TestAll_2022-07-19_16.54.10/gcc/7.2.0/Threads_Serial-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################
srun: error: blake05: task 0: Exited with exit code 2
Build step 'Execute shell' marked build as failure
Finished: FAILURE

Console Output (last 100 lines) : KokkosKernels_PullRequest_GCC720_Light_LayoutRight # 769 (click to expand)

/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp:383:46:   required from int test_batched_gemm() [with DeviceType = Kokkos::OpenMP; ValueType = float; ScalarType = float; ParamTagType = Test::SharedParamTag]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm_Real.hpp:9:62:   required from here
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/KokkosKernels_PullRequest_GCC720_Light_LayoutRight.769/TestAll_2022-07-19_16.54.15/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:171:25: error: invalid use of incomplete type struct Kokkos::Impl::show_name_of_invalid_execution_policy_trait
   static constexpr auto trigger_error_message =
                         ^~~~~~~~~~~~~~~~~~~~~
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/KokkosKernels_PullRequest_GCC720_Light_LayoutRight.769/TestAll_2022-07-19_16.54.15/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:168:8: note: declaration of struct Kokkos::Impl::show_name_of_invalid_execution_policy_trait
 struct show_name_of_invalid_execution_policy_trait;
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/KokkosKernels_PullRequest_GCC720_Light_LayoutRight.769/TestAll_2022-07-19_16.54.15/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp: In instantiation of constexpr Kokkos::Impl::AnalyzeExecPolicyUseMatcher, Kokkos::LayoutRight, Kokkos::OpenMP>::trigger_error_message:
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/KokkosKernels_PullRequest_GCC720_Light_LayoutRight.769/TestAll_2022-07-19_16.54.15/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:171:25:   required from struct Kokkos::Impl::AnalyzeExecPolicyUseMatcher, Kokkos::LayoutRight, Kokkos::OpenMP>
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/KokkosKernels_PullRequest_GCC720_Light_LayoutRight.769/TestAll_2022-07-19_16.54.15/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:156:8:   [ skipping 2 instantiation contexts, use -ftemplate-backtrace-limit=0 to disable ]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/KokkosKernels_PullRequest_GCC720_Light_LayoutRight.769/TestAll_2022-07-19_16.54.15/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:156:8:   recursively required from struct Kokkos::Impl::AnalyzeExecPolicyUseMatcher, Kokkos::LayoutRight, Kokkos::OpenMP>
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/KokkosKernels_PullRequest_GCC720_Light_LayoutRight.769/TestAll_2022-07-19_16.54.15/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:156:8:   required from struct Kokkos::Impl::AnalyzeExecPolicyUseMatcher, Kokkos::LayoutRight, Kokkos::OpenMP>
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/KokkosKernels_PullRequest_GCC720_Light_LayoutRight.769/TestAll_2022-07-19_16.54.15/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:91:8:   required from struct Kokkos::Impl::AnalyzeExecPolicy
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/KokkosKernels_PullRequest_GCC720_Light_LayoutRight.769/TestAll_2022-07-19_16.54.15/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:194:8:   required from struct Kokkos::Impl::ExecPolicyTraitsWithDefaults >
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/KokkosKernels_PullRequest_GCC720_Light_LayoutRight.769/TestAll_2022-07-19_16.54.15/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:218:8:   required from struct Kokkos::Impl::PolicyTraits
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/KokkosKernels_PullRequest_GCC720_Light_LayoutRight.769/TestAll_2022-07-19_16.54.15/gcc/7.2.0/OpenMP-release/kokkos-install/include/Kokkos_ExecPolicy.hpp:546:7:   required from class Kokkos::TeamPolicy
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/kokkos-kernels/src/batched/dense/impl/KokkosBatched_Gemm_DblBuf_Impl.hpp:121:58:   required from void KokkosBatched::Impl::BatchedDblBufGemm::__run() [with ArgTransA = KokkosBatched::Trans::NoTranspose; ArgTransB = KokkosBatched::Trans::NoTranspose; ArgBatchSzDim = KokkosBatched::BatchLayout::Left; HandleType = KokkosBatched::BatchedGemmHandle; ScalarType = float; AViewType = Kokkos::View; BViewType = Kokkos::View; CViewType = Kokkos::View; ArgBoundsCheck = KokkosBatched::BoundsCheck::Yes; ArgAlphaFmaTag = KokkosBatched::AlphaTag::No; int TILE_M = 65536; int TILE_N = 1; int TILE_K = 65536]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/kokkos-kernels/src/batched/dense/impl/KokkosBatched_Gemm_DblBuf_Impl.hpp:114:10:   required from int KokkosBatched::Impl::BatchedDblBufGemm::invoke() [with ArgTransA = KokkosBatched::Trans::NoTranspose; ArgTransB = KokkosBatched::Trans::NoTranspose; ArgBatchSzDim = KokkosBatched::BatchLayout::Left; HandleType = KokkosBatched::BatchedGemmHandle; ScalarType = float; AViewType = Kokkos::View; BViewType = Kokkos::View; CViewType = Kokkos::View; ArgBoundsCheck = KokkosBatched::BoundsCheck::Yes; ArgAlphaFmaTag = KokkosBatched::AlphaTag::No; int TILE_M = 65536; int TILE_N = 1; int TILE_K = 65536]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp:74:7:   required from void Test::impl_test_batched_gemm_with_handle(KokkosBatched::BatchedGemmHandle*, int, int, int, int, int, int, int, ScalarType, ScalarType) [with DeviceType = Kokkos::OpenMP; ViewType = Kokkos::View; ScalarType = float; ParamTagType = Test::SharedParamTag]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp:252:59:   required from void Test::impl_test_batched_gemm(int, int, int, int, int, int, int) [with DeviceType = Kokkos::OpenMP; ViewType = Kokkos::View; ScalarType = float; ParamTagType = Test::SharedParamTag]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp:306:47:   required from void test_batched_gemm_with_layout(int) [with ViewType = Kokkos::View; DeviceType = Kokkos::OpenMP; ValueType = float; ScalarType = float; ParamTagType = Test::SharedParamTag]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm.hpp:383:46:   required from int test_batched_gemm() [with DeviceType = Kokkos::OpenMP; ValueType = float; ScalarType = float; ParamTagType = Test::SharedParamTag]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/kokkos-kernels/unit_test/batched/dense/Test_Batched_BatchedGemm_Real.hpp:9:62:   required from here
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/KokkosKernels_PullRequest_GCC720_Light_LayoutRight.769/TestAll_2022-07-19_16.54.15/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:171:25: error: invalid use of incomplete type struct Kokkos::Impl::show_name_of_invalid_execution_policy_trait
   static constexpr auto trigger_error_message =
                         ^~~~~~~~~~~~~~~~~~~~~
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/KokkosKernels_PullRequest_GCC720_Light_LayoutRight.769/TestAll_2022-07-19_16.54.15/gcc/7.2.0/OpenMP-release/kokkos-install/include/impl/Kokkos_AnalyzePolicy.hpp:168:8: note: declaration of struct Kokkos::Impl::show_name_of_invalid_execution_policy_trait
 struct show_name_of_invalid_execution_policy_trait;
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[ 82%] Linking CXX executable KokkosBlas3_gemm_perf_test
[ 82%] Built target KokkosBlas3_gemm_perf_test
make[2]: *** [unit_test/CMakeFiles/KokkosKernels_batched_dla_openmp.dir/openmp/Test_OpenMP_Batched_Dense.cpp.o] Error 1
make[1]: *** [unit_test/CMakeFiles/KokkosKernels_batched_dla_openmp.dir/all] Error 2
[ 82%] Linking CXX executable KokkosKernels_batched_sla_openmp
[ 82%] Built target KokkosKernels_batched_sla_openmp
[ 82%] Linking CXX executable sparse_kk_spmv
[ 82%] Built target sparse_kk_spmv
[ 83%] Linking CXX executable sparse_spmv_bsr
[ 83%] Built target sparse_spmv_bsr
[ 83%] Linking CXX executable KokkosKernels_common_openmp
[ 83%] Built target KokkosKernels_common_openmp
[ 83%] Linking CXX executable KokkosKernels_blas_openmp
[ 83%] Built target KokkosKernels_blas_openmp
[ 84%] Linking CXX executable KokkosKernels_sparse_openmp
[ 84%] Built target KokkosKernels_sparse_openmp
make: *** [all] Error 2
#######################################################
PASSED TESTS
#######################################################
#######################################################
FAILED TESTS
#######################################################
gcc-7.2.0-OpenMP-release (build failed)
#######################################################
  # Reproducer instructions:
  #   Load modules:
        source /etc/profile.d/modules.sh
        module purge
        module load cmake/3.19.3 gcc/7.2.0

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=OpenMP --arch=SKX --compiler=/home/projects/x86-64/gcc/7.2.0/bin/g++ --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wignored-qualifiers -Wempty-body -Wclobbered -Wuninitialized " --cxxstandard="14" --ldflags="" --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutRight --with-tpls= --with-options= --with-cuda-options= --with-spaces=hostspace --no-examples --no-default-eti

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

  # Move to the build directory
    cd /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/KokkosKernels_PullRequest_GCC720_Light_LayoutRight.769/TestAll_2022-07-19_16.54.15/gcc/7.2.0/OpenMP-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################
gcc-7.2.0-Threads_Serial-release (build failed)
#######################################################

Reproducer instructions:

Load modules:

    source /etc/profile.d/modules.sh
    module purge
    module load cmake/3.19.3 gcc/7.2.0

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=Threads,Serial --arch=SKX --compiler=/home/projects/x86-64/gcc/7.2.0/bin/g++ --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wignored-qualifiers -Wempty-body -Wclobbered -Wuninitialized " --cxxstandard="14" --ldflags="" --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutRight --with-tpls= --with-options= --with-cuda-options= --with-spaces=hostspace --no-examples --no-default-eti

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

  # Move to the build directory
    cd /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_GCC720_Light_LayoutRight/KokkosKernels_PullRequest_GCC720_Light_LayoutRight.769/TestAll_2022-07-19_16.54.15/gcc/7.2.0/Threads_Serial-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################
srun: error: blake20: task 0: Exited with exit code 2
Build step 'Execute shell' marked build as failure
Finished: FAILURE

Console Output (last 100 lines) : KokkosKernels_PullRequest_Tpls_GCC720 # 1113 (click to expand)

[ 77%] Linking CXX executable sparse_spadd
Scanning dependencies of target sparse_spmv_bsr
[ 78%] Linking CXX executable sparse_spgemm_jacobi
[ 79%] Building CXX object perf_test/sparse/CMakeFiles/sparse_spmv_bsr.dir/KokkosSparse_spmv_bsr.cpp.o
[ 79%] Built target sparse_spadd
[ 79%] Linking CXX executable sparse_spmv_blockcrs
[ 79%] Built target sparse_spgemm_jacobi
[ 79%] Linking CXX executable graph_mis_d2
[ 79%] Built target sparse_spmv_blockcrs
[ 79%] Built target graph_mis_d2
Scanning dependencies of target sparse_sptrsv_cholmod
[ 79%] Building CXX object perf_test/sparse/CMakeFiles/sparse_sptrsv_cholmod.dir/KokkosSparse_sptrsv_cholmod.cpp.o
[ 79%] Linking CXX executable sparse_gs
Scanning dependencies of target sparse_spmv
[ 79%] Building CXX object perf_test/sparse/CMakeFiles/sparse_spmv.dir/KokkosSparse_spmv.cpp.o
Scanning dependencies of target sparse_spiluk
[ 79%] Building CXX object perf_test/sparse/CMakeFiles/sparse_spiluk.dir/KokkosSparse_spiluk.cpp.o
[ 79%] Built target sparse_gs
[ 80%] Building CXX object perf_test/sparse/CMakeFiles/sparse_spmv.dir/KokkosSparse_spmv_test.cpp.o
Scanning dependencies of target KokkosBlas_dot_perf_test
[ 81%] Building CXX object perf_test/blas/blas1/CMakeFiles/KokkosBlas_dot_perf_test.dir/KokkosBlas_dot_perf_test.cpp.o
[ 81%] Linking CXX executable sparse_sptrsv_supernode
[ 81%] Built target sparse_sptrsv_supernode
[ 81%] Building CXX object perf_test/sparse/CMakeFiles/sparse_spmv.dir/spmv/OpenMPSmartStatic_SPMV.cpp.o
Scanning dependencies of target KokkosBlas_perf_test
[ 81%] Building CXX object perf_test/blas/blas1/CMakeFiles/KokkosBlas_perf_test.dir/KokkosBlas_perf_test.cpp.o
[ 82%] Linking CXX executable sparse_sptrsv_cholmod
[ 82%] Built target sparse_sptrsv_cholmod
Scanning dependencies of target KokkosBlas_dot_mv_perf_test
[ 82%] Building CXX object perf_test/blas/blas1/CMakeFiles/KokkosBlas_dot_mv_perf_test.dir/KokkosBlas_dot_mv_perf_test.cpp.o
In file included from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_GCC720/KokkosKernels_PullRequest_Tpls_GCC720.1113/TestAll_2022-07-19_16.54.24/gcc/7.2.0/OpenMP_Serial-release/kokkos-install/include/Kokkos_Parallel.hpp:63:0,
                 from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_GCC720/KokkosKernels_PullRequest_Tpls_GCC720.1113/TestAll_2022-07-19_16.54.24/gcc/7.2.0/OpenMP_Serial-release/kokkos-install/include/Kokkos_OpenMP.hpp:71,
                 from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_GCC720/KokkosKernels_PullRequest_Tpls_GCC720.1113/TestAll_2022-07-19_16.54.24/gcc/7.2.0/OpenMP_Serial-release/kokkos-install/include/decl/Kokkos_Declare_OPENMP.hpp:49,
                 from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_GCC720/KokkosKernels_PullRequest_Tpls_GCC720.1113/TestAll_2022-07-19_16.54.24/gcc/7.2.0/OpenMP_Serial-release/kokkos-install/include/KokkosCore_Config_DeclareBackend.hpp:47,
                 from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_GCC720/KokkosKernels_PullRequest_Tpls_GCC720.1113/TestAll_2022-07-19_16.54.24/gcc/7.2.0/OpenMP_Serial-release/kokkos-install/include/Kokkos_Core.hpp:57,
                 from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_GCC720/kokkos-kernels/src/common/KokkosKernels_default_types.hpp:48,
                 from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_GCC720/kokkos-kernels/perf_test/blas/blas1/KokkosBlas_common.hpp:46,
                 from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_GCC720/kokkos-kernels/perf_test/blas/blas1/KokkosBlas_perf_test.cpp:44:
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_GCC720/KokkosKernels_PullRequest_Tpls_GCC720.1113/TestAll_2022-07-19_16.54.24/gcc/7.2.0/OpenMP_Serial-release/kokkos-install/include/Kokkos_View.hpp: In instantiation of Kokkos::View::View(Kokkos::View::pointer_type, size_t, size_t, size_t, size_t, size_t, size_t, size_t, size_t) [with DataType = int; Properties = {Kokkos::LayoutStride, Kokkos::HostSpace, Kokkos::MemoryTraits<1>}; Kokkos::View::pointer_type = int*; size_t = long unsigned int]:
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_GCC720/kokkos-kernels/src/blas/KokkosBlas_trtri.hpp:136:25:   required from int KokkosBlas::trtri(const char*, const char*, const AViewType&) [with AViewType = Kokkos::View, Kokkos::MemoryTraits<0> >]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_GCC720/kokkos-kernels/perf_test/blas/blas3/KokkosBlas_trtri_perf_test.hpp:214:24:   required from void __do_trtri_serial_blas(options_t, trtri_args_t) [with scalar_type = double; vta = Kokkos::View; device_type = Kokkos::OpenMP; options_t = perf_test_options; trtri_args_t = trtri_args]
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_GCC720/kokkos-kernels/perf_test/blas/blas3/KokkosBlas_trtri_perf_test.hpp:552:75:   required from here
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_GCC720/KokkosKernels_PullRequest_Tpls_GCC720.1113/TestAll_2022-07-19_16.54.24/gcc/7.2.0/OpenMP_Serial-release/kokkos-install/include/Kokkos_View.hpp:1658:5: error: static assertion failed: Layout is not constructible from extent arguments. Use overload taking a layout object instead.
     static_assert(traits::array_layout::is_extent_constructible,
     ^~~~~~~~~~~~~
[ 82%] Linking CXX executable graph_color_d2
[ 82%] Linking CXX executable graph_color
make[2]: *** [perf_test/blas/blas1/CMakeFiles/KokkosBlas_perf_test.dir/KokkosBlas_perf_test.cpp.o] Error 1
make[1]: *** [perf_test/blas/blas1/CMakeFiles/KokkosBlas_perf_test.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
[ 82%] Built target graph_color_d2
[ 82%] Linking CXX executable sparse_spmv_struct_tuning
[ 82%] Built target graph_color
[ 82%] Built target sparse_spmv_struct_tuning
[ 82%] Linking CXX executable sparse_spmv
[ 82%] Linking CXX executable sparse_spiluk
[ 82%] Built target sparse_spmv
[ 82%] Built target sparse_spiluk
[ 82%] Linking CXX executable KokkosBlas_dot_perf_test
[ 82%] Built target KokkosBlas_dot_perf_test
[ 82%] Linking CXX executable sparse_block_pcg
[ 82%] Built target sparse_block_pcg
[ 82%] Linking CXX executable sparse_spmv_bsr
[ 82%] Built target sparse_spmv_bsr
[ 82%] Linking CXX executable KokkosBlas_dot_mv_perf_test
[ 82%] Built target KokkosBlas_dot_mv_perf_test
[ 82%] Linking CXX executable sparse_kk_spmv
[ 82%] Built target sparse_kk_spmv
make: *** [all] Error 2
#######################################################
PASSED TESTS
#######################################################
#######################################################
FAILED TESTS
#######################################################
gcc-7.2.0-OpenMP_Serial-release (build failed)
#######################################################
  # Reproducer instructions:
  #   Load modules:
        source /etc/profile.d/modules.sh
        module purge
        module load cmake/3.19.3 gcc/7.2.0 openblas/0.2.20/gcc/7.2.0

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=OpenMP,Serial --arch=SKX --compiler=/home/projects/x86-64/gcc/7.2.0/bin/g++ --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wignored-qualifiers -Wempty-body -Wclobbered -Wuninitialized " --cxxstandard="14" --ldflags="" --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutLeft --with-tpls=blas --user-blas-path=/home/projects/x86-64-skylake/openblas/0.2.20/gcc/7.2.0/lib --user-lapack-path=/home/projects/x86-64-skylake/openblas/0.2.20/gcc/7.2.0/lib --user-blas-lib=blas --user-lapack-lib=lapack --extra-linker-flags=-lgfortran,-lm --with-options= --with-cuda-options= --no-examples

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

  # Move to the build directory
    cd /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_GCC720/KokkosKernels_PullRequest_Tpls_GCC720.1113/TestAll_2022-07-19_16.54.24/gcc/7.2.0/OpenMP_Serial-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################
srun: error: blake01: task 0: Exited with exit code 1
Build step 'Execute shell' marked build as failure
Finished: FAILURE

Console Output (last 100 lines) : KokkosKernels_PullRequest_Tpls_INTEL18 # 1100 (click to expand)

            instantiation of "void __do_gemm_parallel_batched_heuristic(options_t, gemm_args_t) [with algo_tag=void, blocking_type=void, device_type=default_device, algo_mode=void]" at line 2270 of "/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_gemm_perf_test.hpp"

/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/kokkos-kernels/src/batched/dense/impl/KokkosBatched_Gemm_DblBuf_Impl.hpp(156): error: no instance of function template "Kokkos::TeamPolicy<Properties...>::team_size_max [with Properties=<std::conditional_t<true, default_layout, Kokkos::Threads::array_layout>, Kokkos::HostSpace::execution_space>]" matches the argument list
argument types are: (functor_type, Kokkos::ParallelForTag)
object type is: policy_type
.team_size_max(functor, Kokkos::ParallelForTag());
^
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/KokkosKernels_PullRequest_Tpls_INTEL18.1100/TestAll_2022-07-19_16.54.35/intel/18.1.163/Threads-release/kokkos-install/include/Kokkos_ExecPolicy.hpp(316): note: this candidate was rejected because mismatch in count of arguments
static int team_size_max(const FunctorType&);
^
detected during:
instantiation of "void KokkosBatched::Impl::BatchedDblBufGemm<ArgTransA, ArgTransB, ArgBatchSzDim, HandleType, ScalarType, AViewType, BViewType, CViewType, ArgBoundsCheck, ArgAlphaFmaTag, TILE_M, TILE_N, TILE_K>::__run() [with ArgTransA=KokkosBatched::Trans::Transpose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Left, HandleType=KokkosBatched::BatchedGemmHandle, ScalarType=default_scalar={double}, AViewType=view_type_3d,
BViewType=view_type_3d, CViewType=view_type_3d, ArgBoundsCheck=KokkosBatched::BoundsCheck::Yes, ArgAlphaFmaTag=KokkosBatched::AlphaTag::No, TILE_M=32, TILE_N=32, TILE_K=8]" at line 114
instantiation of "int KokkosBatched::Impl::BatchedDblBufGemm<ArgTransA, ArgTransB, ArgBatchSzDim, HandleType, ScalarType, AViewType, BViewType, CViewType, ArgBoundsCheck, ArgAlphaFmaTag, TILE_M, TILE_N, TILE_K>::invoke() [with ArgTransA=KokkosBatched::Trans::Transpose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Left, HandleType=KokkosBatched::BatchedGemmHandle, ScalarType=default_scalar={double}, AViewType=view_type_3d,
BViewType=view_type_3d, CViewType=view_type_3d, ArgBoundsCheck=KokkosBatched::BoundsCheck::Yes, ArgAlphaFmaTag=KokkosBatched::AlphaTag::No, TILE_M=32, TILE_N=32, TILE_K=8]" at line 565 of "/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/kokkos-kernels/src/batched/dense/KokkosBatched_Gemm_Decl.hpp"
instantiation of "int KokkosBatched::BatchedGemm<ArgTransA,ArgTransB,ArgBatchSzDim,BatchedGemmHandleType,ScalarType,AViewType,BViewType,CViewType>(BatchedGemmHandleType *, ScalarType, const AViewType &, const BViewType &, ScalarType, const CViewType &) [with ArgTransA=KokkosBatched::Trans::Transpose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Left, BatchedGemmHandleType=KokkosBatched::BatchedGemmHandle, ScalarType=default_scalar={double},
AViewType=view_type_3d, BViewType=view_type_3d, CViewType=view_type_3d]" at line 568 of "/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_gemm_perf_test.hpp"
instantiation of "void __do_gemm_parallel_batched_heuristic_template<algo_tag,blocking_type,device_type,algo_mode>(options_t, gemm_args_t) [with algo_tag=void, blocking_type=void, device_type=default_device, algo_mode=void]" at line 591 of "/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_gemm_perf_test.hpp"
instantiation of "void __do_gemm_parallel_batched_heuristic<algo_tag,blocking_type,device_type,algo_mode>(options_t, gemm_args_t) [with algo_tag=void, blocking_type=void, device_type=default_device, algo_mode=void]" at line 2270 of "/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_gemm_perf_test.hpp"

/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/kokkos-kernels/src/batched/dense/impl/KokkosBatched_Gemm_DblBuf_Impl.hpp(156): error: no instance of function template "Kokkos::TeamPolicy<Properties...>::team_size_max [with Properties=<std::conditional_t<true, default_layout, Kokkos::Threads::array_layout>, Kokkos::HostSpace::execution_space>]" matches the argument list
argument types are: (functor_type, Kokkos::ParallelForTag)
object type is: policy_type
.team_size_max(functor, Kokkos::ParallelForTag());
^
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/KokkosKernels_PullRequest_Tpls_INTEL18.1100/TestAll_2022-07-19_16.54.35/intel/18.1.163/Threads-release/kokkos-install/include/Kokkos_ExecPolicy.hpp(316): note: this candidate was rejected because mismatch in count of arguments
static int team_size_max(const FunctorType&);
^
detected during:
instantiation of "void KokkosBatched::Impl::BatchedDblBufGemm<ArgTransA, ArgTransB, ArgBatchSzDim, HandleType, ScalarType, AViewType, BViewType, CViewType, ArgBoundsCheck, ArgAlphaFmaTag, TILE_M, TILE_N, TILE_K>::__run() [with ArgTransA=KokkosBatched::Trans::Transpose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Left, HandleType=KokkosBatched::BatchedGemmHandle, ScalarType=default_scalar={double}, AViewType=view_type_3d,
BViewType=view_type_3d, CViewType=view_type_3d, ArgBoundsCheck=KokkosBatched::BoundsCheck::Yes, ArgAlphaFmaTag=KokkosBatched::AlphaTag::No, TILE_M=1, TILE_N=1, TILE_K=1]" at line 114
instantiation of "int KokkosBatched::Impl::BatchedDblBufGemm<ArgTransA, ArgTransB, ArgBatchSzDim, HandleType, ScalarType, AViewType, BViewType, CViewType, ArgBoundsCheck, ArgAlphaFmaTag, TILE_M, TILE_N, TILE_K>::invoke() [with ArgTransA=KokkosBatched::Trans::Transpose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Left, HandleType=KokkosBatched::BatchedGemmHandle, ScalarType=default_scalar={double}, AViewType=view_type_3d,
BViewType=view_type_3d, CViewType=view_type_3d, ArgBoundsCheck=KokkosBatched::BoundsCheck::Yes, ArgAlphaFmaTag=KokkosBatched::AlphaTag::No, TILE_M=1, TILE_N=1, TILE_K=1]" at line 634 of "/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/kokkos-kernels/src/batched/dense/KokkosBatched_Gemm_Decl.hpp"
instantiation of "int KokkosBatched::BatchedGemm<ArgTransA,ArgTransB,ArgBatchSzDim,BatchedGemmHandleType,ScalarType,AViewType,BViewType,CViewType>(BatchedGemmHandleType *, ScalarType, const AViewType &, const BViewType &, ScalarType, const CViewType &) [with ArgTransA=KokkosBatched::Trans::Transpose, ArgTransB=KokkosBatched::Trans::Transpose, ArgBatchSzDim=KokkosBatched::BatchLayout::Left, BatchedGemmHandleType=KokkosBatched::BatchedGemmHandle, ScalarType=default_scalar={double},
AViewType=view_type_3d, BViewType=view_type_3d, CViewType=view_type_3d]" at line 568 of "/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_gemm_perf_test.hpp"
instantiation of "void __do_gemm_parallel_batched_heuristic_template<algo_tag,blocking_type,device_type,algo_mode>(options_t, gemm_args_t) [with algo_tag=void, blocking_type=void, device_type=default_device, algo_mode=void]" at line 591 of "/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_gemm_perf_test.hpp"
instantiation of "void __do_gemm_parallel_batched_heuristic<algo_tag,blocking_type,device_type,algo_mode>(options_t, gemm_args_t) [with algo_tag=void, blocking_type=void, device_type=default_device, algo_mode=void]" at line 2270 of "/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_gemm_perf_test.hpp"

[ 80%] Built target KokkosBlas2_gemv_perf_test
compilation aborted for /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_perf_test.cpp (code 2)
make[2]: *** [perf_test/blas/blas3/CMakeFiles/KokkosBlas3_perf_test.dir/KokkosBlas3_perf_test.cpp.o] Error 2
make[1]: *** [perf_test/blas/blas3/CMakeFiles/KokkosBlas3_perf_test.dir/all] Error 2
[ 80%] Linking CXX executable sparse_kk_spmv
[ 80%] Built target sparse_kk_spmv
[ 80%] Linking CXX executable sparse_spmv_struct_tuning
[ 80%] Built target sparse_spmv_struct_tuning
make: *** [all] Error 2
#######################################################
PASSED TESTS
#######################################################
#######################################################
FAILED TESTS
#######################################################
intel-18.1.163-OpenMP-release (build failed)
#######################################################

Reproducer instructions:

Load modules:

    source /etc/profile.d/modules.sh
    module purge
    module load cmake/3.19.3 intel/compilers/18.1.163

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=OpenMP --arch=SKX --compiler=/home/projects/x86-64/intel/compilers/2018/compilers_and_libraries_2018.1.163/linux/bin/intel64/icpc --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wuninitialized " --cxxstandard="14" --ldflags="" --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutLeft --with-tpls=mkl --with-options= --with-cuda-options= --no-examples

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

  # Move to the build directory
    cd /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/KokkosKernels_PullRequest_Tpls_INTEL18.1100/TestAll_2022-07-19_16.54.35/intel/18.1.163/OpenMP-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################
intel-18.1.163-Threads-release (build failed)
#######################################################

Reproducer instructions:

Load modules:

    source /etc/profile.d/modules.sh
    module purge
    module load cmake/3.19.3 intel/compilers/18.1.163

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=Threads --arch=SKX --compiler=/home/projects/x86-64/intel/compilers/2018/compilers_and_libraries_2018.1.163/linux/bin/intel64/icpc --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wuninitialized " --cxxstandard="14" --ldflags="" --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutLeft --with-tpls=mkl --with-options= --with-cuda-options= --no-examples

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

  # Move to the build directory
    cd /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_Tpls_INTEL18/KokkosKernels_PullRequest_Tpls_INTEL18.1100/TestAll_2022-07-19_16.54.35/intel/18.1.163/Threads-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################
srun: error: blake02: task 0: Exited with exit code 2
Build step 'Execute shell' marked build as failure
Finished: FAILURE

Console Output (last 100 lines) : KokkosKernels_PullRequest_CLANG1001 # 505 (click to expand)

In file included from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_common.hpp:46:
In file included from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/kokkos-kernels/src/common/KokkosKernels_default_types.hpp:48:
In file included from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.505/TestAll_2022-07-19_16.54.46/clang/10.0.1/Threads_Serial-release/kokkos-install/include/Kokkos_Core.hpp:57:
In file included from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.505/TestAll_2022-07-19_16.54.46/clang/10.0.1/Threads_Serial-release/kokkos-install/include/KokkosCore_Config_DeclareBackend.hpp:47:
In file included from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.505/TestAll_2022-07-19_16.54.46/clang/10.0.1/Threads_Serial-release/kokkos-install/include/decl/Kokkos_Declare_THREADS.hpp:49:
In file included from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.505/TestAll_2022-07-19_16.54.46/clang/10.0.1/Threads_Serial-release/kokkos-install/include/Kokkos_Threads.hpp:202:
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.505/TestAll_2022-07-19_16.54.46/clang/10.0.1/Threads_Serial-release/kokkos-install/include/Threads/Kokkos_ThreadsTeam.hpp:595:26: error: no type named 'execution_space' in 'Kokkos::Impl::PolicyTraits'
  const typename traits::execution_space& space() const {
        ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.505/TestAll_2022-07-19_16.54.46/clang/10.0.1/Threads_Serial-release/kokkos-install/include/Threads/Kokkos_Threads_Parallel_Team.hpp:59:28: note: in instantiation of template class 'Kokkos::Impl::TeamPolicyInternal' requested here
  using WorkTag = typename Policy::work_tag;
                           ^
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.505/TestAll_2022-07-19_16.54.46/clang/10.0.1/Threads_Serial-release/kokkos-install/include/Kokkos_Parallel.hpp:173:46: note: in instantiation of template class 'Kokkos::Impl::ParallelFor, 8> ***, Kokkos::LayoutLeft, Kokkos::Threads>, Kokkos::View, 8> ***, Kokkos::LayoutLeft, Kokkos::Threads>, Kokkos::View, 8> ***, Kokkos::LayoutLeft, Kokkos::Threads>, KokkosBatched::BoundsCheck::No, KokkosBatched::AlphaTag::Yes, 32, 32, 8>::Functor, Kokkos::TeamPolicy, Kokkos::Threads>' requested here
  Impl::ParallelFor closure(functor, inner_policy);
                                             ^
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/kokkos-kernels/src/batched/dense/impl/KokkosBatched_Gemm_DblBuf_Impl.hpp:197:13: note: in instantiation of function template specialization 'Kokkos::parallel_for, KokkosBatched::Impl::BatchedDblBufGemm, 8> ***, Kokkos::LayoutLeft, Kokkos::Threads>, Kokkos::View, 8> ***, Kokkos::LayoutLeft, Kokkos::Threads>, Kokkos::View, 8> ***, Kokkos::LayoutLeft, Kokkos::Threads>, KokkosBatched::BoundsCheck::No, KokkosBatched::AlphaTag::Yes, 32, 32, 8>::Functor, void>' requested here
    Kokkos::parallel_for("BatchedDblBufGemm", team_policy, functor);
            ^
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/kokkos-kernels/src/batched/dense/impl/KokkosBatched_Gemm_DblBuf_Impl.hpp:114:5: note: in instantiation of member function 'KokkosBatched::Impl::BatchedDblBufGemm, 8> ***, Kokkos::LayoutLeft, Kokkos::Threads>, Kokkos::View, 8> ***, Kokkos::LayoutLeft, Kokkos::Threads>, Kokkos::View, 8> ***, Kokkos::LayoutLeft, Kokkos::Threads>, KokkosBatched::BoundsCheck::No, KokkosBatched::AlphaTag::Yes, 32, 32, 8>::__run' requested here
    __run();
    ^
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/kokkos-kernels/src/batched/dense/KokkosBatched_Gemm_Decl.hpp:539:22: note: in instantiation of member function 'KokkosBatched::Impl::BatchedDblBufGemm, 8> ***, Kokkos::LayoutLeft, Kokkos::Threads>, Kokkos::View, 8> ***, Kokkos::LayoutLeft, Kokkos::Threads>, Kokkos::View, 8> ***, Kokkos::LayoutLeft, Kokkos::Threads>, KokkosBatched::BoundsCheck::No, KokkosBatched::AlphaTag::Yes, 32, 32, 8>::invoke' requested here
                    .invoke();
                     ^
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_gemm_perf_test.hpp:497:24: note: in instantiation of function template specialization 'KokkosBatched::BatchedGemm, 8> ***, Kokkos::LayoutLeft, Kokkos::Threads>, Kokkos::View, 8> ***, Kokkos::LayoutLeft, Kokkos::Threads>, Kokkos::View, 8> ***, Kokkos::LayoutLeft, Kokkos::Threads> >' requested here
        KokkosBatched::BatchedGemm(
                       ^
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_gemm_perf_test.hpp:589:5: note: in instantiation of function template specialization '__do_gemm_parallel_batched_heuristic_template' requested here
    __do_gemm_parallel_batched_heuristic_template' requested here
      __do_gemm_parallel_batched_heuristic);
      ^
In file included from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_perf_test.cpp:44:
In file included from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/kokkos-kernels/perf_test/blas/blas3/KokkosBlas3_common.hpp:46:
In file included from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/kokkos-kernels/src/common/KokkosKernels_default_types.hpp:48:
In file included from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.505/TestAll_2022-07-19_16.54.46/clang/10.0.1/Threads_Serial-release/kokkos-install/include/Kokkos_Core.hpp:57:
In file included from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.505/TestAll_2022-07-19_16.54.46/clang/10.0.1/Threads_Serial-release/kokkos-install/include/KokkosCore_Config_DeclareBackend.hpp:47:
In file included from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.505/TestAll_2022-07-19_16.54.46/clang/10.0.1/Threads_Serial-release/kokkos-install/include/decl/Kokkos_Declare_THREADS.hpp:49:
In file included from /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.505/TestAll_2022-07-19_16.54.46/clang/10.0.1/Threads_Serial-release/kokkos-install/include/Kokkos_Threads.hpp:202:
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.505/TestAll_2022-07-19_16.54.46/clang/10.0.1/Threads_Serial-release/kokkos-install/include/Threads/Kokkos_ThreadsTeam.hpp:682:45: error: no type named 'execution_space' in 'Kokkos::Impl::PolicyTraits'
  TeamPolicyInternal(const typename traits::execution_space&,
                           ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.505/TestAll_2022-07-19_16.54.46/clang/10.0.1/Threads_Serial-release/kokkos-install/include/Threads/Kokkos_ThreadsTeam.hpp:698:45: error: no type named 'execution_space' in 'Kokkos::Impl::PolicyTraits'
  TeamPolicyInternal(const typename traits::execution_space& space,
                           ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.505/TestAll_2022-07-19_16.54.46/clang/10.0.1/Threads_Serial-release/kokkos-install/include/Threads/Kokkos_ThreadsTeam.hpp:706:45: error: no type named 'execution_space' in 'Kokkos::Impl::PolicyTraits'
  TeamPolicyInternal(const typename traits::execution_space& space,
                           ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.505/TestAll_2022-07-19_16.54.46/clang/10.0.1/Threads_Serial-release/kokkos-install/include/Threads/Kokkos_ThreadsTeam.hpp:715:45: error: no type named 'execution_space' in 'Kokkos::Impl::PolicyTraits'
  TeamPolicyInternal(const typename traits::execution_space& space,
                           ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~
/home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.505/TestAll_2022-07-19_16.54.46/clang/10.0.1/Threads_Serial-release/kokkos-install/include/Threads/Kokkos_ThreadsTeam.hpp:751:24: error: no type named 'index_type' in 'Kokkos::Impl::PolicyTraits'
      typename traits::index_type chunk_size_) {
      ~~~~~~~~~~~~~~~~~^~~~~~~~~~
fatal error: too many errors emitted, stopping now [-ferror-limit=]
[ 84%] Built target KokkosBlas_dot_mv_perf_test
20 errors generated.
make[2]: *** [perf_test/blas/blas3/CMakeFiles/KokkosBlas3_perf_test.dir/KokkosBlas3_perf_test.cpp.o] Error 1
make[1]: *** [perf_test/blas/blas3/CMakeFiles/KokkosBlas3_perf_test.dir/all] Error 2
[ 84%] Linking CXX executable sparse_spmv_blockcrs
[ 84%] Built target sparse_spmv_blockcrs
[ 84%] Linking CXX executable KokkosBlas3_gemm_perf_test
[ 84%] Built target KokkosBlas3_gemm_perf_test
[ 84%] Linking CXX executable KokkosBlas2_gemv_perf_test
[ 84%] Built target KokkosBlas2_gemv_perf_test
[ 84%] Linking CXX executable sparse_kk_spmv
[ 84%] Built target sparse_kk_spmv
make: *** [all] Error 2
#######################################################
PASSED TESTS
#######################################################
#######################################################
FAILED TESTS
#######################################################
clang-10.0.1-Threads_Serial-release (build failed)
#######################################################
  # Reproducer instructions:
  #   Load modules:
        source /etc/profile.d/modules.sh
        module purge
        module load cmake/3.19.3 clang/10.0.1

$KOKKOSKERNELS_PATH/cm_generate_makefile.bash --with-devices=Threads,Serial --arch=SKX --compiler=/home/projects/x86-64/spack/opt/spack/linux-rhel7-x86_64/gcc-10.2.0/llvm-10.0.1-nldepabrxk2zcykcq7rlky5sr53hnm63/bin/clang++ --cxxflags="-O3 -Wall -Wunused-parameter -Wshadow -pedantic -Werror -Wsign-compare -Wtype-limits -Wuninitialized " --cxxstandard="14" --ldflags="" --kokkos-path=$KOKKOS_PATH --kokkoskernels-path=$KOKKOSKERNELS_PATH --with-scalars='double,complex_double' --with-ordinals=int --with-offsets=int,size_t --with-layouts=LayoutLeft --with-tpls= --with-options= --with-cuda-options= --no-examples

To reload modules, reconfigure, rebuild, and retest directly from this failing build do the following:

  # Move to the build directory
    cd /home/jenkins/blake-new/workspace/KokkosKernels_PullRequest_CLANG1001/KokkosKernels_PullRequest_CLANG1001.505/TestAll_2022-07-19_16.54.46/clang/10.0.1/Threads_Serial-release
  # To reload modules
    source ./reload_modules.sh
  # To reconfigure
    ./call_generate_makefile.sh
  # To rebuild
    make -j
  # To retest
    ctest -V

#######################################################
srun: error: blake03: task 0: Exited with exit code 1
Build step 'Execute shell' marked build as failure
Finished: FAILURE

@lucbv
Copy link
Contributor Author

lucbv commented Jul 19, 2022

Ugh, looks like something broke in Kokkos?

@ndellingwood
Copy link
Contributor

@lucbv I ran into issues following merge of kokkos/kokkos#5209 triaging some stuff with Trilinos, possibly the same thing here?

@lucbv
Copy link
Contributor Author

lucbv commented Jul 19, 2022

@ndellingwood yes that broke something but the one above looks like it is due to PR #5230

For some kernels that return results in host views the
implementation is non-blocking and requires to do a
Kokkos::fence() before checking the value against the
reference value.
@lucbv
Copy link
Contributor Author

lucbv commented Jul 20, 2022

Rebased on develop after PR #1476 was merged, this should go through CI now...

@kokkos-devops-admin
Copy link

Status Flag 'Pre-Test Inspection' - Auto Inspected - Inspection Is Not Necessary for this Pull Request.

@kokkos-devops-admin
Copy link

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740

  • Build Num: 322
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 563d094
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 1f42ce6
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight

  • Build Num: 315
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 563d094
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 1f42ce6
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC720

  • Build Num: 1130
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 563d094
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 1f42ce6
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC720_Light_LayoutRight

  • Build Num: 774
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 563d094
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 1f42ce6
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC720

  • Build Num: 1118
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 563d094
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 1f42ce6
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL18

  • Build Num: 1105
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 563d094
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 1f42ce6
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

  • Build Num: 510
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 563d094
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 1f42ce6
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Using Repos:

Repo: KOKKOSKERNELS (lucbv/kokkos-kernels)
  • Branch: blas_mv_fix
  • SHA: 563d094
  • Mode: TEST_REPO

Pull Request Author: lucbv

@kokkos-devops-admin
Copy link

Status Flag 'Pull Request AutoTester' - Jenkins Testing: all Jobs PASSED

Pull Request Auto Testing has PASSED (click to expand)

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_CUDA9_GCC720_Light_Tpls_GCC720_GCC740

  • Build Num: 322
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 563d094
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 1f42ce6
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_CUDA10_Tpls_CUDA10_LayoutRight

  • Build Num: 315
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 563d094
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 1f42ce6
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC720

  • Build Num: 1130
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 563d094
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 1f42ce6
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC720_Light_LayoutRight

  • Build Num: 774
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 563d094
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 1f42ce6
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC720

  • Build Num: 1118
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 563d094
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 1f42ce6
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL18

  • Build Num: 1105
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 563d094
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 1f42ce6
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

  • Build Num: 510
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_BRANCH blas_mv_fix
KOKKOSKERNELS_SOURCE_REPO https://github.com/lucbv/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 563d094
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA 1f42ce6
PR_LABELS bug
PULLREQUESTNUM 1472
TEST_REPO_ALIAS KOKKOSKERNELS

@kokkos-devops-admin
Copy link

Status Flag 'Pre-Merge Inspection' - - This Pull Request Requires Inspection... The code must be inspected by a member of the Team before Testing/Merging
THE LAST COMMIT TO THIS PULL REQUEST HAS NOT BEEN REVIEWED YET!

@kokkos-devops-admin
Copy link

All Jobs Finished; status = PASSED, However Inspection must be performed before merge can occur...

@lucbv lucbv merged commit 3dd14b7 into kokkos:develop Jul 21, 2022
@lucbv lucbv deleted the blas_mv_fix branch July 21, 2022 16:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants