Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Compilation error on rzansel #401

Closed
jhux2 opened this issue Mar 22, 2019 · 15 comments
Closed

Compilation error on rzansel #401

jhux2 opened this issue Mar 22, 2019 · 15 comments

Comments

@jhux2
Copy link

jhux2 commented Mar 22, 2019

I'm attempting to compile Trilinos on rzansel at LLNL. I'm using a recipe that has worked for @csiefer2 on LLNL's lassen. The compile is failing in Kokkos-Kernels with this error:

error
1 [1/47] Building CXX object packages/kokkos-kernels/src/CMakeFiles/kokkoskernels.dir/impl/generated_specializations_cpp/gauss_seidel_apply/KokkosSparse_gauss_seidel_apply_eti_spec_inst_double_size_t_int_LayoutLeft_Serial_HostSpace_HostSpace.cpp.o
  2 FAILED: packages/kokkos-kernels/src/CMakeFiles/kokkoskernels.dir/impl/generated_specializations_cpp/gauss_seidel_apply/KokkosSparse_gauss_seidel_apply_eti_spec_inst_double_size_t_int_LayoutLeft_Serial_HostSpace_HostSpace.cpp.o
  3 /usr/tce/packages/spectrum-mpi/spectrum-mpi-rolling-release-xl-2019.02.07/bin/mpicxx -+  -I. -Ipackages/kokkos-kernels/src -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/impl -I/g/g20/hu21/sandbox/Trilinos/pac    kages/kokkos-kernels/src/impl/tpls -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/blas -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/blas/impl -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos    -kernels/src/sparse/impl -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/graph -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/graph/impl -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/batched -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernel    s/src/batched/impl -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/common -Ipackages/kokkos/algorithms/src -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos/algorithms/src -Ipackages/kokkos/containers/src -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos/containers/src -Ipac    kages/kokkos/core/src -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/impl/generated_specializations_hpp -qthreaded -std=c++11 -O -DNDEBUG -MF packages/kokkos-kernels/src/CMakeFiles/kokkoskernels.dir/impl/generate    d_specializations_cpp/gauss_seidel_apply/KokkosSparse_gauss_seidel_apply_eti_spec_inst_double_size_t_int_LayoutLeft_Serial_HostSpace_HostSpace.cpp.o.d -qmakedep=gcc -o packages/kokkos-kernels/src/CMakeFiles/kokkoskernels.dir/impl/generated_specializations_cpp/gauss_seidel_apply/K    okkosSparse_gauss_seidel_apply_eti_spec_inst_double_size_t_int_LayoutLeft_Serial_HostSpace_HostSpace.cpp.o -c /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/impl/generated_specializations_cpp/gauss_seidel_apply/KokkosSparse_gauss_seidel_apply_eti_spec_inst_double_size_t    _int_LayoutLeft_Serial_HostSpace_HostSpace.cpp
  4 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/graph/impl/KokkosGraph_GraphColor_impl.hpp(2633): error: no instance of function template "Kokkos::atomic_fetch_add" matches the argument list
  5             argument types are: (unsigned long *, int)
  6           detected during:
  7             instantiation of "void KokkosGraph::Impl::GraphColor_VBD<HandleType, lno_row_view_t_, lno_nnz_view_t_>::functorInitialDependency::operator()(int) const [with HandleType=KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::execution_spac    e, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<cons    t int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
  8 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Serial.hpp(476): here
  9             instantiation of "std::enable_if<std::is_same<TagType, void>::value, void>::type Kokkos::Impl::ParallelFor<FunctorType, Kokkos::RangePolicy<Traits...>, Kokkos::Serial>::exec<TagType>() const [with FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColorin    gHandle<const size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Ko    kkos::MemoryTraits<1U>>, Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>>::functorInitialDependency, Traits=<Kokkos::Serial::execution_space>, TagType=void]"
 10 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Serial.hpp(495): here
 11             instantiation of "void Kokkos::Impl::ParallelFor<FunctorType, Kokkos::RangePolicy<Traits...>, Kokkos::Serial>::execute() const [with FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::exec    ution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, Kokkos::View<const int *, Kokkos::Layou    tLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>>::functorInitialDependency, Traits=<Kokkos::Serial::execution_space>]"
 12 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Parallel.hpp(191): here
 13             instantiation of "void Kokkos::parallel_for(const ExecPolicy &, const FunctorType &, const std::string &, Kokkos::Impl::enable_if<Kokkos::is_execution_policy<ExecPolicy>::value, void>::type *) [with ExecPolicy=Kokkos::RangePolicy<Kokkos::Serial::execution_space>, Func    torType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokko    s::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>>::functorInitialDependency]"
 14 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Parallel.hpp(244): here
 15             instantiation of "void Kokkos::parallel_for(const std::string &, const ExecPolicy &, const FunctorType &) [with ExecPolicy=Kokkos::RangePolicy<Kokkos::Serial::execution_space>, FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t    , const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1    U>>, Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>>::functorInitialDependency]"
 16 (2522): here
 17             [ 2 instantiation contexts not shown ]
 18             instantiation of "void KokkosGraph::Experimental::graph_color_symbolic(KernelHandle *, KernelHandle::nnz_lno_t, KernelHandle::nnz_lno_t, lno_row_view_t_, lno_nnz_view_t_, __nv_bool) [with KernelHandle=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, cons    t int, const double, Kokkos::Serial, Kokkos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::Vie    w<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
 19 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(619): here
 20             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::initialize_symbolic() [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kok    kos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokko    s::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits    <1U>>]" 
 21 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(1085): here
 22             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::initialize_numeric() [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kokk    os::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos    ::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<    1U>>]"
 23 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(1500): here
 24             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::apply(x_value_array_type, y_value_array_type, __nv_bool, int, KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar    _nnz_view_t_>::nnz_scalar_t, __nv_bool, __nv_bool, __nv_bool) [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kokkos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::Layou    tLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::Memory    Traits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, x_value_array_type=Kokkos::View<double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::Ho    stSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, y_value_array_type=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]" 
 25 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_spec.hpp(314): here
 26             instantiation of "void KokkosSparse::Impl::GAUSS_SEIDEL_APPLY<KernelHandle, a_size_view_t_, a_lno_view_t, a_scalar_view_t, x_scalar_view_t, y_scalar_view_t, false, true>::gauss_seidel_apply(KernelHandle *, KernelHandle::const_nnz_lno_t, KernelHandle::const_nnz_lno_t,     a_size_view_t_, a_lno_view_t, a_scalar_view_t, x_scalar_view_t, y_scalar_view_t, __nv_bool, __nv_bool, KernelHandle::nnz_scalar_t, int, __nv_bool, __nv_bool) [with KernelHandle=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial,     Kokkos::HostSpace, Kokkos::HostSpace>, a_size_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, a_lno_view_t=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokko    s::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, a_scalar_view_t=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U    >>, x_scalar_view_t=Kokkos::View<double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, y_scalar_view_t=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execut    ion_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
 27 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/impl/generated_specializations_cpp/gauss_seidel_apply/KokkosSparse_gauss_seidel_apply_eti_spec_inst_double_size_t_int_LayoutLeft_Serial_HostSpace_HostSpace.cpp(58): here
 28 
 29 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/graph/impl/KokkosGraph_GraphColor_impl.hpp(2684): error: no instance of function template "Kokkos::atomic_fetch_add" matches the argument list
 30             argument types are: (unsigned long *, int)
 31           detected during:
 32             instantiation of "void KokkosGraph::Impl::GraphColor_VBD<HandleType, lno_row_view_t_, lno_nnz_view_t_>::functorDeterministicColoring::operator()(KokkosGraph::Impl::GraphColor_VBD<HandleType, lno_row_view_t_, lno_nnz_view_t_>::size_type) const [with HandleType=KokkosGr    aph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kok    kos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]" 
 33 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Serial.hpp(476): here
 34             instantiation of "std::enable_if<std::is_same<TagType, void>::value, void>::type Kokkos::Impl::ParallelFor<FunctorType, Kokkos::RangePolicy<Traits...>, Kokkos::Serial>::exec<TagType>() const [with FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColorin    gHandle<const size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Ko    kkos::MemoryTraits<1U>>, Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>>::functorDeterministicColoring, Traits=<Kokkos::Serial::execution_space>, TagType=void]" 
 35 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Serial.hpp(495): here
 36             instantiation of "void Kokkos::Impl::ParallelFor<FunctorType, Kokkos::RangePolicy<Traits...>, Kokkos::Serial>::execute() const [with FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::exec    ution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, Kokkos::View<const int *, Kokkos::Layou    tLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>>::functorDeterministicColoring, Traits=<Kokkos::Serial::execution_space>]" 
 37 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Parallel.hpp(191): here
 38             instantiation of "void Kokkos::parallel_for(const ExecPolicy &, const FunctorType &, const std::string &, Kokkos::Impl::enable_if<Kokkos::is_execution_policy<ExecPolicy>::value, void>::type *) [with ExecPolicy=Kokkos::RangePolicy<Kokkos::Serial::execution_space>, Func    torType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokko    s::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>>::functorDeterministicColoring]    " 
 39 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Parallel.hpp(244): here
 40             instantiation of "void Kokkos::parallel_for(const std::string &, const ExecPolicy &, const FunctorType &) [with ExecPolicy=Kokkos::RangePolicy<Kokkos::Serial::execution_space>, FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t    , const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1    U>>, Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>>::functorDeterministicColoring]"
 41 (2547): here
 42             [ 2 instantiation contexts not shown ]
 43             instantiation of "void KokkosGraph::Experimental::graph_color_symbolic(KernelHandle *, KernelHandle::nnz_lno_t, KernelHandle::nnz_lno_t, lno_row_view_t_, lno_nnz_view_t_, __nv_bool) [with KernelHandle=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, cons    t int, const double, Kokkos::Serial, Kokkos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::Vie    w<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
 44 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(619): here
 45             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::initialize_symbolic() [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kok    kos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokko    s::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits    <1U>>]"
 46 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(1085): here
 47             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::initialize_numeric() [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kokk    os::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos    ::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<    1U>>]"
 48 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(1500): here
 49             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::apply(x_value_array_type, y_value_array_type, __nv_bool, int, KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar    _nnz_view_t_>::nnz_scalar_t, __nv_bool, __nv_bool, __nv_bool) [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kokkos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::Layou    tLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::Memory    Traits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, x_value_array_type=Kokkos::View<double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::Ho    stSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, y_value_array_type=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
 50 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_spec.hpp(314): here
 51             instantiation of "void KokkosSparse::Impl::GAUSS_SEIDEL_APPLY<KernelHandle, a_size_view_t_, a_lno_view_t, a_scalar_view_t, x_scalar_view_t, y_scalar_view_t, false, true>::gauss_seidel_apply(KernelHandle *, KernelHandle::const_nnz_lno_t, KernelHandle::const_nnz_lno_t,     a_size_view_t_, a_lno_view_t, a_scalar_view_t, x_scalar_view_t, y_scalar_view_t, __nv_bool, __nv_bool, KernelHandle::nnz_scalar_t, int, __nv_bool, __nv_bool) [with KernelHandle=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial,     Kokkos::HostSpace, Kokkos::HostSpace>, a_size_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, a_lno_view_t=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokko    s::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, a_scalar_view_t=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U    >>, x_scalar_view_t=Kokkos::View<double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, y_scalar_view_t=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execut    ion_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
 52 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/impl/generated_specializations_cpp/gauss_seidel_apply/KokkosSparse_gauss_seidel_apply_eti_spec_inst_double_size_t_int_LayoutLeft_Serial_HostSpace_HostSpace.cpp(58): here
 53 
 54 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/graph/impl/KokkosGraph_GraphColor_impl.hpp(2751): error: no instance of function template "Kokkos::atomic_fetch_add" matches the argument list
 55             argument types are: (unsigned long *, int)
 56           detected during:
 57             instantiation of "void KokkosGraph::Impl::GraphColor_VBD<HandleType, lno_row_view_t_, lno_nnz_view_t_>::functorDeterministicColoringBitArray::operator()(KokkosGraph::Impl::GraphColor_VBD<HandleType, lno_row_view_t_, lno_nnz_view_t_>::size_type) const [with HandleType=    KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_sp    ace, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
 58 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Serial.hpp(476): here
 59             instantiation of "std::enable_if<std::is_same<TagType, void>::value, void>::type Kokkos::Impl::ParallelFor<FunctorType, Kokkos::RangePolicy<Traits...>, Kokkos::Serial>::exec<TagType>() const [with FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColorin    gHandle<const size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Ko    kkos::MemoryTraits<1U>>, Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>>::functorDeterministicColoringBitArray, Traits=<Kokkos::Serial::execution_space>, TagType=void]"
 60 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Serial.hpp(495): here
 61             instantiation of "void Kokkos::Impl::ParallelFor<FunctorType, Kokkos::RangePolicy<Traits...>, Kokkos::Serial>::execute() const [with FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::exec    ution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, Kokkos::View<const int *, Kokkos::Layou    tLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>>::functorDeterministicColoringBitArray, Traits=<Kokkos::Serial::execution_space>]"
 62 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Parallel.hpp(191): here
 63             instantiation of "void Kokkos::parallel_for(const ExecPolicy &, const FunctorType &, const std::string &, Kokkos::Impl::enable_if<Kokkos::is_execution_policy<ExecPolicy>::value, void>::type *) [with ExecPolicy=Kokkos::RangePolicy<Kokkos::Serial::execution_space>, Func    torType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokko    s::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>>::functorDeterministicColoringB    itArray]"
 64 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Parallel.hpp(244): here
 65             instantiation of "void Kokkos::parallel_for(const std::string &, const ExecPolicy &, const FunctorType &) [with ExecPolicy=Kokkos::RangePolicy<Kokkos::Serial::execution_space>, FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t    , const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1    U>>, Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>>::functorDeterministicColoringBitArray]"
 66 (2562): here
 67             [ 2 instantiation contexts not shown ]
 68             instantiation of "void KokkosGraph::Experimental::graph_color_symbolic(KernelHandle *, KernelHandle::nnz_lno_t, KernelHandle::nnz_lno_t, lno_row_view_t_, lno_nnz_view_t_, __nv_bool) [with KernelHandle=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, cons    t int, const double, Kokkos::Serial, Kokkos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::Vie    w<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
 69 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(619): here
 70             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::initialize_symbolic() [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kok    kos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokko    s::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits    <1U>>]"
 71 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(1085): here
 72             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::initialize_numeric() [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kokk    os::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos    ::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<    1U>>]"
 73 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(1500): here
 74             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::apply(x_value_array_type, y_value_array_type, __nv_bool, int, KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar    _nnz_view_t_>::nnz_scalar_t, __nv_bool, __nv_bool, __nv_bool) [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kokkos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::Layou    tLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::Memory    Traits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, x_value_array_type=Kokkos::View<double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::Ho    stSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, y_value_array_type=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
 75 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_spec.hpp(314): here
 76             instantiation of "void KokkosSparse::Impl::GAUSS_SEIDEL_APPLY<KernelHandle, a_size_view_t_, a_lno_view_t, a_scalar_view_t, x_scalar_view_t, y_scalar_view_t, false, true>::gauss_seidel_apply(KernelHandle *, KernelHandle::const_nnz_lno_t, KernelHandle::const_nnz_lno_t,     a_size_view_t_, a_lno_view_t, a_scalar_view_t, x_scalar_view_t, y_scalar_view_t, __nv_bool, __nv_bool, KernelHandle::nnz_scalar_t, int, __nv_bool, __nv_bool) [with KernelHandle=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial,     Kokkos::HostSpace, Kokkos::HostSpace>, a_size_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, a_lno_view_t=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokko    s::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, a_scalar_view_t=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U    >>, x_scalar_view_t=Kokkos::View<double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, y_scalar_view_t=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execut    ion_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
 77 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/impl/generated_specializations_cpp/gauss_seidel_apply/KokkosSparse_gauss_seidel_apply_eti_spec_inst_double_size_t_int_LayoutLeft_Serial_HostSpace_HostSpace.cpp(58): here
 78 
 79 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/graph/impl/KokkosGraph_GraphColor_impl.hpp(2633): error: no instance of function template "Kokkos::atomic_fetch_add" matches the argument list
 80             argument types are: (unsigned long *, int)
 81           detected during:
 82             instantiation of "void KokkosGraph::Impl::GraphColor_VBD<HandleType, lno_row_view_t_, lno_nnz_view_t_>::functorInitialDependency::operator()(int) const [with HandleType=KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::execution_spac    e, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, lno_row_view_t_=Kokkos::View<size_t *, Kokkos::HostSpace::memory_space>, lno_nnz_view_t_=Kokkos::View<int *, Kokkos::HostSpace::memory_space>]"
 83 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Serial.hpp(476): here
 84             instantiation of "std::enable_if<std::is_same<TagType, void>::value, void>::type Kokkos::Impl::ParallelFor<FunctorType, Kokkos::RangePolicy<Traits...>, Kokkos::Serial>::exec<TagType>() const [with FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColorin    gHandle<const size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<size_t *, Kokkos::HostSpace::memory_space>, Kokkos::View<int *, Kokkos::HostSpace::memory_space>>::functorInitialDependency    , Traits=<Kokkos::Serial::execution_space>, TagType=void]"
 85 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Serial.hpp(495): here
 86             instantiation of "void Kokkos::Impl::ParallelFor<FunctorType, Kokkos::RangePolicy<Traits...>, Kokkos::Serial>::execute() const [with FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::exec    ution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<size_t *, Kokkos::HostSpace::memory_space>, Kokkos::View<int *, Kokkos::HostSpace::memory_space>>::functorInitialDependency, Traits=<Kokkos::Serial::execution_space>]"
 87 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Parallel.hpp(191): here
 88             instantiation of "void Kokkos::parallel_for(const ExecPolicy &, const FunctorType &, const std::string &, Kokkos::Impl::enable_if<Kokkos::is_execution_policy<ExecPolicy>::value, void>::type *) [with ExecPolicy=Kokkos::RangePolicy<Kokkos::Serial::execution_space>, Func    torType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<size_t *, Kokkos::HostSpace::memory_space>, Kokkos::View    <int *, Kokkos::HostSpace::memory_space>>::functorInitialDependency]"
 89 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Parallel.hpp(244): here
 90             instantiation of "void Kokkos::parallel_for(const std::string &, const ExecPolicy &, const FunctorType &) [with ExecPolicy=Kokkos::RangePolicy<Kokkos::Serial::execution_space>, FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t    , const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<size_t *, Kokkos::HostSpace::memory_space>, Kokkos::View<int *, Kokkos::HostSpace::memory_space>>::functorInitialDependency]"
 91 (2522): here
 92             [ 2 instantiation contexts not shown ]
 93             instantiation of "void KokkosGraph::Experimental::graph_color_symbolic(KernelHandle *, KernelHandle::nnz_lno_t, KernelHandle::nnz_lno_t, lno_row_view_t_, lno_nnz_view_t_, __nv_bool) [with KernelHandle=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, cons    t int, const double, Kokkos::Serial, Kokkos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<size_t *, Kokkos::HostSpace::memory_space>, lno_nnz_view_t_=Kokkos::View<int *, Kokkos::HostSpace::memory_space>]"
 94 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(629): here
 95             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::initialize_symbolic() [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kok    kos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokko    s::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits    <1U>>]"
 96 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(1085): here
 97             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::initialize_numeric() [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kokk    os::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos    ::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<    1U>>]"
 98 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(1500): here
 99             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::apply(x_value_array_type, y_value_array_type, __nv_bool, int, KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar    _nnz_view_t_>::nnz_scalar_t, __nv_bool, __nv_bool, __nv_bool) [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kokkos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::Layou    tLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::Memory    Traits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, x_value_array_type=Kokkos::View<double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::Ho    stSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, y_value_array_type=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
100 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_spec.hpp(314): here
101             instantiation of "void KokkosSparse::Impl::GAUSS_SEIDEL_APPLY<KernelHandle, a_size_view_t_, a_lno_view_t, a_scalar_view_t, x_scalar_view_t, y_scalar_view_t, false, true>::gauss_seidel_apply(KernelHandle *, KernelHandle::const_nnz_lno_t, KernelHandle::const_nnz_lno_t,     a_size_view_t_, a_lno_view_t, a_scalar_view_t, x_scalar_view_t, y_scalar_view_t, __nv_bool, __nv_bool, KernelHandle::nnz_scalar_t, int, __nv_bool, __nv_bool) [with KernelHandle=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial,     Kokkos::HostSpace, Kokkos::HostSpace>, a_size_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, a_lno_view_t=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokko    s::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, a_scalar_view_t=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U    >>, x_scalar_view_t=Kokkos::View<double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, y_scalar_view_t=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execut    ion_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
102 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/impl/generated_specializations_cpp/gauss_seidel_apply/KokkosSparse_gauss_seidel_apply_eti_spec_inst_double_size_t_int_LayoutLeft_Serial_HostSpace_HostSpace.cpp(58): here
103 
104 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/graph/impl/KokkosGraph_GraphColor_impl.hpp(2684): error: no instance of function template "Kokkos::atomic_fetch_add" matches the argument list
105             argument types are: (unsigned long *, int)
106           detected during:
107             instantiation of "void KokkosGraph::Impl::GraphColor_VBD<HandleType, lno_row_view_t_, lno_nnz_view_t_>::functorDeterministicColoring::operator()(KokkosGraph::Impl::GraphColor_VBD<HandleType, lno_row_view_t_, lno_nnz_view_t_>::size_type) const [with HandleType=KokkosGr    aph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, lno_row_view_t_=Kokkos::View<size_t *, Kokkos::HostSpace::memory_space>, lno_nnz_view_t_=Kokkos::View<int *, Kokkos::Ho    stSpace::memory_space>]"
108 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Serial.hpp(476): here
109             instantiation of "std::enable_if<std::is_same<TagType, void>::value, void>::type Kokkos::Impl::ParallelFor<FunctorType, Kokkos::RangePolicy<Traits...>, Kokkos::Serial>::exec<TagType>() const [with FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColorin    gHandle<const size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<size_t *, Kokkos::HostSpace::memory_space>, Kokkos::View<int *, Kokkos::HostSpace::memory_space>>::functorDeterministicColo    ring, Traits=<Kokkos::Serial::execution_space>, TagType=void]"
110 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Serial.hpp(495): here
111             instantiation of "void Kokkos::Impl::ParallelFor<FunctorType, Kokkos::RangePolicy<Traits...>, Kokkos::Serial>::execute() const [with FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::exec    ution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<size_t *, Kokkos::HostSpace::memory_space>, Kokkos::View<int *, Kokkos::HostSpace::memory_space>>::functorDeterministicColoring, Traits=<Kokkos::Serial::execution_space>]"
112 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Parallel.hpp(191): here
113             instantiation of "void Kokkos::parallel_for(const ExecPolicy &, const FunctorType &, const std::string &, Kokkos::Impl::enable_if<Kokkos::is_execution_policy<ExecPolicy>::value, void>::type *) [with ExecPolicy=Kokkos::RangePolicy<Kokkos::Serial::execution_space>, Func    torType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<size_t *, Kokkos::HostSpace::memory_space>, Kokkos::View    <int *, Kokkos::HostSpace::memory_space>>::functorDeterministicColoring]"
114 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Parallel.hpp(244): here
115             instantiation of "void Kokkos::parallel_for(const std::string &, const ExecPolicy &, const FunctorType &) [with ExecPolicy=Kokkos::RangePolicy<Kokkos::Serial::execution_space>, FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t    , const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<size_t *, Kokkos::HostSpace::memory_space>, Kokkos::View<int *, Kokkos::HostSpace::memory_space>>::functorDeterministicColoring]"
116 (2547): here
117             [ 2 instantiation contexts not shown ]
118             instantiation of "void KokkosGraph::Experimental::graph_color_symbolic(KernelHandle *, KernelHandle::nnz_lno_t, KernelHandle::nnz_lno_t, lno_row_view_t_, lno_nnz_view_t_, __nv_bool) [with KernelHandle=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, cons    t int, const double, Kokkos::Serial, Kokkos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<size_t *, Kokkos::HostSpace::memory_space>, lno_nnz_view_t_=Kokkos::View<int *, Kokkos::HostSpace::memory_space>]"
119 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(629): here
120             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::initialize_symbolic() [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kok    kos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokko    s::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits    <1U>>]"
121 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(1085): here
122             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::initialize_numeric() [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kokk    os::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos    ::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<    1U>>]"
123 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(1500): here
124             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::apply(x_value_array_type, y_value_array_type, __nv_bool, int, KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar    _nnz_view_t_>::nnz_scalar_t, __nv_bool, __nv_bool, __nv_bool) [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kokkos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::Layou    tLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::Memory    Traits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, x_value_array_type=Kokkos::View<double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::Ho    stSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, y_value_array_type=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
125 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_spec.hpp(314): here
126             instantiation of "void KokkosSparse::Impl::GAUSS_SEIDEL_APPLY<KernelHandle, a_size_view_t_, a_lno_view_t, a_scalar_view_t, x_scalar_view_t, y_scalar_view_t, false, true>::gauss_seidel_apply(KernelHandle *, KernelHandle::const_nnz_lno_t, KernelHandle::const_nnz_lno_t,     a_size_view_t_, a_lno_view_t, a_scalar_view_t, x_scalar_view_t, y_scalar_view_t, __nv_bool, __nv_bool, KernelHandle::nnz_scalar_t, int, __nv_bool, __nv_bool) [with KernelHandle=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial,     Kokkos::HostSpace, Kokkos::HostSpace>, a_size_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, a_lno_view_t=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokko    s::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, a_scalar_view_t=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U    >>, x_scalar_view_t=Kokkos::View<double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, y_scalar_view_t=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execut    ion_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
127 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/impl/generated_specializations_cpp/gauss_seidel_apply/KokkosSparse_gauss_seidel_apply_eti_spec_inst_double_size_t_int_LayoutLeft_Serial_HostSpace_HostSpace.cpp(58): here
128 
129 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/graph/impl/KokkosGraph_GraphColor_impl.hpp(2751): error: no instance of function template "Kokkos::atomic_fetch_add" matches the argument list
130             argument types are: (unsigned long *, int)
131           detected during:
132             instantiation of "void KokkosGraph::Impl::GraphColor_VBD<HandleType, lno_row_view_t_, lno_nnz_view_t_>::functorDeterministicColoringBitArray::operator()(KokkosGraph::Impl::GraphColor_VBD<HandleType, lno_row_view_t_, lno_nnz_view_t_>::size_type) const [with HandleType=    KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, lno_row_view_t_=Kokkos::View<size_t *, Kokkos::HostSpace::memory_space>, lno_nnz_view_t_=Kokkos::View<int *, Ko    kkos::HostSpace::memory_space>]"
133 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Serial.hpp(476): here
134             instantiation of "std::enable_if<std::is_same<TagType, void>::value, void>::type Kokkos::Impl::ParallelFor<FunctorType, Kokkos::RangePolicy<Traits...>, Kokkos::Serial>::exec<TagType>() const [with FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColorin    gHandle<const size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<size_t *, Kokkos::HostSpace::memory_space>, Kokkos::View<int *, Kokkos::HostSpace::memory_space>>::functorDeterministicColo    ringBitArray, Traits=<Kokkos::Serial::execution_space>, TagType=void]"
135 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Serial.hpp(495): here
136             instantiation of "void Kokkos::Impl::ParallelFor<FunctorType, Kokkos::RangePolicy<Traits...>, Kokkos::Serial>::execute() const [with FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::exec    ution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<size_t *, Kokkos::HostSpace::memory_space>, Kokkos::View<int *, Kokkos::HostSpace::memory_space>>::functorDeterministicColoringBitArray, Traits=<Kokkos::Serial::execution_space>]"
137 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Parallel.hpp(191): here
138             instantiation of "void Kokkos::parallel_for(const ExecPolicy &, const FunctorType &, const std::string &, Kokkos::Impl::enable_if<Kokkos::is_execution_policy<ExecPolicy>::value, void>::type *) [with ExecPolicy=Kokkos::RangePolicy<Kokkos::Serial::execution_space>, Func    torType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<size_t *, Kokkos::HostSpace::memory_space>, Kokkos::View    <int *, Kokkos::HostSpace::memory_space>>::functorDeterministicColoringBitArray]"
139 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Parallel.hpp(244): here
140             instantiation of "void Kokkos::parallel_for(const std::string &, const ExecPolicy &, const FunctorType &) [with ExecPolicy=Kokkos::RangePolicy<Kokkos::Serial::execution_space>, FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t    , const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<size_t *, Kokkos::HostSpace::memory_space>, Kokkos::View<int *, Kokkos::HostSpace::memory_space>>::functorDeterministicColoringBitArray]"
141 (2562): here
142             [ 2 instantiation contexts not shown ]
143             instantiation of "void KokkosGraph::Experimental::graph_color_symbolic(KernelHandle *, KernelHandle::nnz_lno_t, KernelHandle::nnz_lno_t, lno_row_view_t_, lno_nnz_view_t_, __nv_bool) [with KernelHandle=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, cons    t int, const double, Kokkos::Serial, Kokkos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<size_t *, Kokkos::HostSpace::memory_space>, lno_nnz_view_t_=Kokkos::View<int *, Kokkos::HostSpace::memory_space>]"
144 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(629): here
145             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::initialize_symbolic() [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kok    kos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokko    s::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits    <1U>>]"
146 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(1085): here
147             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::initialize_numeric() [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kokk    os::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos    ::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<    1U>>]"
148 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(1500): here
149             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::apply(x_value_array_type, y_value_array_type, __nv_bool, int, KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar    _nnz_view_t_>::nnz_scalar_t, __nv_bool, __nv_bool, __nv_bool) [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kokkos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::Layou    tLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::Memory    Traits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, x_value_array_type=Kokkos::View<double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::Ho    stSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, y_value_array_type=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
150 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_spec.hpp(314): here
151             instantiation of "void KokkosSparse::Impl::GAUSS_SEIDEL_APPLY<KernelHandle, a_size_view_t_, a_lno_view_t, a_scalar_view_t, x_scalar_view_t, y_scalar_view_t, false, true>::gauss_seidel_apply(KernelHandle *, KernelHandle::const_nnz_lno_t, KernelHandle::const_nnz_lno_t,     a_size_view_t_, a_lno_view_t, a_scalar_view_t, x_scalar_view_t, y_scalar_view_t, __nv_bool, __nv_bool, KernelHandle::nnz_scalar_t, int, __nv_bool, __nv_bool) [with KernelHandle=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial,     Kokkos::HostSpace, Kokkos::HostSpace>, a_size_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, a_lno_view_t=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokko    s::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, a_scalar_view_t=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U    >>, x_scalar_view_t=Kokkos::View<double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, y_scalar_view_t=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execut    ion_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
152 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/impl/generated_specializations_cpp/gauss_seidel_apply/KokkosSparse_gauss_seidel_apply_eti_spec_inst_double_size_t_int_LayoutLeft_Serial_HostSpace_HostSpace.cpp(58): here
153 
154 6 errors detected in the compilation of "/var/tmp/hu21/tmpxft_00018a77_00000000-6_KokkosSparse_gauss_seidel_apply_eti_spec_inst_double_size_t_int_LayoutLeft_Serial_HostSpace_HostSpace.cpp1.ii".
155 ninja: build stopped: subcommand failed.

Here is my setup:

Currently Loaded Modules:
  1) xl/2019.02.07
  2) spectrum-mpi/rolling-release
  3) cuda/9.2.148
  4) StdEnv
  5) lapack/3.8.0-P9-xl-2018.08.24
  6) cmake/3.12.1
ARGS=(
  -D Trilinos_ENABLE_EXPLICIT_INSTANTIATION:BOOL=ON
  -GNinja -DTrilinos_ENABLE_Fortran:BOOL=OFF
  -D Kokkos_ENABLE_Profiling=ON
  -D MueLu_ENABLE_Kokkos_Refactor_Use_By_Default:BOOL=ON
  -D Trilinos_ENABLE_TESTS:BOOL=OFF
  -D Trilinos_ENABLE_EXAMPLES:BOOL=OFF

  -D Trilinos_ENABLE_Panzer=ON
  -D Panzer_ENABLE_TESTS:BOOL=OFF
  -D Panzer_ENABLE_EXAMPLES:BOOL=OFF
  -D Trilinos_ENABLE_PanzerMiniEM=ON
  -D PanzerMiniEM_ENABLE_EXAMPLES=ON
  -D PanzerMiniEM_ENABLE_TESTS=ON

  -D Trilinos_ENABLE_SEACASExodiff:BOOL=ON
  -D Trilinos_ENABLE_SEACASEpu:BOOL=ON
  -D Trilinos_ENABLE_SEACASNemspread:BOOL=ON
  -D Trilinos_ENABLE_SEACASNemslice:BOOL=ON
  -D Trilinos_ENABLE_SEACASAprepro:BOOL=ON
  -D Teuchos_KOKKOS_PROFILING:BOOL=ON

  -D TPL_ENABLE_MPI:BOOL=ON
)

cmake "${ARGS[@]}" ${TRILINOS_DIR

Some relevant "magic" environment variables are

export ARCH="Power9;Volta70"
export OMPI_CXX=${TRILINOS_DIR}/packages/kokkos/bin/nvcc_wrapper
export LLNL_USE_OMPI_VARS="Y"
export NVCC_WRAPPER_DEFAULT_COMPILER=`which  xlC`

@nmhamster @srajama1

@srajama1
Copy link
Contributor

@jhux2 : Strange error. We have nightlies with Cuda 9.2 but not with Xlc.

Do you have gcc in this environment for a sanity check ?

@crtrott @ndellingwood

@jhux2
Copy link
Author

jhux2 commented Mar 22, 2019

@srajama1 I think so, I'll try and report back.

@jhux2
Copy link
Author

jhux2 commented Mar 22, 2019

Tried these modules:

  1) cuda/9.2.148
  2) StdEnv
  3) gcc/7.3.1
  4) spectrum-mpi/rolling-release
  5) lapack/3.8.0-gcc-4.9.3
  6) cmake/3.12.1

Appears to be the same type of error:

 5 [5/3439] Building CXX object packages/kokkos-kernels/src/CMakeFiles/kokkoskernels.dir/impl/generated_specializations_cpp/gauss_seidel_apply/KokkosSparse_gauss_seidel_apply_eti_spec_inst_double_size_t_int_LayoutLeft_Serial_HostSpace_HostSpace.cpp.o
  6 FAILED: packages/kokkos-kernels/src/CMakeFiles/kokkoskernels.dir/impl/generated_specializations_cpp/gauss_seidel_apply/KokkosSparse_gauss_seidel_apply_eti_spec_inst_double_size_t_int_LayoutLeft_Serial_HostSpace_HostSpace.cpp.o
  7 /usr/tce/packages/spectrum-mpi/spectrum-mpi-rolling-release-gcc-7.3.1/bin/mpicxx -+  -I. -Ipackages/kokkos-kernels/src -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/impl -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-    kernels/src/impl/tpls -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/blas -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/blas/impl -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/im    pl -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/graph -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/graph/impl -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/batched -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/batched/impl -I/g/g20/hu2    1/sandbox/Trilinos/packages/kokkos-kernels/src/common -Ipackages/kokkos/algorithms/src -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos/algorithms/src -Ipackages/kokkos/containers/src -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos/containers/src -Ipackages/kokkos/core/src -I/g/g20/hu21/sand    box/Trilinos/packages/kokkos/core/src -I/g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/impl/generated_specializations_hpp -qthreaded -std=c++11 -O -DNDEBUG -MF packages/kokkos-kernels/src/CMakeFiles/kokkoskernels.dir/impl/generated_specializations_cpp/gauss_seidel_apply/KokkosSp    arse_gauss_seidel_apply_eti_spec_inst_double_size_t_int_LayoutLeft_Serial_HostSpace_HostSpace.cpp.o.d -qmakedep=gcc -o packages/kokkos-kernels/src/CMakeFiles/kokkoskernels.dir/impl/generated_specializations_cpp/gauss_seidel_apply/KokkosSparse_gauss_seidel_apply_eti_spec_inst_double_size_t    _int_LayoutLeft_Serial_HostSpace_HostSpace.cpp.o -c /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/impl/generated_specializations_cpp/gauss_seidel_apply/KokkosSparse_gauss_seidel_apply_eti_spec_inst_double_size_t_int_LayoutLeft_Serial_HostSpace_HostSpace.cpp
  8 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/graph/impl/KokkosGraph_GraphColor_impl.hpp(2633): error: no instance of function template "Kokkos::atomic_fetch_add" matches the argument list
  9             argument types are: (unsigned long *, int)
 10           detected during:
 11             instantiation of "void KokkosGraph::Impl::GraphColor_VBD<HandleType, lno_row_view_t_, lno_nnz_view_t_>::functorInitialDependency::operator()(int) const [with HandleType=KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos    ::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::L    ayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
 12 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Serial.hpp(476): here
 13             instantiation of "std::enable_if<std::is_same<TagType, void>::value, void>::type Kokkos::Impl::ParallelFor<FunctorType, Kokkos::RangePolicy<Traits...>, Kokkos::Serial>::exec<TagType>() const [with FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<c    onst size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits    <1U>>, Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>>::functorInitialDependency, Traits=<Kokkos::Serial::execution_space>, TagType=void]"
 14 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Serial.hpp(495): here
 15             instantiation of "void Kokkos::Impl::ParallelFor<FunctorType, Kokkos::RangePolicy<Traits...>, Kokkos::Serial>::execute() const [with FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::execution_spa    ce, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Dev    ice<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>>::functorInitialDependency, Traits=<Kokkos::Serial::execution_space>]"
 16 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Parallel.hpp(191): here
 17             instantiation of "void Kokkos::parallel_for(const ExecPolicy &, const FunctorType &, const std::string &, Kokkos::Impl::enable_if<Kokkos::is_execution_policy<ExecPolicy>::value, void>::type *) [with ExecPolicy=Kokkos::RangePolicy<Kokkos::Serial::execution_space>, FunctorType=K    okkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t, const int, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::exec    ution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>>::functorInitialDependency]"
 18 /g/g20/hu21/sandbox/Trilinos/packages/kokkos/core/src/Kokkos_Parallel.hpp(244): here
 19             instantiation of "void Kokkos::parallel_for(const std::string &, const ExecPolicy &, const FunctorType &) [with ExecPolicy=Kokkos::RangePolicy<Kokkos::Serial::execution_space>, FunctorType=KokkosGraph::Impl::GraphColor_VBD<KokkosGraph::GraphColoringHandle<const size_t, const i    nt, const int, Kokkos::Serial::execution_space, Kokkos::HostSpace::memory_space, Kokkos::HostSpace::memory_space>, Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, Kokkos::View<    const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>>::functorInitialDependency]"
 20 (2522): here
 21             [ 2 instantiation contexts not shown ]
 22             instantiation of "void KokkosGraph::Experimental::graph_color_symbolic(KernelHandle *, KernelHandle::nnz_lno_t, KernelHandle::nnz_lno_t, lno_row_view_t_, lno_nnz_view_t_, __nv_bool) [with KernelHandle=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, co    nst double, Kokkos::Serial, Kokkos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kok    kos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
 23 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(619): here
 24             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::initialize_symbolic() [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kokkos::Host    Space, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::    HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
 25 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(1085): here
 26             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::initialize_numeric() [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kokkos::HostS    pace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::H    ostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, scalar_nnz_view_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
 27 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_impl.hpp(1500): here
 28             instantiation of "void KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view_t_>::apply(x_value_array_type, y_value_array_type, __nv_bool, int, KokkosSparse::Impl::GaussSeidel<HandleType, lno_row_view_t_, lno_nnz_view_t_, scalar_nnz_view    _t_>::nnz_scalar_t, __nv_bool, __nv_bool, __nv_bool) [with HandleType=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kokkos::HostSpace, Kokkos::HostSpace>, lno_row_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Dev    ice<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, lno_nnz_view_t_=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, scalar_nnz_vie    w_t_=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, x_value_array_type=Kokkos::View<double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::Ho    stSpace::memory_space>, Kokkos::MemoryTraits<1U>>, y_value_array_type=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>]"
 29 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/sparse/impl/KokkosSparse_gauss_seidel_spec.hpp(314): here
 30             instantiation of "void KokkosSparse::Impl::GAUSS_SEIDEL_APPLY<KernelHandle, a_size_view_t_, a_lno_view_t, a_scalar_view_t, x_scalar_view_t, y_scalar_view_t, false, true>::gauss_seidel_apply(KernelHandle *, KernelHandle::const_nnz_lno_t, KernelHandle::const_nnz_lno_t, a_size_vi    ew_t_, a_lno_view_t, a_scalar_view_t, x_scalar_view_t, y_scalar_view_t, __nv_bool, __nv_bool, KernelHandle::nnz_scalar_t, int, __nv_bool, __nv_bool) [with KernelHandle=KokkosKernels::Experimental::KokkosKernelsHandle<const size_t, const int, const double, Kokkos::Serial, Kokkos::HostSpace    , Kokkos::HostSpace>, a_size_view_t_=Kokkos::View<const size_t *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, a_lno_view_t=Kokkos::View<const int *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace    ::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, a_scalar_view_t=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, x_scalar_view_t=Kokkos::View<dou    ble *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>, Kokkos::MemoryTraits<1U>>, y_scalar_view_t=Kokkos::View<const double *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::HostSpace::execution_space, Kokkos::HostSpace::memory_space>,     Kokkos::MemoryTraits<1U>>]"
 31 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/impl/generated_specializations_cpp/gauss_seidel_apply/KokkosSparse_gauss_seidel_apply_eti_spec_inst_double_size_t_int_LayoutLeft_Serial_HostSpace_HostSpace.cpp(58): here
 32 
 33 /g/g20/hu21/sandbox/Trilinos/packages/kokkos-kernels/src/graph/impl/KokkosGraph_GraphColor_impl.hpp(2684): error: no instance of function template "Kokkos::atomic_fetch_add" matches the argument list
 34             argument types are: (unsigned long *, int)

@srajama1
Copy link
Contributor

@jhux2 : I see what is causing the problem. A constant in the second argument to Kokkos atomic_fetch_add gets interpreted as int. I am not sure why every other platform works fine and it fails here. We will put in a fix.

@jhux2
Copy link
Author

jhux2 commented Mar 22, 2019

@srajama1 Good eyes, thank you! (I just tried gcc 4.9.3, and the compile fails the same way.) I am happy to try a patch for you.

@srajama1
Copy link
Contributor

Not as simple as I thought, I get unsigned types in and need to a fetch add with -1, can't match them both. Need some reworking and time.

@jjellio
Copy link

jjellio commented Mar 24, 2019

@jhu2 Shouldn't 'ARCH' be 'KOKKOS_ARCH'?

@srajama1
Copy link
Contributor

@jhux2 : I think @jjellio has a good catch, may be that will explain why it is only happening in this machine. I am still working through the changes, need some time with @ndellingwood to confirm what I am thinking.

@jhux2
Copy link
Author

jhux2 commented Mar 25, 2019

@jjellio Thanks for the suggestion. I just tried an XL build using KOKKOS_ARCH, rather than just ARCH. The build failed in the same way.

@ndellingwood
Copy link
Contributor

@srajama1 has a patch with a fix for this.

srajama1 added a commit to srajama1/kokkos-kernels that referenced this issue Mar 26, 2019
 the constant input to Kokkos atomc_fetch_add
ndellingwood added a commit that referenced this issue Mar 27, 2019
 Fix #401. Address failures when compiling with xlc on certain platform
@srajama1
Copy link
Contributor

@jhux2 : We have a fix in develop. You have a Trilinos patch. Do you want that patch to be applied to Trilinos develop or can this wait till next Kokkos update ?

@jhux2
Copy link
Author

jhux2 commented Mar 27, 2019

@srajama1 @ndellingwood Thank you for fixing this. No, this can wait until the next snapshot.

@srajama1
Copy link
Contributor

@jhux2 : Thanks ! Closing this.

@srajama1 srajama1 reopened this Mar 27, 2019
@srajama1
Copy link
Contributor

Shouldn't have closed. Per @crtrott need to leave it open till next Trilinos update as the issue is there :)

@ndellingwood
Copy link
Contributor

@srajama1 let's just mark as InDevelop for now, we will close when the next promotion completes (this helps monitor stuff when creating the CHANGELOG)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants