#5 Refactor blas2 test for benchmark feature #1733

cz4rs · 2023-03-15T12:06:45Z

Convert blas2 performance test to use benchmark library.
Follow-up to #1636.

Sample result:

> ./build/perf_test/blas/blas2/KokkosKernels_Blas2_Benchmark --benchmark_counters_tabular=true --m 1000 --n 2000 --layout right --openmp 1

--------------------------------------------------------------------------------------------------------------------------------------------------
Benchmark                                                         Time             CPU   Iterations Avg GEMV FLOP/s: Avg GEMV time (s):     OpenMP
--------------------------------------------------------------------------------------------------------------------------------------------------
KokkosBlas2_gemv/m:1000/n:2000/LayoutRight:1/manual_time      0.008 s         0.008 s            87       521.439M/s           7.67108m          1

Full output:

Console

2023-04-11T16:59:17+02:00
Running ./build/perf_test/blas/blas2/KokkosKernels_Blas2_Benchmark
Run on (8 X 4700 MHz CPU s)
CPU Caches:
  L1 Data 32 KiB (x8)
  L1 Instruction 32 KiB (x8)
  L2 Unified 256 KiB (x8)
  L3 Unified 12288 KiB (x1)
Load Average: 0.82, 0.98, 1.05
CPU architecture: none
Default Device: N6Kokkos6OpenMPE
GIT_BRANCH: 5-google-benchmark-blas2-tests
GIT_CLEAN_STATUS: DIRTY
GIT_COMMIT_DATE: 2023-04-11T16:56:50+02:00
GIT_COMMIT_DESCRIPTION: Support all command line parameters
GIT_COMMIT_HASH: b7dd84a95
GOOGLE_BENCHMARK_VERSION: 1.6.2
GPU architecture: none
KOKKOSKERNELS_ENABLE_TPL_ARMPL: no
KOKKOSKERNELS_ENABLE_TPL_BLAS: no
KOKKOSKERNELS_ENABLE_TPL_CBLAS: no
KOKKOSKERNELS_ENABLE_TPL_CHOLMOD: no
KOKKOSKERNELS_ENABLE_TPL_CUBLAS: no
KOKKOSKERNELS_ENABLE_TPL_CUSPARSE: no
KOKKOSKERNELS_ENABLE_TPL_LAPACK: no
KOKKOSKERNELS_ENABLE_TPL_LAPACKE: no
KOKKOSKERNELS_ENABLE_TPL_MAGMA: no
KOKKOSKERNELS_ENABLE_TPL_METIS: no
KOKKOSKERNELS_ENABLE_TPL_MKL: no
KOKKOSKERNELS_ENABLE_TPL_ROCBLAS: no
KOKKOSKERNELS_ENABLE_TPL_ROCSPARSE: no
KOKKOSKERNELS_ENABLE_TPL_SUPERLU: no
KOKKOS_COMPILER_CLANG: 1507
KOKKOS_ENABLE_ASM: no
KOKKOS_ENABLE_CXX17: yes
KOKKOS_ENABLE_CXX20: no
KOKKOS_ENABLE_CXX23: no
KOKKOS_ENABLE_DEBUG_BOUNDS_CHECK: yes
KOKKOS_ENABLE_GNU_ATOMICS: no
KOKKOS_ENABLE_HBWSPACE: no
KOKKOS_ENABLE_HWLOC: yes
KOKKOS_ENABLE_INTEL_ATOMICS: no
KOKKOS_ENABLE_INTEL_MM_ALLOC: no
KOKKOS_ENABLE_LIBDL: yes
KOKKOS_ENABLE_LIBRT: no
KOKKOS_ENABLE_OPENMP: yes
KOKKOS_ENABLE_OPENMP_ATOMICS: no
KOKKOS_ENABLE_PRAGMA_IVDEP: no
KOKKOS_ENABLE_PRAGMA_LOOPCOUNT: no
KOKKOS_ENABLE_PRAGMA_UNROLL: no
KOKKOS_ENABLE_PRAGMA_VECTOR: no
KOKKOS_ENABLE_SERIAL: yes
KOKKOS_ENABLE_SERIAL_ATOMICS: no
KOKKOS_ENABLE_WINDOWS_ATOMICS: no
Kokkos: OpenMP thread_pool_topology[ 1 x 8 x 1 ]
Kokkos Version: 4.0.0
KokkosKernels Version: 4.0.99
***WARNING*** CPU scaling is enabled, the benchmark real time measurements may be noisy and will incur extra overhead.
***WARNING*** Library was built as DEBUG. Timings may be affected.
--------------------------------------------------------------------------------------------------------------------------------------------------
Benchmark                                                         Time             CPU   Iterations Avg GEMV FLOP/s: Avg GEMV time (s):     OpenMP
--------------------------------------------------------------------------------------------------------------------------------------------------
KokkosBlas2_gemv/m:1000/n:2000/LayoutRight:1/manual_time      0.008 s         0.008 s            87       521.439M/s           7.67108m          1

JSON

> ./build/perf_test/blas/blas2/KokkosKernels_Blas2_Benchmark --benchmark_format=json --m 1000 --n 2000 --layout right --openmp 1

{
  "context": {
    "date": "2023-04-11T17:02:38+02:00",
    "host_name": "rysy",
    "executable": "./build/perf_test/blas/blas2/KokkosKernels_Blas2_Benchmark",
    "num_cpus": 8,
    "mhz_per_cpu": 4700,
    "cpu_scaling_enabled": true,
    "caches": [
      {
        "type": "Data",
        "level": 1,
        "size": 32768,
        "num_sharing": 1
      },
      {
        "type": "Instruction",
        "level": 1,
        "size": 32768,
        "num_sharing": 1
      },
      {
        "type": "Unified",
        "level": 2,
        "size": 262144,
        "num_sharing": 1
      },
      {
        "type": "Unified",
        "level": 3,
        "size": 12582912,
        "num_sharing": 8
      }
    ],
    "load_avg": [1.39453,1.25977,1.15918],
    "library_build_type": "debug",
    "CPU architecture": "none",
    "Default Device": "N6Kokkos6OpenMPE",
    "GIT_BRANCH": "5-google-benchmark-blas2-tests",
    "GIT_CLEAN_STATUS": "DIRTY",
    "GIT_COMMIT_DATE": "2023-04-11T16:56:50+02:00",
    "GIT_COMMIT_DESCRIPTION": "Support all command line parameters",
    "GIT_COMMIT_HASH": "b7dd84a95",
    "GOOGLE_BENCHMARK_VERSION": "1.6.2",
    "GPU architecture": "none",
    "KOKKOSKERNELS_ENABLE_TPL_ARMPL": "no",
    "KOKKOSKERNELS_ENABLE_TPL_BLAS": "no",
    "KOKKOSKERNELS_ENABLE_TPL_CBLAS": "no",
    "KOKKOSKERNELS_ENABLE_TPL_CHOLMOD": "no",
    "KOKKOSKERNELS_ENABLE_TPL_CUBLAS": "no",
    "KOKKOSKERNELS_ENABLE_TPL_CUSPARSE": "no",
    "KOKKOSKERNELS_ENABLE_TPL_LAPACK": "no",
    "KOKKOSKERNELS_ENABLE_TPL_LAPACKE": "no",
    "KOKKOSKERNELS_ENABLE_TPL_MAGMA": "no",
    "KOKKOSKERNELS_ENABLE_TPL_METIS": "no",
    "KOKKOSKERNELS_ENABLE_TPL_MKL": "no",
    "KOKKOSKERNELS_ENABLE_TPL_ROCBLAS": "no",
    "KOKKOSKERNELS_ENABLE_TPL_ROCSPARSE": "no",
    "KOKKOSKERNELS_ENABLE_TPL_SUPERLU": "no",
    "KOKKOS_COMPILER_CLANG": "1507",
    "KOKKOS_ENABLE_ASM": "no",
    "KOKKOS_ENABLE_CXX17": "yes",
    "KOKKOS_ENABLE_CXX20": "no",
    "KOKKOS_ENABLE_CXX23": "no",
    "KOKKOS_ENABLE_DEBUG_BOUNDS_CHECK": "yes",
    "KOKKOS_ENABLE_GNU_ATOMICS": "no",
    "KOKKOS_ENABLE_HBWSPACE": "no",
    "KOKKOS_ENABLE_HWLOC": "yes",
    "KOKKOS_ENABLE_INTEL_ATOMICS": "no",
    "KOKKOS_ENABLE_INTEL_MM_ALLOC": "no",
    "KOKKOS_ENABLE_LIBDL": "yes",
    "KOKKOS_ENABLE_LIBRT": "no",
    "KOKKOS_ENABLE_OPENMP": "yes",
    "KOKKOS_ENABLE_OPENMP_ATOMICS": "no",
    "KOKKOS_ENABLE_PRAGMA_IVDEP": "no",
    "KOKKOS_ENABLE_PRAGMA_LOOPCOUNT": "no",
    "KOKKOS_ENABLE_PRAGMA_UNROLL": "no",
    "KOKKOS_ENABLE_PRAGMA_VECTOR": "no",
    "KOKKOS_ENABLE_SERIAL": "yes",
    "KOKKOS_ENABLE_SERIAL_ATOMICS": "no",
    "KOKKOS_ENABLE_WINDOWS_ATOMICS": "no",
    "Kokkos": "OpenMP thread_pool_topology[ 1 x 8 x 1 ]",
    "Kokkos Version": "4.0.0",
    "KokkosKernels Version": "4.0.99"
  },
  "benchmarks": [
    {
      "name": "KokkosBlas2_gemv/m:1000/n:2000/LayoutRight:1/manual_time",
      "family_index": 0,
      "per_family_instance_index": 0,
      "run_name": "KokkosBlas2_gemv/m:1000/n:2000/LayoutRight:1/manual_time",
      "run_type": "iteration",
      "repetitions": 1,
      "repetition_index": 0,
      "threads": 1,
      "iterations": 90,
      "real_time": 7.6139030333333291e-03,
      "cpu_time": 7.5903666777777786e-03,
      "time_unit": "s",
      "Avg GEMV FLOP/s:": 5.2535473363505912e+08,
      "Avg GEMV time (s):": 7.6139030333333291e-03,
      "OpenMP": 1.0000000000000000e+00
    }
  ]
}

kokkos-devops-admin · 2023-03-15T12:19:32Z

Status Flag 'Pre-Test Inspection' - - This Pull Request Requires Inspection... The code must be inspected by a member of the Team before Testing/Merging
NO INSPECTION HAS BEEN PERFORMED ON THIS PULL REQUEST! - This PR must be inspected by setting label 'AT: PRE-TEST INSPECTED'.

kokkos-devops-admin · 2023-03-17T09:18:40Z

Status Flag 'Pre-Test Inspection' - - This Pull Request Requires Inspection... The code must be inspected by a member of the Team before Testing/Merging
NO INSPECTION HAS BEEN PERFORMED ON THIS PULL REQUEST! - This PR must be inspected by setting label 'AT: PRE-TEST INSPECTED'.

kokkos-devops-admin · 2023-03-20T12:48:38Z

Status Flag 'Pre-Test Inspection' - - This Pull Request Requires Inspection... The code must be inspected by a member of the Team before Testing/Merging
NO INSPECTION HAS BEEN PERFORMED ON THIS PULL REQUEST! - This PR must be inspected by setting label 'AT: PRE-TEST INSPECTED'.

kokkos-devops-admin · 2023-03-21T22:53:06Z

Status Flag 'Pre-Test Inspection' - - This Pull Request Requires Inspection... The code must be inspected by a member of the Team before Testing/Merging
NO INSPECTION HAS BEEN PERFORMED ON THIS PULL REQUEST! - This PR must be inspected by setting label 'AT: PRE-TEST INSPECTED'.

kokkos-devops-admin · 2023-03-23T23:08:52Z

Status Flag 'Pre-Test Inspection' - - This Pull Request Requires Inspection... The code must be inspected by a member of the Team before Testing/Merging
NO INSPECTION HAS BEEN PERFORMED ON THIS PULL REQUEST! - This PR must be inspected by setting label 'AT: PRE-TEST INSPECTED'.

perf_test/blas/blas1/KokkosBlas_dot_mv_perf_test_benchmark.cpp

perf_test/blas/blas1/KokkosBlas_dot_perf_test_benchmark.cpp

fnrizzi · 2023-03-28T08:49:50Z

perf_test/blas/blas1/KokkosBlas_team_dot_perf_test_benchmark.cpp

@@ -128,8 +128,6 @@ static void run(benchmark::State& state) {
    double avg   = total / repeat;
    // Flops calculation for a 1D matrix dot product per test run;
    size_t flopsPerRun = (size_t)2 * m;
-    printf("Avg DOT time: %f s.\n", avg);
-    printf("Avg DOT FLOP/s: %.3e\n", flopsPerRun / avg);
    state.SetIterationTime(timer.seconds());


I would move this change to a separate PR ideally

Done (all blas1 modifications reverted).

cz4rs · 2023-03-28T18:23:50Z

This is freshly rebased and ready for review. @lucbv can you please have a look?

kokkos-devops-admin · 2023-03-28T21:36:08Z

Status Flag 'Pre-Test Inspection' - - This Pull Request Requires Inspection... The code must be inspected by a member of the Team before Testing/Merging
NO INSPECTION HAS BEEN PERFORMED ON THIS PULL REQUEST! - This PR must be inspected by setting label 'AT: PRE-TEST INSPECTED'.

lucbv

Looks fine

kokkos-devops-admin · 2023-03-30T05:56:01Z

Status Flag 'Pre-Test Inspection' - SUCCESS: The last commit to this Pull Request has been INSPECTED by label AT: PRE-TEST INSPECTED! Autotester is Removing Label; This inspection will remain valid until a new commit to source branch is performed.

kokkos-devops-admin · 2023-03-30T06:59:49Z

Status Flag 'Pull Request AutoTester' - Failure: Timed out waiting for job KokkosKernels_PullRequest_CUDA11_CUDA11_LayoutRight to start: Total Wait = 3603

Other jobs have been previously started - We must stop them...

cz4rs · 2023-04-06T10:51:27Z

Rebased on top of develop.

kokkos-devops-admin · 2023-04-06T10:56:45Z

Status Flag 'Pre-Test Inspection' - - This Pull Request Requires Inspection... The code must be inspected by a member of the Team before Testing/Merging
NO INSPECTION HAS BEEN PERFORMED ON THIS PULL REQUEST! - This PR must be inspected by setting label 'AT: PRE-TEST INSPECTED'.

cz4rs · 2023-04-06T16:23:09Z

Converting to draft.
TODO:

use separate executable
use common approach for command line parameters handling

Let benchmark decide how many iterations will be run when --repeat is not provided.

kokkos-devops-admin · 2023-04-12T21:06:14Z

Status Flag 'Pre-Test Inspection' - - This Pull Request Requires Inspection... The code must be inspected by a member of the Team before Testing/Merging
NO INSPECTION HAS BEEN PERFORMED ON THIS PULL REQUEST! - This PR must be inspected by setting label 'AT: PRE-TEST INSPECTED'.

lucbv

Okay this looks good to me

lucbv · 2023-04-12T14:01:47Z

perf_test/ode/CMakeLists.txt

+  KOKKOSKERNELS_ADD_BENCHMARK(
+    ode_runge_kutta SOURCES KokkosODE_RK.cpp


Yes, thanks for the update that's cleaner!

lucbv · 2023-04-12T14:02:22Z

perf_test/ode/KokkosODE_RK.cpp

@@ -353,8 +353,7 @@ int main(int argc, char** argv) {
        run_benchmark_wrapper<Kokkos::DefaultExecutionSpace>, argc, argv)
        ->UseRealTime()
        ->ArgNames({"n", "model"})
-        ->Args({1000, 1})
-        ->Iterations(common_params.repeat);


Indeed, that was intention. Thanks for the update

lucbv · 2023-04-13T16:01:43Z

@cz4rs this should go through our CI some time today, assuming it passes fine we should be able to merge this!

kokkos-devops-admin · 2023-04-13T21:45:31Z

Status Flag 'Pre-Test Inspection' - SUCCESS: The last commit to this Pull Request has been INSPECTED by label AT: PRE-TEST INSPECTED! Autotester is Removing Label; This inspection will remain valid until a new commit to source branch is performed.

kokkos-devops-admin · 2023-04-13T21:51:16Z

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: KokkosKernels_PullRequest_CUDA11_CUDA11_LayoutRight

Build Num: 509
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC930_Light_Tpls_GCC930_Tpls_CLANG13CUDA10

Build Num: 112
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020

Build Num: 142
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020_Light_LayoutRight

Build Num: 412
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC1020

Build Num: 373
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL19

Build Num: 462
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

Build Num: 515
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_A64FX_Tpls_ARMPL2110

Build Num: 316
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_A64FX_GCC1020

Build Num: 311
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_VEGA908_ROCM520

Build Num: 314
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Using Repos:

Repo: KOKKOSKERNELS (NexGenAnalytics/kokkos-kernels)

Pull Request Author: cz4rs

kokkos-devops-admin · 2023-04-14T00:15:26Z

Status Flag 'Pull Request AutoTester' - Jenkins Testing: all Jobs PASSED

Pull Request Auto Testing has PASSED (click to expand)

Build Information

Test Name: KokkosKernels_PullRequest_CUDA11_CUDA11_LayoutRight

Build Num: 509
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC930_Light_Tpls_GCC930_Tpls_CLANG13CUDA10

Build Num: 112
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020

Build Num: 142
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020_Light_LayoutRight

Build Num: 412
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC1020

Build Num: 373
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL19

Build Num: 462
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

Build Num: 515
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_A64FX_Tpls_ARMPL2110

Build Num: 316
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_A64FX_GCC1020

Build Num: 311
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_VEGA908_ROCM520

Build Num: 314
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-benchmark-blas2-tests
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`97187c3`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`8154037`
PR_LABELS
PULLREQUESTNUM	1733
TEST_REPO_ALIAS	KOKKOSKERNELS

kokkos-devops-admin · 2023-04-14T00:15:43Z

Status Flag 'Pre-Merge Inspection' - SUCCESS: The last commit to this Pull Request has been INSPECTED AND APPROVED by [ lucbv fnrizzi ]!

kokkos-devops-admin · 2023-04-14T00:15:50Z

Status Flag 'Pull Request AutoTester' - Pull Request MUST BE MERGED MANUALLY BY Project Team - This Repo does not support Automerge

cz4rs force-pushed the 5-google-benchmark-blas2-tests branch from 39afa64 to 8e2ec89 Compare March 16, 2023 15:24

cz4rs force-pushed the 5-google-benchmark-blas2-tests branch 2 times, most recently from af1ead4 to f9f27aa Compare March 20, 2023 12:34

cz4rs marked this pull request as ready for review March 20, 2023 13:15

cz4rs force-pushed the 5-google-benchmark-blas2-tests branch from f1d33d5 to a998d2d Compare March 21, 2023 19:25

cz4rs force-pushed the 5-google-benchmark-blas2-tests branch 2 times, most recently from 5922864 to 8319bae Compare March 23, 2023 23:03

fnrizzi reviewed Mar 28, 2023

View reviewed changes

perf_test/blas/blas1/KokkosBlas_dot_mv_perf_test_benchmark.cpp Outdated Show resolved Hide resolved

fnrizzi reviewed Mar 28, 2023

View reviewed changes

perf_test/blas/blas1/KokkosBlas_dot_perf_test_benchmark.cpp Outdated Show resolved Hide resolved

fnrizzi reviewed Mar 28, 2023

View reviewed changes

cz4rs force-pushed the 5-google-benchmark-blas2-tests branch from 8319bae to a0163e9 Compare March 28, 2023 15:28

cz4rs requested a review from fnrizzi March 28, 2023 15:28

fnrizzi approved these changes Mar 28, 2023

View reviewed changes

lucbv approved these changes Mar 29, 2023

View reviewed changes

lucbv added the AT: PRE-TEST INSPECTED Mark this PR as approved for testing. label Mar 29, 2023

kokkos-devops-admin removed the AT: PRE-TEST INSPECTED Mark this PR as approved for testing. label Mar 30, 2023

cz4rs force-pushed the 5-google-benchmark-blas2-tests branch from a0163e9 to 2e8d587 Compare April 6, 2023 10:51

cz4rs marked this pull request as draft April 6, 2023 16:22

cz4rs added 16 commits April 12, 2023 21:37

Let benchmark calculate FLOP/s

6d02701

Add a benchmark for LayoutRight

7336d9c

Use correct header

b3da125

Use stored time value

278d18f

Revert changes to blas1 benchmark

6c21c4d

Use separate executable

24923b7

Move warm-up out of benchmarking loop

10dc298

Parse common parameters

1d70e7a

Use CMake helper for ODE_RK benchmark

03728a8

Let benchmark decide number of iterations

f38b56a

Let benchmark decide how many iterations will be run when --repeat is not provided.

Parse blas2 custom command line parameters

34a2286

Add registration wrapper

3324854

Fix formatting

35ee9ee

Support all command line parameters

5d237f8

Reduce duplication

15d6169

Allow passing additional arguments

97187c3

cz4rs force-pushed the 5-google-benchmark-blas2-tests branch from e0e0030 to 97187c3 Compare April 12, 2023 20:56

cz4rs requested a review from fnrizzi April 12, 2023 20:57

fnrizzi approved these changes Apr 13, 2023

View reviewed changes

lucbv approved these changes Apr 13, 2023

View reviewed changes

lucbv added the AT: PRE-TEST INSPECTED Mark this PR as approved for testing. label Apr 13, 2023

kokkos-devops-admin removed the AT: PRE-TEST INSPECTED Mark this PR as approved for testing. label Apr 13, 2023

lucbv merged commit 5015a2c into kokkos:develop Apr 14, 2023

		KOKKOSKERNELS_ADD_BENCHMARK(
		ode_runge_kutta SOURCES KokkosODE_RK.cpp

#5 Refactor blas2 test for benchmark feature #1733

#5 Refactor blas2 test for benchmark feature #1733

Conversation

cz4rs commented Mar 15, 2023 • edited Loading

kokkos-devops-admin commented Mar 15, 2023

kokkos-devops-admin commented Mar 17, 2023

kokkos-devops-admin commented Mar 20, 2023

kokkos-devops-admin commented Mar 21, 2023

kokkos-devops-admin commented Mar 23, 2023

fnrizzi Mar 28, 2023

Choose a reason for hiding this comment

cz4rs Mar 28, 2023

Choose a reason for hiding this comment

cz4rs commented Mar 28, 2023

kokkos-devops-admin commented Mar 28, 2023

lucbv left a comment

Choose a reason for hiding this comment

kokkos-devops-admin commented Mar 30, 2023

kokkos-devops-admin commented Mar 30, 2023

cz4rs commented Apr 6, 2023

kokkos-devops-admin commented Apr 6, 2023

cz4rs commented Apr 6, 2023

kokkos-devops-admin commented Apr 12, 2023

lucbv left a comment

Choose a reason for hiding this comment

lucbv Apr 12, 2023

Choose a reason for hiding this comment

lucbv Apr 12, 2023

Choose a reason for hiding this comment

lucbv commented Apr 13, 2023

kokkos-devops-admin commented Apr 13, 2023

kokkos-devops-admin commented Apr 13, 2023

Build Information

Test Name: KokkosKernels_PullRequest_CUDA11_CUDA11_LayoutRight

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_GCC930_Light_Tpls_GCC930_Tpls_CLANG13CUDA10

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020_Light_LayoutRight

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC1020

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL19

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_A64FX_Tpls_ARMPL2110

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_A64FX_GCC1020

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_VEGA908_ROCM520

Jenkins Parameters

Using Repos:

kokkos-devops-admin commented Apr 14, 2023

Build Information

Test Name: KokkosKernels_PullRequest_CUDA11_CUDA11_LayoutRight

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_GCC930_Light_Tpls_GCC930_Tpls_CLANG13CUDA10

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020_Light_LayoutRight

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC1020

Jenkins Parameters

Build Information

cz4rs commented Mar 15, 2023 •

edited

Loading