#5 Refactor blas1 test for benchmark feature #1636

mperrinel · 2022-12-21T13:53:52Z

This PR provides a first example converting one blas test (KokkosBlas_dot) to using google bench.
The idea is that to show what the tests would look like and what output they generate, and if accepted, we can use the same "structure" for porting all other performance tests

Configuration to enable benchmark:
cmake .<KOKKOS-KERNELS_SOURCE_DIR> -DKokkos_DIR:DIR==<KOKKOS_INSTALL_DIR>/lib/cmake/Kokkos -DKokkosKernels_ENABLE_BENCHMARK=ON -DKokkosKernels_ENABLE_TESTS=ON -DKokkosKernels_ENABLE_ALL_COMPONENTS=ON -DKokkosKernels_ENABLE_PERFTESTS=ON

The file containing the code that was changed is this: https://github.com/kokkos/kokkos-kernels/pull/1636/files#diff-467ac095c3b5b7db0d220fbfa379fe328b2024ff6d516cd80a910cdcbeb78c1a"

See below the json output from googlebench that gives a summary of the configuration, metrics, etc for the test

benchmark output in json format

{
  "context": {
    "date": "2023-03-02T19:19:26+01:00",
    "host_name": "perrinel-MS-7C75",
    "executable": "/home/perrinel/Dev/kokkos/build_kernel_benchmark/perf_test/KokkosKernels_PerformanceTest_Benchmark",
    "num_cpus": 20,
    "mhz_per_cpu": 5300,
    "cpu_scaling_enabled": true,
    "caches": [
      {
        "type": "Data",
        "level": 1,
        "size": 32768,
        "num_sharing": 2
      },
      {
        "type": "Instruction",
        "level": 1,
        "size": 32768,
        "num_sharing": 2
      },
      {
        "type": "Unified",
        "level": 2,
        "size": 262144,
        "num_sharing": 2
      },
      {
        "type": "Unified",
        "level": 3,
        "size": 20971520,
        "num_sharing": 20
      }
    ],
    "load_avg": [3.13,1.83,0.87],
    "library_build_type": "debug",
    "CPU architecture": "none",
    "Default Device": "N6Kokkos6SerialE",
    "GPU architecture": "none",
    "KOKKOSKERNELS_ENABLE_TPL_ARMPL": "no",
    "KOKKOSKERNELS_ENABLE_TPL_BLAS": "no",
    "KOKKOSKERNELS_ENABLE_TPL_CBLAS": "no",
    "KOKKOSKERNELS_ENABLE_TPL_CHOLMOD": "no",
    "KOKKOSKERNELS_ENABLE_TPL_CUBLAS": "no",
    "KOKKOSKERNELS_ENABLE_TPL_CUSPARSE": "no",
    "KOKKOSKERNELS_ENABLE_TPL_LAPACK": "no",
    "KOKKOSKERNELS_ENABLE_TPL_LAPACKE": "no",
    "KOKKOSKERNELS_ENABLE_TPL_MAGMA": "no",
    "KOKKOSKERNELS_ENABLE_TPL_METIS": "no",
    "KOKKOSKERNELS_ENABLE_TPL_MKL": "no",
    "KOKKOSKERNELS_ENABLE_TPL_ROCBLAS": "no",
    "KOKKOSKERNELS_ENABLE_TPL_ROCSPARSE": "no",
    "KOKKOSKERNELS_ENABLE_TPL_SUPERLU": "no",
    "KOKKOS_COMPILER_GNU": "940",
    "KOKKOS_ENABLE_ASM": "yes",
    "KOKKOS_ENABLE_CXX17": "yes",
    "KOKKOS_ENABLE_CXX20": "no",
    "KOKKOS_ENABLE_CXX23": "no",
    "KOKKOS_ENABLE_DEBUG_BOUNDS_CHECK": "no",
    "KOKKOS_ENABLE_GNU_ATOMICS": "no",
    "KOKKOS_ENABLE_HBWSPACE": "no",
    "KOKKOS_ENABLE_HWLOC": "no",
    "KOKKOS_ENABLE_INTEL_ATOMICS": "no",
    "KOKKOS_ENABLE_INTEL_MM_ALLOC": "no",
    "KOKKOS_ENABLE_LIBDL": "yes",
    "KOKKOS_ENABLE_LIBRT": "no",
    "KOKKOS_ENABLE_PRAGMA_IVDEP": "no",
    "KOKKOS_ENABLE_PRAGMA_LOOPCOUNT": "no",
    "KOKKOS_ENABLE_PRAGMA_UNROLL": "no",
    "KOKKOS_ENABLE_PRAGMA_VECTOR": "no",
    "KOKKOS_ENABLE_SERIAL": "yes",
    "KOKKOS_ENABLE_SERIAL_ATOMICS": "no",
    "KOKKOS_ENABLE_WINDOWS_ATOMICS": "no",
    "Kokkos Version": "4.0.99",
    "KokkosKernels Version": "4.0.99"
  },
  "benchmarks": [
    {
      "name": "KokkosBlas_dot/m:100000/repeat:1/manual_time",
      "family_index": 0,
      "per_family_instance_index": 0,
      "run_name": "KokkosBlas_dot/m:100000/repeat:1/manual_time",
      "run_type": "iteration",
      "repetitions": 1,
      "repetition_index": 0,
      "threads": 1,
      "iterations": 484,
      "real_time": 1.4449344855371896e-03,
      "cpu_time": 2.8886822851239670e-03,
      "time_unit": "s",
      "Avg DOT FLOP/s:": 1.4001346929574627e+08,
      "Avg DOT time (s):": 1.4284339999999999e-03
    },
    {
      "name": "KokkosBlas_dot_mv/m:100000/n:5/repeat:20/manual_time",
      "family_index": 1,
      "per_family_instance_index": 0,
      "run_name": "KokkosBlas_dot_mv/m:100000/n:5/repeat:20/manual_time",
      "run_type": "iteration",
      "repetitions": 1,
      "repetition_index": 0,
      "threads": 1,
      "iterations": 3,
      "real_time": 2.0546729999999999e-01,
      "cpu_time": 2.1573627266666673e-01,
      "time_unit": "s",
      "Avg DOT FLOP/s:": 9.7024361318100587e+07,
      "Avg DOT time (s):": 1.0306689850000000e-02
    },
    {
      "name": "KokkosBlas_team_dot/run<Kokkos::DefaultExecutionSpace>/m:100000/repeat:1/manual_time",
      "family_index": 2,
      "per_family_instance_index": 0,
      "run_name": "KokkosBlas_team_dot/run<Kokkos::DefaultExecutionSpace>/m:100000/repeat:1/manual_time",
      "run_type": "iteration",
      "repetitions": 1,
      "repetition_index": 0,
      "threads": 1,
      "iterations": 429,
      "real_time": 1.6436447202797205e-03,
      "cpu_time": 3.2831944988344999e-03,
      "time_unit": "s",
      "Avg DOT FLOP/s:": 1.2376153380144070e+08,
      "Avg DOT time (s):": 1.6160110000000001e-03
    }
  ]
}

kokkos-devops-admin · 2023-01-25T15:16:37Z

Status Flag 'Pre-Test Inspection' - - This Pull Request Requires Inspection... The code must be inspected by a member of the Team before Testing/Merging
NO INSPECTION HAS BEEN PERFORMED ON THIS PULL REQUEST! - This PR must be inspected by setting label 'AT: PRE-TEST INSPECTED'.

cwpearson · 2023-01-26T16:42:41Z

I made a related comment over here: #1626 (comment)

This looks like a really great set of information. Would it be possible to include the following:

General:

compilers and versions used for the build
as precise a version as possible of all dependencies
- Kokkos Core SHA
- Kokkos Kernels SHA
- any TPLs
- Google Benchmark

OpenMP environment variables for OpenMP benchmarks (from querying the environment variables, or querying the OpenMP API programmatically)

OMP_NUM_THREADS
OMP_DYNAMIC
OMP_PROC_BIND
OMP_PLACES

For CUDA (from parsing nvidia-smi, or using the CUDA runtime API query functions)

Nvidia driver version (probably taken from nvidia-smi)
GPU name / model / revision (enough to unambiguously identify the SKU, this is more than just the GPU architecture)

For AMD / Intel GPUs:

analogous to CUDA

This information is good to have to reproduce any issues that arise.

cwpearson · 2023-01-26T17:03:23Z

Summary of our internal conversation:

Two ways to do this:

gather additional information when the benchmark is run, and add it as benchmark context and it will show up in the JSON output.
Have this available as metadata attached to a benchmark run somehow in the performance dashboard system, so Kokkos Kernels is not responsible for gathering it.

Other thoughts:

Core may gather some of this information
We may want kernels to gather some of this information generally, and just happen to print it at benchmark time (possibly out of scope for this specific effort).

fnrizzi · 2023-01-26T17:23:54Z

@cwpearson the compiler is already there actually

"KOKKOS_COMPILER_GNU": "940",

all other stuff makes sense, I will double check

kokkos-devops-admin · 2023-03-03T00:04:03Z

Status Flag 'Pre-Test Inspection' - - This Pull Request Requires Inspection... The code must be inspected by a member of the Team before Testing/Merging
NO INSPECTION HAS BEEN PERFORMED ON THIS PULL REQUEST! - This PR must be inspected by setting label 'AT: PRE-TEST INSPECTED'.

cz4rs · 2023-03-09T17:08:50Z

Freshly rebased on top of develop.

kokkos-devops-admin · 2023-03-09T17:16:39Z

Status Flag 'Pre-Test Inspection' - - This Pull Request Requires Inspection... The code must be inspected by a member of the Team before Testing/Merging
NO INSPECTION HAS BEEN PERFORMED ON THIS PULL REQUEST! - This PR must be inspected by setting label 'AT: PRE-TEST INSPECTED'.

lucbv

Looks good to me.

kokkos-devops-admin · 2023-03-15T22:56:18Z

Status Flag 'Pre-Test Inspection' - SUCCESS: The last commit to this Pull Request has been INSPECTED by label AT: PRE-TEST INSPECTED! Autotester is Removing Label; This inspection will remain valid until a new commit to source branch is performed.

kokkos-devops-admin · 2023-03-15T23:04:47Z

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: KokkosKernels_PullRequest_GCC930_Light_Tpls_GCC930

Build Num: 378
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_CUDA11_CUDA11_LayoutRight

Build Num: 383
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020

Build Num: 25
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020_Light_LayoutRight

Build Num: 296
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC1020

Build Num: 259
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL19

Build Num: 346
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

Build Num: 398
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_CLANG13CUDA10

Build Num: 310
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_A64FX_Tpls_ARMPL2110

Build Num: 200
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_A64FX_GCC1020

Build Num: 197
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_VEGA908_ROCM520

Build Num: 199
Status: STARTED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Using Repos:

Repo: KOKKOSKERNELS (NexGenAnalytics/kokkos-kernels)

Pull Request Author: mperrinel

kokkos-devops-admin · 2023-03-16T01:25:33Z

Status Flag 'Pull Request AutoTester' - Jenkins Testing: all Jobs PASSED

Pull Request Auto Testing has PASSED (click to expand)

Build Information

Test Name: KokkosKernels_PullRequest_GCC930_Light_Tpls_GCC930

Build Num: 378
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_CUDA11_CUDA11_LayoutRight

Build Num: 383
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020

Build Num: 25
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020_Light_LayoutRight

Build Num: 296
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC1020

Build Num: 259
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL19

Build Num: 346
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

Build Num: 398
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_CLANG13CUDA10

Build Num: 310
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_A64FX_Tpls_ARMPL2110

Build Num: 200
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_A64FX_GCC1020

Build Num: 197
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_VEGA908_ROCM520

Build Num: 199
Status: PASSED

Jenkins Parameters

Parameter Name	Value
KOKKOSKERNELS_SOURCE_BRANCH	5-google-bench-dot-test
KOKKOSKERNELS_SOURCE_REPO	https://github.com/NexGenAnalytics/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA	`3ec0cb7`
KOKKOSKERNELS_TARGET_BRANCH	develop
KOKKOSKERNELS_TARGET_REPO	https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA	`0481552`
PR_LABELS
PULLREQUESTNUM	1636
TEST_REPO_ALIAS	KOKKOSKERNELS

kokkos-devops-admin · 2023-03-16T01:25:50Z

Status Flag 'Pre-Merge Inspection' - SUCCESS: The last commit to this Pull Request has been INSPECTED AND APPROVED by [ lucbv ]!

kokkos-devops-admin · 2023-03-16T01:25:57Z

Status Flag 'Pull Request AutoTester' - Pull Request MUST BE MERGED MANUALLY BY Project Team - This Repo does not support Automerge

mperrinel marked this pull request as draft December 21, 2022 13:54

mperrinel changed the title ~~#5 Added KokkosBlas::dot benchmark test~~ #5 Refactor blas1 test for benchmark feature Jan 3, 2023

fnrizzi mentioned this pull request Jan 25, 2023

draft #5 Added google benchmark to kokkos kernel and to the CI #1626

Merged

mperrinel mentioned this pull request Feb 2, 2023

add basis skeleton for KokkosKernels::print_configuration #1665

Merged

mperrinel force-pushed the 5-google-bench-dot-test branch 2 times, most recently from 4830672 to 8761546 Compare March 2, 2023 18:21

mperrinel marked this pull request as ready for review March 6, 2023 09:44

cz4rs mentioned this pull request Mar 6, 2023

improve context information for benchmarks #1718

Open

15 tasks

fnrizzi approved these changes Mar 6, 2023

View reviewed changes

cz4rs approved these changes Mar 9, 2023

View reviewed changes

mperrinel and others added 8 commits March 9, 2023 18:04

#5: Added benchmark dot perf test

0361d1d

#5: generalized execution space and removed unused include

7dfe9ef

#5: Fixed clang-format errors

7be07e5

#5: Added dot_mv benchmark test

e9c968c

#5: Fixed clang-format

4fc7908

#5: Added team dot benchmark test

56ef209

#5: Added better name for benchmark tests

8be3032

#5: Rebased on develop and added kernels print_configuration call

3ec0cb7

cz4rs force-pushed the 5-google-bench-dot-test branch from 8761546 to 3ec0cb7 Compare March 9, 2023 17:07

This was referenced Mar 14, 2023

Add git information to benchmark context #1722

Merged

#5 Refactor blas2 test for benchmark feature #1733

Merged

lucbv approved these changes Mar 15, 2023

View reviewed changes

lucbv added the AT: PRE-TEST INSPECTED Mark this PR as approved for testing. label Mar 15, 2023

kokkos-devops-admin removed the AT: PRE-TEST INSPECTED Mark this PR as approved for testing. label Mar 15, 2023

lucbv merged commit ff097ec into kokkos:develop Mar 16, 2023

#5 Refactor blas1 test for benchmark feature #1636

#5 Refactor blas1 test for benchmark feature #1636

Conversation

mperrinel commented Dec 21, 2022 • edited Loading

kokkos-devops-admin commented Jan 25, 2023

cwpearson commented Jan 26, 2023 • edited Loading

cwpearson commented Jan 26, 2023 • edited Loading

fnrizzi commented Jan 26, 2023 • edited Loading

kokkos-devops-admin commented Mar 3, 2023

cz4rs commented Mar 9, 2023

kokkos-devops-admin commented Mar 9, 2023

lucbv left a comment

Choose a reason for hiding this comment

kokkos-devops-admin commented Mar 15, 2023

kokkos-devops-admin commented Mar 15, 2023

Build Information

Test Name: KokkosKernels_PullRequest_GCC930_Light_Tpls_GCC930

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_CUDA11_CUDA11_LayoutRight

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020_Light_LayoutRight

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC1020

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL19

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_CLANG13CUDA10

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_A64FX_Tpls_ARMPL2110

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_A64FX_GCC1020

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_VEGA908_ROCM520

Jenkins Parameters

Using Repos:

kokkos-devops-admin commented Mar 16, 2023

Build Information

Test Name: KokkosKernels_PullRequest_GCC930_Light_Tpls_GCC930

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_CUDA11_CUDA11_LayoutRight

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020_Light_LayoutRight

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC1020

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL19

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_CLANG13CUDA10

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_A64FX_Tpls_ARMPL2110

Jenkins Parameters

Build Information

Test Name: KokkosKernels_PullRequest_A64FX_GCC1020

Jenkins Parameters

mperrinel commented Dec 21, 2022 •

edited

Loading

cwpearson commented Jan 26, 2023 •

edited

Loading

cwpearson commented Jan 26, 2023 •

edited

Loading

fnrizzi commented Jan 26, 2023 •

edited

Loading