Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmark cleanup for par_ilut and spmv #1853

Merged
merged 1 commit into from
Jun 12, 2023

Conversation

jgfouca
Copy link
Contributor

@jgfouca jgfouca commented Jun 7, 2023

  1. Make better use of google benchmark in par_ilut benchmark
  2. Re-enable par_ilut benchmark, warnings should be fixed
  3. Add new KK_USER_REQUIRE macros to KokkosKernels_Error. Makes it
    convenient to check and throw a good exception for user errors.
  4. Fix option help in spmv benchmark (was saying -s instead of -n)
  5. Fix option parsing in spmv benchmark. Bad options were printed to cerr
    but program execution was not halted.
  6. Fix google bm argument list in spmv benchmark. It was always reporting
    n=100000 even when that was not the case. It will still report an incorrect
    n if an input A is used, but this is a step in the right direction. This
    requires run_spmv to a spmv_parameters object instead of argc/argv.
  7. Use register_benchmark_real_time in spmv benchmark. The code there was identical
    to it.

1) Make better use of google benchmark in par_ilut benchmark
2) Re-enable par_ilut benchmark, warnings should be fixed
3) Add new KK_USER_REQUIRE macros to KokkosKernels_Error. Makes it
   convenient to check and throw a good exception for user errors.
4) Fix option help in spmv benchmark (was saying -s instead of -n)
5) Fix option parsing in spmv benchmark. Bad options were printed to cerr
   but program execution was not halted.
6) Fix google bm argument list in spmv benchmark. It was always reporting
   n=100000 even when that was not the case. It will still report an incorrect
   n if an input A is used, but this is a step in the right direction. This
   requires run_spmv to a spmv_parameters object instead of argc/argv.
7) Use register_benchmark_real_time in spmv benchmark. The code there was identical
   to it.
@jgfouca jgfouca requested review from brian-kelley and lucbv June 7, 2023 21:45
@kokkos-devops-admin
Copy link

Status Flag 'Pre-Test Inspection' - Auto Inspected - Inspection is Not Necessary for this Pull Request.

@kokkos-devops-admin
Copy link

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: KokkosKernels_PullRequest_CUDA11_CUDA11_LayoutRight

  • Build Num: 668
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC930_Light_Tpls_GCC930_Tpls_CLANG13CUDA10

  • Build Num: 259
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020

  • Build Num: 282
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020_Light_LayoutRight

  • Build Num: 552
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC1020

  • Build Num: 513
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL19

  • Build Num: 602
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

  • Build Num: 655
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_A64FX_Tpls_ARMPL2110

  • Build Num: 456
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_A64FX_GCC1020

  • Build Num: 451
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_VEGA908_ROCM520

  • Build Num: 452
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Using Repos:

Repo: KOKKOSKERNELS (jgfouca/kokkos-kernels)
  • Branch: jgfouca/imprv_par_ilut_bench
  • SHA: 5a2c690
  • Mode: TEST_REPO

Pull Request Author: jgfouca

@kokkos-devops-admin
Copy link

Status Flag 'Pull Request AutoTester' - Jenkins Testing: all Jobs PASSED

Pull Request Auto Testing has PASSED (click to expand)

Build Information

Test Name: KokkosKernels_PullRequest_CUDA11_CUDA11_LayoutRight

  • Build Num: 668
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC930_Light_Tpls_GCC930_Tpls_CLANG13CUDA10

  • Build Num: 259
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020

  • Build Num: 282
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_GCC1020_Light_LayoutRight

  • Build Num: 552
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_GCC1020

  • Build Num: 513
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_Tpls_INTEL19

  • Build Num: 602
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_CLANG1001

  • Build Num: 655
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_A64FX_Tpls_ARMPL2110

  • Build Num: 456
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_A64FX_GCC1020

  • Build Num: 451
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

Build Information

Test Name: KokkosKernels_PullRequest_VEGA908_ROCM520

  • Build Num: 452
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
KOKKOSKERNELS_SOURCE_REPO https://github.com/jgfouca/kokkos-kernels
KOKKOSKERNELS_SOURCE_SHA 5a2c690
KOKKOSKERNELS_TARGET_BRANCH develop
KOKKOSKERNELS_TARGET_REPO https://github.com/kokkos/kokkos-kernels
KOKKOSKERNELS_TARGET_SHA fa2bdef
PR_LABELS
PULLREQUESTNUM 1853
TEST_REPO_ALIAS KOKKOSKERNELS

@kokkos-devops-admin
Copy link

Status Flag 'Pre-Merge Inspection' - SUCCESS: The last commit to this Pull Request has been INSPECTED AND APPROVED by [ brian-kelley ]!

@kokkos-devops-admin
Copy link

Status Flag 'Pull Request AutoTester' - Pull Request MUST BE MERGED MANUALLY BY Project Team - This Repo does not support Automerge

4 similar comments
@kokkos-devops-admin
Copy link

Status Flag 'Pull Request AutoTester' - Pull Request MUST BE MERGED MANUALLY BY Project Team - This Repo does not support Automerge

@kokkos-devops-admin
Copy link

Status Flag 'Pull Request AutoTester' - Pull Request MUST BE MERGED MANUALLY BY Project Team - This Repo does not support Automerge

@kokkos-devops-admin
Copy link

Status Flag 'Pull Request AutoTester' - Pull Request MUST BE MERGED MANUALLY BY Project Team - This Repo does not support Automerge

@kokkos-devops-admin
Copy link

Status Flag 'Pull Request AutoTester' - Pull Request MUST BE MERGED MANUALLY BY Project Team - This Repo does not support Automerge

@brian-kelley brian-kelley merged commit ce8bb98 into kokkos:develop Jun 12, 2023
@jgfouca jgfouca deleted the jgfouca/imprv_par_ilut_bench branch June 12, 2023 16:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants