Thanks for your patience. Conbench analyzed the 4 benchmarking runs that have been run so far on PR commit 9134050.

Benchmarks with performance regressions

There were 15 possible performance regressions, according to the lookback z-score method.

Benchmarks with regressions:

• Pull Request Run on arm64-t4g-2xlarge-linux at 2024-09-14 10:03:07Z

  • BitBlockCounterFourWordsSum (C++) with params=4096, source=cpp-micro, suite=arrow-bit-block-counter-benchmark
  • BenchmarkBitmapVisitBitsetAnd (C++) with params=131072/0, source=cpp-micro, suite=arrow-bit-util-benchmark
  • TakeInt64RandomIndicesWithNulls (C++) with params=1048576/1, source=cpp-micro, suite=arrow-compute-vector-selection-benchmark

• Pull Request Run on amd64-c6a-4xlarge-linux at 2024-09-14 09:46:05Z

  • BM_DeltaBitPackingEncode_Int32_Narrow (C++) with params=4096, source=cpp-micro, suite=parquet-encoding-benchmark
  • BM_DictEncodingInt64_repeats (C++) with params=1024, source=cpp-micro, suite=parquet-encoding-benchmark
  • FieldPathGetFromWideChunkedArray (C++) with params=2, source=cpp-micro, suite=arrow-type-benchmark
  • BM_WriteBinaryColumn (C++) with params=null_probability:0/unique_values:32, source=cpp-micro, suite=parquet-arrow-reader-writer-benchmark
  • TouchArea (C++) with params=size:1048576/real_time/threads:8, source=cpp-micro, suite=arrow-memory-pool-benchmark
  • BM_DeltaBitPackingEncode_Int32_Narrow (C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmark

• Pull Request Run on amd64-m5-4xlarge-linux at 2024-09-14 09:58:13Z

  • ArrayRankInt64Narrow (C++) with params=32768/10/tiebreaker:3, source=cpp-micro, suite=arrow-compute-vector-sort-benchmark
  • ArrayRankInt64Narrow (C++) with params=32768/100/tiebreaker:0, source=cpp-micro, suite=arrow-compute-vector-sort-benchmark
  • ArrayRankInt64Narrow (C++) with params=32768/100/tiebreaker:3, source=cpp-micro, suite=arrow-compute-vector-sort-benchmark
  • ArrayRankInt64Narrow (C++) with params=32768/10/tiebreaker:2, source=cpp-micro, suite=arrow-compute-vector-sort-benchmark

• Pull Request Run on test-mac-arm at 2024-09-14 10:03:57Z

  • ConstructFromShortStdVector (C++) with params=<STD_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmark
  • BenchmarkTemporal (C++) with params=<Hour, non_zoned>/4194304/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmark

All benchmark runs analyzed:

• Pull Request Run on arm64-t4g-2xlarge-linux at 2024-09-14 10:03:07Z
• Pull Request Run on amd64-c6a-4xlarge-linux at 2024-09-14 09:46:05Z
• Pull Request Run on amd64-m5-4xlarge-linux at 2024-09-14 09:58:13Z
• Pull Request Run on test-mac-arm at 2024-09-14 10:03:57Z