conbench-apache-arrow / Conbench performance report
failed
Dec 7, 2023
Found 22 regressions
Thanks for your patience. Conbench analyzed the 6 benchmarking runs that have been run so far on PR commit 196255c.
Benchmarks with performance regressions
There were 0 possible performance regressions, according to the lookback z-score method.
All benchmark runs analyzed:
- Pull Request Run on
ec2-t3-xlarge-us-east-2
at 2023-12-07 18:31:27Z - Pull Request Run on
ec2-m5-4xlarge-us-east-2
at 2023-12-07 17:52:59Z - Pull Request Run on
ursa-i9-9960x
at 2023-12-07 20:03:55Z - Pull Request Run on
arm64-m6g-linux-compute
at 2023-12-07 18:40:31Z - Pull Request Run on
arm64-t4g-linux-compute
at 2023-12-07 19:29:03Z - Pull Request Run on
ursa-thinkcentre-m75q
at 2023-12-07 23:40:31Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
- Pull Request Run on
ursa-thinkcentre-m75q
at 2023-12-07 23:40:31ZArrayScalarKernel
(C++) with params=<Subtract, DoubleType>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Subtract, Int16Type>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<SubtractChecked, Int32Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Multiply, DoubleType>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBM_ByteStreamSplitDecode_Double_Scalar
(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkArrayScalarKernel
(C++) with params=<MultiplyChecked, UInt16Type>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBM_ByteStreamSplitDecode_Double_Scalar
(C++) with params=4096, source=cpp-micro, suite=parquet-encoding-benchmarkDoubleColumnMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCSFTensorInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_ByteStreamSplitDecode_Double_Scalar
(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkMaxElementWiseArrayScalarInt64
(C++) with params=32768/1, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkBinaryBitOp
(C++) with source=cpp-micro, suite=arrow-decimal-benchmarkFloatRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkArrayScalarKernel
(C++) with params=<Multiply, Int16Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkDoubleStridedTensorConversionFixture
(C++) with params=/ConvertToSparseCSFTensorInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkArrayScalarKernel
(C++) with params=<Multiply, Int16Type>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Multiply, DoubleType>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Subtract, DoubleType>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Subtract, Int16Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkShortVectorInsertAtEnd
(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkDoubleRowMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCOOTensorInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkArrayScalarKernel
(C++) with params=<MultiplyChecked, UInt16Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmark
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.
Loading