Skip to content

Latest commit

 

History

History
653 lines (630 loc) · 53.5 KB

File metadata and controls

653 lines (630 loc) · 53.5 KB

Benchmark Report

Job Properties

Commits: JuliaLang/julia@40f17341a281c0e45c8a396575a3b04e9e9ecfa0 vs JuliaLang/julia@dd122918ceb84dad9063a0866fc7b1262a38d273

Comparison Diff: link

Triggered By: link

Tag Predicate: ALL

Results

Note: If Chrome is your browser, I strongly recommend installing the Wide GitHub extension, which makes the result table easier to read.

Below is a table of this job's results, obtained by running the benchmarks found in JuliaCI/BaseBenchmarks.jl. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.

The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value.

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["array", "accumulate", ("accumulate!", "Int")] 1.43 (5%) ❌ 1.00 (1%)
["array", "accumulate", ("cumsum!", "Float64", "dim2")] 1.52 (5%) ❌ 1.00 (1%)
["array", "accumulate", ("cumsum", "Float64", "dim2")] 1.28 (5%) ❌ 1.00 (1%)
["array", "any/all", ("all", "Vector{Float32} generator")] 0.78 (5%) ✅ 1.00 (1%)
["array", "any/all", ("all", "Vector{Float32}")] 0.78 (5%) ✅ 1.00 (1%)
["array", "any/all", ("all", "Vector{Float64}")] 1.27 (5%) ❌ 1.00 (1%)
["array", "bool", "bitarray_bool_load!"] 1.16 (5%) ❌ 1.00 (1%)
["array", "cat", ("vcat_setind", 5)] 0.91 (5%) ✅ 1.00 (1%)
["array", "comprehension", ("collect", "StepRangeLen{Float64, Base.TwicePrecision{Float64}, Base.TwicePrecision{Float64}}")] 0.40 (5%) ✅ 1.00 (1%)
["array", "comprehension", ("collect", "Vector{Float64}")] 0.30 (5%) ✅ 1.00 (1%)
["array", "comprehension", ("comprehension_collect", "StepRangeLen{Float64, Base.TwicePrecision{Float64}, Base.TwicePrecision{Float64}}")] 0.40 (5%) ✅ 1.00 (1%)
["array", "comprehension", ("comprehension_collect", "Vector{Float64}")] 0.32 (5%) ✅ 1.00 (1%)
["array", "comprehension", ("comprehension_indexing", "Vector{Float64}")] 0.56 (30%) ✅ 1.00 (1%)
["array", "comprehension", ("comprehension_iteration", "StepRangeLen{Float64, Base.TwicePrecision{Float64}, Base.TwicePrecision{Float64}}")] 0.82 (5%) ✅ 1.00 (1%)
["array", "comprehension", ("comprehension_iteration", "Vector{Float64}")] 0.55 (5%) ✅ 1.00 (1%)
["array", "convert", ("Float64", "Int")] 0.76 (5%) ✅ 1.00 (1%)
["array", "equality", ("isequal", "Vector{Int64} isequal UnitRange{Int64}")] 0.75 (5%) ✅ 1.00 (1%)
["array", "growth", ("push_multiple!", 2048)] 0.90 (5%) ✅ 1.00 (1%)
["array", "growth", ("push_multiple!", 256)] 0.91 (5%) ✅ 1.00 (1%)
["array", "index", ("sumelt_boundscheck", "BaseBenchmarks.ArrayBenchmarks.ArrayLF{Int32, 2}")] 1.74 (50%) ❌ 1.00 (1%)
["array", "reductions", ("perf_mapreduce", "Int64")] 0.92 (5%) ✅ 1.00 (1%)
["array", "reductions", ("sumabs", "Int64")] 0.93 (5%) ✅ 1.00 (1%)
["array", "setindex!", ("setindex!", 1)] 0.90 (5%) ✅ 1.00 (1%)
["array", "subarray", ("lucompletepivCopy!", 100)] 0.77 (5%) ✅ 1.00 (1%)
["array", "subarray", ("lucompletepivCopy!", 1000)] 0.74 (5%) ✅ 1.00 (1%)
["array", "subarray", ("lucompletepivCopy!", 250)] 0.75 (5%) ✅ 1.00 (1%)
["array", "subarray", ("lucompletepivCopy!", 500)] 0.75 (5%) ✅ 1.00 (1%)
["array", "subarray", ("lucompletepivSub!", 100)] 0.75 (5%) ✅ 1.00 (1%)
["array", "subarray", ("lucompletepivSub!", 1000)] 0.71 (5%) ✅ 1.00 (1%)
["array", "subarray", ("lucompletepivSub!", 250)] 0.73 (5%) ✅ 1.00 (1%)
["array", "subarray", ("lucompletepivSub!", 500)] 0.73 (5%) ✅ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (10, "scal_tup_x3")] 0.83 (5%) ✅ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (10, "tup_tup")] 0.88 (5%) ✅ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (3, "scal_tup_x3")] 1.11 (5%) ❌ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (5, "scal_tup_x3")] 0.88 (5%) ✅ 1.00 (1%)
["broadcast", "mix_scalar_tuple", (5, "tup_tup")] 1.19 (5%) ❌ 1.00 (1%)
["broadcast", "sparse", ("(1000, 1000)", 1)] 0.89 (5%) ✅ 1.00 (1%)
["broadcast", "sparse", ("(10000000,)", 2)] 1.24 (5%) ❌ 1.00 (1%)
["broadcast", "typeargs", ("array", 10)] 0.95 (5%) ✅ 1.00 (1%)
["collection", "queries & updates", ("Vector", "Any", "getindex")] 0.72 (25%) ✅ 1.00 (1%)
["collection", "set operations", ("BitSet", "Int", "intersect", "BitSet", "BitSet")] 1.33 (25%) ❌ 1.00 (1%)
["find", "findall", ("> q0.5", "Vector{Bool}")] 0.92 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.5", "Vector{Float32}")] 0.95 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.5", "Vector{Float64}")] 0.92 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.5", "Vector{Int64}")] 0.81 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.5", "Vector{Int8}")] 0.92 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.5", "Vector{UInt64}")] 0.90 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.5", "Vector{UInt8}")] 0.94 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.8", "Vector{Float32}")] 0.95 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.8", "Vector{Float64}")] 0.91 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.8", "Vector{Int8}")] 0.95 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.95", "Vector{Int64}")] 0.89 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.95", "Vector{Int8}")] 1.13 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.95", "Vector{UInt8}")] 1.14 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.99", "Vector{Int64}")] 0.91 (5%) ✅ 1.00 (1%)
["find", "findall", ("> q0.99", "Vector{Int8}")] 1.16 (5%) ❌ 1.00 (1%)
["find", "findall", ("> q0.99", "Vector{UInt8}")] 1.24 (5%) ❌ 1.00 (1%)
["find", "findall", ("Vector{Bool}", "10-90")] 0.85 (5%) ✅ 1.00 (1%)
["find", "findall", ("Vector{Bool}", "50-50")] 0.36 (5%) ✅ 1.00 (1%)
["find", "findall", ("Vector{Bool}", "90-10")] 0.91 (5%) ✅ 1.00 (1%)
["find", "findall", ("ispos", "Vector{Float32}")] 0.92 (5%) ✅ 1.00 (1%)
["find", "findall", ("ispos", "Vector{Float64}")] 0.94 (5%) ✅ 1.00 (1%)
["find", "findall", ("ispos", "Vector{Int64}")] 0.94 (5%) ✅ 1.00 (1%)
["find", "findall", ("ispos", "Vector{UInt8}")] 0.93 (5%) ✅ 1.00 (1%)
["find", "findnext", ("ispos", "Vector{Bool}")] 0.94 (5%) ✅ 1.00 (1%)
["find", "findnext", ("ispos", "Vector{UInt8}")] 1.09 (5%) ❌ 1.00 (1%)
["find", "findprev", ("BitVector", "90-10")] 0.90 (5%) ✅ 1.00 (1%)
["find", "findprev", ("Vector{Bool}", "50-50")] 1.21 (5%) ❌ 1.00 (1%)
["io", "serialization", ("serialize", "Matrix{Float64}")] 0.81 (5%) ✅ 1.00 (1%)
["linalg", "small exp #29116"] 0.89 (5%) ✅ 1.00 (1%)
["misc", "18129"] 0.92 (5%) ✅ 1.00 (1%)
["misc", "allocation elision view", "no conditional"] 0.91 (5%) ✅ 1.00 (1%)
["misc", "bitshift", ("UInt32", "UInt32")] 1.19 (5%) ❌ 1.00 (1%)
["misc", "foldl", "foldl(+, filter(...))"] 0.72 (5%) ✅ 1.00 (1%)
["misc", "foldl", "foldl(+, filter(...); init = 0.0)"] 0.35 (5%) ✅ 1.00 (1%)
["misc", "issue 12165", "Float16"] 0.95 (5%) ✅ 1.00 (1%)
["misc", "issue 12165", "Float32"] 0.88 (5%) ✅ 1.00 (1%)
["misc", "issue 12165", "Float64"] 1.07 (5%) ❌ 1.00 (1%)
["misc", "iterators", "zip(1:1000, 1:1000)"] 0.70 (5%) ✅ 1.00 (1%)
["misc", "repeat", (200, 24, 1)] 0.84 (5%) ✅ 1.00 (1%)
["problem", "laplacian", "laplace_iter_devec"] 0.78 (5%) ✅ 1.00 (1%)
["problem", "monte carlo", "euro_option_vec"] 0.94 (5%) ✅ 1.00 (1%)
["problem", "ziggurat", "ziggurat"] 1.05 (5%) ❌ 1.00 (1%)
["random", "ranges", ("RangeGenerator", "BigInt", "1:1")] 1.30 (25%) ❌ 1.00 (1%)
["random", "ranges", ("RangeGenerator", "BigInt", "1:18446744073709551615")] 1.30 (25%) ❌ 1.00 (1%)
["random", "ranges", ("RangeGenerator", "BigInt", "1:18446744073709551616")] 1.28 (25%) ❌ 1.00 (1%)
["random", "ranges", ("RangeGenerator", "BigInt", "1:4294967295")] 1.28 (25%) ❌ 1.00 (1%)
["random", "ranges", ("RangeGenerator", "BigInt", "1:4294967297")] 1.28 (25%) ❌ 1.00 (1%)
["random", "types", ("rand!", "MersenneTwister", "ComplexF32")] 1.35 (25%) ❌ 1.00 (1%)
["random", "types", ("rand", "MersenneTwister", "UInt8")] 1.32 (25%) ❌ 1.00 (1%)
["scalar", "acos", ("0.5 <= abs(x) < 1", "positive argument", "Float32")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "acos", ("abs(x) < 0.5", "negative argument", "Float32")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "acos", ("abs(x) < 0.5", "negative argument", "Float64")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "acos", ("abs(x) < 0.5", "positive argument", "Float32")] 1.06 (5%) ❌ 1.00 (1%)
["scalar", "acos", ("abs(x) < 0.5", "positive argument", "Float64")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "acos", ("small", "negative argument", "Float32")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "acos", ("small", "negative argument", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "acos", ("small", "positive argument", "Float32")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "acos", ("small", "positive argument", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "acos", ("zero", "Float32")] 0.80 (5%) ✅ 1.00 (1%)
["scalar", "acosh", ("2 <= abs(x) < 2^28", "positive argument", "Float32")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "acosh", ("very large", "positive argument", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "arithmetic", ("sub", "Complex{BigInt}", "BigInt")] 1.58 (50%) ❌ 1.00 (1%)
["scalar", "asin", ("0.975 <= abs(x) < 1.0", "negative argument", "Float64")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "asin", ("0.975 <= abs(x) < 1.0", "positive argument", "Float64")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "asin", ("abs(x) < 0.5", "negative argument", "Float32")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "asin", ("abs(x) < 0.5", "positive argument", "Float32")] 1.21 (5%) ❌ 1.00 (1%)
["scalar", "asin", ("small", "positive argument", "Float32")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "asin", ("zero", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "asinh", ("0 <= abs(x) < 2^-28", "negative argument", "Float32")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "asinh", ("0 <= abs(x) < 2^-28", "negative argument", "Float64")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("0 <= abs(x) < 2^-28", "positive argument", "Float32")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "asinh", ("0 <= abs(x) < 2^-28", "positive argument", "Float64")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("2 <= abs(x) < 2^28", "negative argument", "Float32")] 0.90 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("2 <= abs(x) < 2^28", "negative argument", "Float64")] 0.81 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("2 <= abs(x) < 2^28", "positive argument", "Float32")] 0.86 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("2 <= abs(x) < 2^28", "positive argument", "Float64")] 0.85 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("2^-28 <= abs(x) < 2", "negative argument", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("very large", "positive argument", "Float32")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "asinh", ("very small", "negative argument", "Float32")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "asinh", ("very small", "negative argument", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "asinh", ("very small", "positive argument", "Float32")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "asinh", ("very small", "positive argument", "Float64")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "asinh", ("zero", "Float32")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "asinh", ("zero", "Float64")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("0 <= abs(x) < 7/16", "positive argument", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("11/16 <= abs(x) < 19/16", "negative argument", "Float32")] 0.89 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("11/16 <= abs(x) < 19/16", "negative argument", "Float64")] 0.88 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("11/16 <= abs(x) < 19/16", "positive argument", "Float32")] 0.89 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("11/16 <= abs(x) < 19/16", "positive argument", "Float64")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("19/16 <= abs(x) < 39/16", "negative argument", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("19/16 <= abs(x) < 39/16", "negative argument", "Float64")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("19/16 <= abs(x) < 39/16", "positive argument", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("19/16 <= abs(x) < 39/16", "positive argument", "Float64")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("39/16 <= abs(x) < 2^66", "negative argument", "Float32")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("39/16 <= abs(x) < 2^66", "positive argument", "Float32")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("39/16 <= abs(x) < 2^66", "positive argument", "Float64")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("7/16 <= abs(x) < 11/16", "negative argument", "Float32")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("7/16 <= abs(x) < 11/16", "negative argument", "Float64")] 0.88 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("7/16 <= abs(x) < 11/16", "positive argument", "Float32")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("7/16 <= abs(x) < 11/16", "positive argument", "Float64")] 0.88 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very large", "negative argument", "Float64")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very large", "positive argument", "Float64")] 0.85 (5%) ✅ 1.00 (1%)
["scalar", "atan", ("very small", "negative argument", "Float32")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("very small", "positive argument", "Float32")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "atan", ("zero", "Float32")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) high", "y negative", "x positive", "Float32")] 1.12 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) high", "y positive", "x positive", "Float32")] 1.12 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) high", "y positive", "x positive", "Float64")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (large)", "y positive", "x negative", "Float32")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (large)", "y positive", "x positive", "Float64")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) safe (small)", "y negative", "x negative", "Float64")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) small", "y positive", "x positive", "Float32")] 1.11 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("abs(y/x) small", "y positive", "x positive", "Float64")] 1.05 (5%) ❌ 1.00 (1%)
["scalar", "atan2", ("x one", "Float64")] 0.95 (5%) ✅ 1.00 (1%)
["scalar", "atanh", ("one", "Float32")] 0.87 (5%) ✅ 1.00 (1%)
["scalar", "atanh", ("one", "Float64")] 1.21 (5%) ❌ 1.00 (1%)
["scalar", "atanh", ("very small", "negative argument", "Float32")] 1.09 (5%) ❌ 1.00 (1%)
["scalar", "atanh", ("very small", "positive argument", "Float32")] 1.09 (5%) ❌ 1.00 (1%)
["scalar", "atanh", ("zero", "Float32")] 1.09 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 2.0^20π/4", "negative argument", "Float32", "cos_kernel")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 2.0^20π/4", "negative argument", "Float64", "cos_kernel")] 1.14 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 2.0^20π/4", "positive argument", "Float32", "cos_kernel")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 2.0^20π/4", "positive argument", "Float64", "cos_kernel")] 1.15 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 2π/4", "negative argument", "Float32", "sin_kernel")] 1.10 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 2π/4", "negative argument", "Float64", "sin_kernel")] 1.11 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 2π/4", "positive argument", "Float32", "sin_kernel")] 1.15 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 2π/4", "positive argument", "Float64", "sin_kernel")] 1.19 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 3π/4", "negative argument", "Float32", "sin_kernel")] 1.11 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 3π/4", "negative argument", "Float64", "sin_kernel")] 1.11 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 3π/4", "positive argument", "Float32", "sin_kernel")] 1.19 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 3π/4", "positive argument", "Float64", "sin_kernel")] 1.15 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 8π/4", "negative argument", "Float32", "cos_kernel")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 8π/4", "negative argument", "Float64", "cos_kernel")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 9π/4", "negative argument", "Float32", "cos_kernel")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (easy) abs(x) < 9π/4", "negative argument", "Float64", "cos_kernel")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 2π/4", "negative argument", "Float32", "sin_kernel")] 1.29 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 2π/4", "negative argument", "Float64", "sin_kernel")] 1.25 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 2π/4", "positive argument", "Float32", "sin_kernel")] 1.25 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 2π/4", "positive argument", "Float64", "sin_kernel")] 1.25 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 4π/4", "negative argument", "Float32", "cos_kernel")] 0.88 (5%) ✅ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 4π/4", "negative argument", "Float64", "cos_kernel")] 1.17 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 4π/4", "positive argument", "Float64", "cos_kernel")] 1.17 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 6π/4", "negative argument", "Float32", "sin_kernel")] 1.24 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 6π/4", "negative argument", "Float64", "sin_kernel")] 1.18 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 6π/4", "positive argument", "Float32", "sin_kernel")] 1.22 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 6π/4", "positive argument", "Float64", "sin_kernel")] 1.27 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 8π/4", "negative argument", "Float32", "cos_kernel")] 1.20 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 8π/4", "negative argument", "Float64", "cos_kernel")] 1.23 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 8π/4", "positive argument", "Float32", "cos_kernel")] 1.20 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("argument reduction (hard) abs(x) < 8π/4", "positive argument", "Float64", "cos_kernel")] 1.25 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("no reduction", "negative argument", "Float32", "cos_kernel")] 1.16 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("no reduction", "negative argument", "Float64", "cos_kernel")] 1.16 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("no reduction", "positive argument", "Float32", "cos_kernel")] 1.16 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("no reduction", "positive argument", "Float64", "cos_kernel")] 1.16 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("no reduction", "zero", "Float32")] 1.16 (5%) ❌ 1.00 (1%)
["scalar", "cos", ("no reduction", "zero", "Float64")] 1.17 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("huge", "positive argument", "Float64")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "expm1", ("large", "negative argument", "Float32")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("large", "positive argument", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("medium", "negative argument", "Float32")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "expm1", ("medium", "negative argument", "Float64")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("very small", "negative argument", "Float32")] 1.18 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("very small", "negative argument", "Float64")] 1.08 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("very small", "positive argument", "Float32")] 1.18 (5%) ❌ 1.00 (1%)
["scalar", "expm1", ("zero", "Float32")] 1.17 (5%) ❌ 1.00 (1%)
["scalar", "fastmath", "13786"] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "fastmath", ("sub", "BigInt")] 1.42 (40%) ❌ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 2.0^20π/4", "negative argument", "Float64", "sin_kernel")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 2.0^20π/4", "positive argument", "Float64", "sin_kernel")] 0.94 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 2π/4", "negative argument", "Float64", "cos_kernel")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 2π/4", "positive argument", "Float32", "cos_kernel")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 2π/4", "positive argument", "Float64", "cos_kernel")] 1.12 (5%) ❌ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 3π/4", "negative argument", "Float32", "cos_kernel")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 3π/4", "positive argument", "Float32", "cos_kernel")] 0.84 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 3π/4", "positive argument", "Float64", "cos_kernel")] 1.15 (5%) ❌ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 6π/4", "negative argument", "Float32", "cos_kernel")] 0.88 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 6π/4", "negative argument", "Float64", "cos_kernel")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 6π/4", "positive argument", "Float32", "cos_kernel")] 0.85 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 7π/4", "negative argument", "Float32", "sin_kernel")] 0.88 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 7π/4", "positive argument", "Float32", "sin_kernel")] 0.85 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 8π/4", "negative argument", "Float32", "sin_kernel")] 0.84 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 8π/4", "positive argument", "Float32", "sin_kernel")] 0.91 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 8π/4", "positive argument", "Float64", "sin_kernel")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 9π/4", "negative argument", "Float32", "sin_kernel")] 0.88 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 9π/4", "positive argument", "Float32", "sin_kernel")] 0.84 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (easy) abs(x) < 9π/4", "positive argument", "Float64", "sin_kernel")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (hard) abs(x) < 2π/4", "negative argument", "Float32", "cos_kernel")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (hard) abs(x) < 2π/4", "positive argument", "Float32", "cos_kernel")] 0.84 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (hard) abs(x) < 6π/4", "positive argument", "Float32", "cos_kernel")] 0.92 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("argument reduction (hard) abs(x) < 8π/4", "positive argument", "Float32", "sin_kernel")] 0.83 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("no reduction", "negative argument", "Float32", "sin_kernel")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "sin", ("no reduction", "negative argument", "Float64", "sin_kernel")] 0.88 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("no reduction", "positive argument", "Float32", "sin_kernel")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "sin", ("no reduction", "positive argument", "Float64", "sin_kernel")] 0.88 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("no reduction", "zero", "Float32")] 0.86 (5%) ✅ 1.00 (1%)
["scalar", "sin", ("no reduction", "zero", "Float64")] 1.09 (5%) ❌ 1.00 (1%)
["scalar", "sinh", ("very large", "positive argument", "Float32")] 0.77 (5%) ✅ 1.00 (1%)
["scalar", "tan", ("medium", "negative argument", "Float64")] 0.87 (5%) ✅ 1.00 (1%)
["scalar", "tan", ("medium", "positive argument", "Float64")] 0.93 (5%) ✅ 1.00 (1%)
["scalar", "tan", ("small", "negative argument", "Float32")] 1.17 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("small", "positive argument", "Float32")] 1.07 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("very small", "negative argument", "Float32")] 1.15 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("very small", "positive argument", "Float32")] 1.15 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("zero", "Float32")] 1.16 (5%) ❌ 1.00 (1%)
["scalar", "tan", ("zero", "Float64")] 0.92 (5%) ✅ 1.00 (1%)
["shootout", "fasta"] 0.94 (5%) ✅ 1.00 (1%)
["simd", ("auto_conditional_loop!", "Float32", 4095)] 0.71 (20%) ✅ 1.00 (1%)
["simd", ("auto_conditional_loop!", "Float32", 4096)] 0.80 (20%) ✅ 1.00 (1%)
["simd", ("auto_conditional_loop!", "Float64", 4095)] 0.76 (20%) ✅ 1.00 (1%)
["simd", ("auto_two_reductions", "Int32", 4095)] 1.31 (20%) ❌ 1.00 (1%)
["simd", ("conditional_loop!", "Float32", 4095)] 0.72 (20%) ✅ 1.00 (1%)
["simd", ("conditional_loop!", "Float64", 4095)] 0.75 (20%) ✅ 1.00 (1%)
["simd", ("conditional_loop!", "Float64", 4096)] 0.79 (20%) ✅ 1.00 (1%)
["sort", "insertionsort", ("sort forwards", "descending")] 1.30 (30%) ❌ 1.00 (1%)
["sort", "insertionsort", ("sort reverse", "ascending")] 0.67 (30%) ✅ 1.00 (1%)
["sort", "insertionsort", ("sort! forwards", "ascending")] 0.66 (30%) ✅ 1.00 (1%)
["sort", "insertionsort", ("sort! forwards", "descending")] 1.30 (30%) ❌ 1.00 (1%)
["sort", "insertionsort", ("sort! reverse", "ascending")] 0.67 (30%) ✅ 1.00 (1%)
["sort", "insertionsort", ("sort! reverse", "descending")] 1.51 (30%) ❌ 1.00 (1%)
["sort", "insertionsort", ("sortperm! forwards", "ascending")] 0.66 (30%) ✅ 1.00 (1%)
["sort", "insertionsort", ("sortperm! forwards", "ones")] 0.70 (30%) ✅ 1.00 (1%)
["sort", "insertionsort", ("sortperm! reverse", "ones")] 1.32 (30%) ❌ 1.00 (1%)
["sparse", "constructors", ("Bidiagonal", 10)] 1.10 (5%) ❌ 1.00 (1%)
["sparse", "constructors", ("Bidiagonal", 1000)] 0.90 (5%) ✅ 1.00 (1%)
["sparse", "constructors", ("Diagonal", 100)] 0.91 (5%) ✅ 1.00 (1%)
["sparse", "constructors", ("Diagonal", 1000)] 0.88 (5%) ✅ 1.00 (1%)
["sparse", "constructors", ("IJV", 1000)] 0.94 (5%) ✅ 1.00 (1%)
["sparse", "constructors", ("SymTridiagonal", 100)] 1.09 (5%) ❌ 1.00 (1%)
["sparse", "constructors", ("SymTridiagonal", 1000)] 0.92 (5%) ✅ 1.00 (1%)
["sparse", "constructors", ("Tridiagonal", 1000)] 0.89 (5%) ✅ 1.00 (1%)
["sparse", "index", ("spmat", "col", "logical", 1000)] 0.57 (30%) ✅ 1.00 (1%)
["sparse", "index", ("spmat", "row", "logical", 1000)] 0.70 (30%) ✅ 1.00 (1%)
["sparse", "index", ("spvec", "logical", 1000)] 0.57 (30%) ✅ 1.00 (1%)
["sparse", "matmul", ("A_mul_Bt", "sparse 500x500, dense 5x500 -> dense 500x5")] 1.38 (30%) ❌ 1.00 (1%)
["sparse", "matmul", ("A_mul_Bt", "sparse 50x500, dense 5x500 -> dense 50x5")] 1.50 (30%) ❌ 1.00 (1%)
["sparse", "matmul", ("At_mul_B!", "sparse 400x4000, dense 400x40 -> dense 4000x40")] 0.66 (30%) ✅ 1.00 (1%)
["sparse", "matmul", ("At_mul_B", "dense 500x5, sparse 500x500 -> dense 5x500")] 0.55 (30%) ✅ 1.00 (1%)
["sparse", "matmul", ("At_mul_B", "dense 50x5, sparse 50x500 -> dense 5x500")] 0.51 (30%) ✅ 1.00 (1%)
["sparse", "matmul", ("At_mul_B", "dense 5x5, sparse 5x500 -> dense 5x500")] 0.57 (30%) ✅ 1.00 (1%)
["sparse", "matmul", ("At_mul_B", "sparse 500x500, dense 500x5 -> dense 500x5")] 1.45 (30%) ❌ 1.00 (1%)
["sparse", "sparse solves", "square system (ldlt), matrix rhs"] 1.13 (5%) ❌ 1.00 (1%)
["sparse", "sparse solves", "square system (ldlt), vector rhs"] 1.17 (5%) ❌ 1.00 (1%)
["string", "==(::SubString, ::String)", "different"] 1.50 (5%) ❌ 1.00 (1%)
["string", "findfirst", "String"] 0.95 (5%) ✅ 1.00 (1%)
["string", "readuntil", "backtracking"] 0.94 (5%) ✅ 1.00 (1%)
["string", "readuntil", "no backtracking"] 0.94 (5%) ✅ 1.00 (1%)
["string", "repeat", "repeat char 2"] 0.64 (5%) ✅ 1.00 (1%)
["tuple", "reduction", ("minimum", "(8,)")] 1.07 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("sum", "(16,)")] 1.11 (5%) ❌ 1.00 (1%)
["tuple", "reduction", ("sumabs", "(8,)")] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "BigInt", "(false, false)")] 1.07 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "BigInt", "(false, true)")] 1.07 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "Bool", "(false, true)")] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "Bool", "(true, true)")] 1.08 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "Float32", "(false, false)")] 1.11 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "Float32", "(false, true)")] 0.87 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "*", "Float32", "(true, true)")] 0.86 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "*", "Float64", "(false, true)")] 0.89 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "*", "Float64", "(true, true)")] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "*", "Int64", "(false, false)")] 0.89 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "*", "Int64", "(false, true)")] 1.13 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "Int64", "(true, true)")] 1.14 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "*", "Int8", "(false, false)")] 0.89 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "*", "Int8", "(false, true)")] 0.86 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "*", "Int8", "(true, true)")] 0.83 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "abs", "BigInt", 0)] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "abs", "ComplexF64", 0)] 1.05 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "abs", "Float64", 0)] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "abs", "Int64", 1)] 1.09 (5%) ❌ 1.00 (1%)
["union", "array", ("broadcast", "abs", "Int8", 1)] 0.72 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "identity", "BigFloat", 0)] 0.80 (5%) ✅ 1.00 (1%)
["union", "array", ("broadcast", "identity", "BigInt", 0)] 0.81 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "all", "BigFloat", 0)] 1.21 (5%) ❌ 1.00 (1%)
["union", "array", ("collect", "all", "BigInt", 0)] 1.21 (5%) ❌ 1.00 (1%)
["union", "array", ("collect", "all", "BigInt", 1)] 0.88 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "all", "Float32", 0)] 0.85 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "all", "Float32", 1)] 1.23 (5%) ❌ 1.00 (1%)
["union", "array", ("collect", "all", "Float64", 0)] 1.11 (5%) ❌ 1.00 (1%)
["union", "array", ("collect", "all", "Float64", 1)] 1.19 (5%) ❌ 1.00 (1%)
["union", "array", ("collect", "all", "Int64", 0)] 1.11 (5%) ❌ 1.00 (1%)
["union", "array", ("collect", "all", "Int64", 1)] 1.18 (5%) ❌ 1.00 (1%)
["union", "array", ("collect", "all", "Int8", 0)] 0.84 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "all", "Int8", 1)] 1.08 (5%) ❌ 1.00 (1%)
["union", "array", ("collect", "filter", "BigInt", 1)] 1.10 (5%) ❌ 1.00 (1%)
["union", "array", ("collect", "filter", "Bool", 0)] 0.86 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Bool", 1)] 0.85 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "ComplexF64", 0)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "ComplexF64", 1)] 0.88 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Float32", 0)] 0.82 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Float32", 1)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Float64", 0)] 0.85 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Float64", 1)] 0.89 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Int64", 0)] 0.86 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Int64", 1)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Int8", 0)] 0.83 (5%) ✅ 1.00 (1%)
["union", "array", ("collect", "filter", "Int8", 1)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "*", "BigInt", "(false, false)")] 1.07 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "BigInt", "(false, true)")] 1.08 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "Bool", "(false, false)")] 1.10 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "ComplexF64", "(false, false)")] 1.22 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "ComplexF64", "(false, true)")] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "ComplexF64", "(true, true)")] 1.08 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "Float32", "(false, false)")] 0.70 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "*", "Float32", "(false, true)")] 1.16 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "Float32", "(true, true)")] 1.19 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "Float64", "(false, false)")] 1.55 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "*", "Float64", "(false, true)")] 0.88 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "*", "Float64", "(true, true)")] 0.89 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "*", "Int64", "(false, false)")] 0.73 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "*", "Int8", "(false, false)")] 0.84 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "*", "Int8", "(false, true)")] 0.80 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "*", "Int8", "(true, true)")] 0.69 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "abs", "Bool", 0)] 1.19 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "abs", "Bool", 1)] 0.92 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "abs", "Int8", 1)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "identity", "BigFloat", 0)] 1.21 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "identity", "BigInt", 0)] 1.22 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "identity", "BigInt", 1)] 0.89 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "identity", "Float32", 0)] 0.85 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "identity", "Float32", 1)] 1.23 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "identity", "Float64", 0)] 1.12 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "identity", "Float64", 1)] 1.18 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "identity", "Int64", 0)] 1.11 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "identity", "Int64", 1)] 1.18 (5%) ❌ 1.00 (1%)
["union", "array", ("map", "identity", "Int8", 0)] 0.84 (5%) ✅ 1.00 (1%)
["union", "array", ("map", "identity", "Int8", 1)] 1.08 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "BigInt", "(false, false)")] 1.07 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "BigInt", "(false, true)")] 1.09 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Bool", "(false, false)")] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Bool", "(false, true)")] 0.84 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Bool", "(true, true)")] 0.84 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "ComplexF64", "(true, true)")] 1.05 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Float64", "(false, false)")] 1.08 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Int8", "(false, false)")] 1.45 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Int8", "(false, true)")] 1.34 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_binaryop", "*", "Int8", "(true, true)")] 1.34 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_countequals", "BigInt")] 1.13 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_countequals", "Bool")] 1.09 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_countequals", "ComplexF64")] 0.82 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_countequals", "Float64")] 0.78 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_countequals", "Int64")] 1.08 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_countnothing", "Bool", 0)] 0.59 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_countnothing", "Bool", 1)] 0.67 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_countnothing", "ComplexF64", 0)] 1.50 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_countnothing", "ComplexF64", 1)] 0.88 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_countnothing", "Float32", 0)] 0.59 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_countnothing", "Float32", 1)] 0.59 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_countnothing", "Float64", 0)] 0.67 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_countnothing", "Int64", 0)] 0.66 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_countnothing", "Int64", 1)] 1.71 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_countnothing", "Int8", 0)] 1.49 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_countnothing", "Int8", 1)] 1.50 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_simplecopy", "BigFloat", 0)] 0.92 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_simplecopy", "BigInt", 0)] 0.92 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_simplecopy", "BigInt", 1)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum", "BigInt", 0)] 1.11 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum", "Bool", 1)] 0.89 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum2", "BigInt", 0)] 1.11 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum2", "Bool", 0)] 0.89 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum2", "Bool", 1)] 0.89 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum2", "Int8", 0)] 1.10 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum3", "BigInt", 0)] 1.11 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum3", "Bool", 0)] 1.33 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum3", "Bool", 1)] 1.29 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum3", "Float32", 1)] 1.20 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum3", "Float64", 1)] 0.83 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum3", "Int64", 0)] 1.09 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum3", "Int64", 1)] 1.07 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum3", "Int8", 1)] 0.73 (5%) ✅ 1.00 (1%)
["union", "array", ("perf_sum4", "BigInt", 0)] 1.08 (5%) ❌ 1.00 (1%)
["union", "array", ("perf_sum4", "Bool", 1)] 1.12 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "BigInt", 0)] 1.09 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Bool", 0)] 0.84 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Float64", 0)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Int64", 0)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Int8", 0)] 0.94 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Missing, Bool}", 1)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Missing, Float32}", 1)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Missing, Int8}", 1)] 0.88 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Nothing, Bool}", 0)] 0.91 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Nothing, ComplexF64}", 0)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Nothing, Float32}", 0)] 0.91 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "collect", "Union{Nothing, Int8}", 0)] 0.90 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "BigInt", 0)] 1.10 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "Bool", 0)] 1.11 (5%) ❌ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "Union{Missing, Bool}", 1)] 0.93 (5%) ✅ 1.00 (1%)
["union", "array", ("skipmissing", "sum", "Union{Nothing, BigInt}", 0)] 1.09 (5%) ❌ 1.00 (1%)
["union", "array", ("sort", "Float32", 0)] 1.09 (5%) ❌ 1.00 (1%)
["union", "array", ("sort", "Union{Missing, Float32}", 1)] 1.06 (5%) ❌ 1.00 (1%)
["union", "array", ("sort", "Union{Nothing, Int64}", 0)] 0.92 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["array", "accumulate"]
  • ["array", "any/all"]
  • ["array", "bool"]
  • ["array", "cat"]
  • ["array", "comprehension"]
  • ["array", "convert"]
  • ["array", "equality"]
  • ["array", "growth"]
  • ["array", "index"]
  • ["array", "reductions"]
  • ["array", "reverse"]
  • ["array", "setindex!"]
  • ["array", "subarray"]
  • ["broadcast"]
  • ["broadcast", "dotop"]
  • ["broadcast", "fusion"]
  • ["broadcast", "mix_scalar_tuple"]
  • ["broadcast", "sparse"]
  • ["broadcast", "typeargs"]
  • ["collection", "deletion"]
  • ["collection", "initialization"]
  • ["collection", "iteration"]
  • ["collection", "optimizations"]
  • ["collection", "queries & updates"]
  • ["collection", "set operations"]
  • ["dates", "accessor"]
  • ["dates", "arithmetic"]
  • ["dates", "construction"]
  • ["dates", "conversion"]
  • ["dates", "parse"]
  • ["dates", "query"]
  • ["dates", "string"]
  • ["find", "findall"]
  • ["find", "findnext"]
  • ["find", "findprev"]
  • ["io", "array_limit"]
  • ["io", "read"]
  • ["io", "serialization"]
  • ["io"]
  • ["linalg", "arithmetic"]
  • ["linalg", "blas"]
  • ["linalg", "factorization"]
  • ["linalg"]
  • ["micro"]
  • ["misc"]
  • ["misc", "23042"]
  • ["misc", "afoldl"]
  • ["misc", "allocation elision view"]
  • ["misc", "bitshift"]
  • ["misc", "foldl"]
  • ["misc", "issue 12165"]
  • ["misc", "iterators"]
  • ["misc", "julia"]
  • ["misc", "parse"]
  • ["misc", "repeat"]
  • ["misc", "splatting"]
  • ["problem", "chaosgame"]
  • ["problem", "fem"]
  • ["problem", "go"]
  • ["problem", "grigoriadis khachiyan"]
  • ["problem", "imdb"]
  • ["problem", "json"]
  • ["problem", "laplacian"]
  • ["problem", "monte carlo"]
  • ["problem", "raytrace"]
  • ["problem", "seismic"]
  • ["problem", "simplex"]
  • ["problem", "spellcheck"]
  • ["problem", "stockcorr"]
  • ["problem", "ziggurat"]
  • ["random", "collections"]
  • ["random", "randstring"]
  • ["random", "ranges"]
  • ["random", "sequences"]
  • ["random", "types"]
  • ["scalar", "acos"]
  • ["scalar", "acosh"]
  • ["scalar", "arithmetic"]
  • ["scalar", "asin"]
  • ["scalar", "asinh"]
  • ["scalar", "atan"]
  • ["scalar", "atan2"]
  • ["scalar", "atanh"]
  • ["scalar", "cbrt"]
  • ["scalar", "cos"]
  • ["scalar", "cosh"]
  • ["scalar", "exp2"]
  • ["scalar", "expm1"]
  • ["scalar", "fastmath"]
  • ["scalar", "floatexp"]
  • ["scalar", "intfuncs"]
  • ["scalar", "iteration"]
  • ["scalar", "mod2pi"]
  • ["scalar", "predicate"]
  • ["scalar", "rem_pio2"]
  • ["scalar", "sin"]
  • ["scalar", "sincos"]
  • ["scalar", "sinh"]
  • ["scalar", "tan"]
  • ["scalar", "tanh"]
  • ["shootout"]
  • ["simd"]
  • ["sort", "insertionsort"]
  • ["sort", "issorted"]
  • ["sort", "mergesort"]
  • ["sort", "quicksort"]
  • ["sparse", "arithmetic"]
  • ["sparse", "constructors"]
  • ["sparse", "index"]
  • ["sparse", "matmul"]
  • ["sparse", "sparse matvec"]
  • ["sparse", "sparse solves"]
  • ["sparse", "transpose"]
  • ["string", "==(::AbstractString, ::AbstractString)"]
  • ["string", "==(::SubString, ::String)"]
  • ["string", "findfirst"]
  • ["string"]
  • ["string", "readuntil"]
  • ["string", "repeat"]
  • ["tuple", "index"]
  • ["tuple", "linear algebra"]
  • ["tuple", "misc"]
  • ["tuple", "reduction"]
  • ["union", "array"]

Version Info

Primary Build

Julia Version 1.6.2-pre.58
Commit 40f17341a2 (2021-06-29 06:56 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 20.04.2 LTS
  uname: Linux 5.4.0-1037-aws #39-Ubuntu SMP Thu Jan 14 02:56:06 UTC 2021 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8124M CPU @ 3.00GHz: 
              speed         user         nice          sys         idle          irq
       #1  3432 MHz     320344 s       2643 s      32927 s  108918489 s          0 s
       #2  3426 MHz   12130119 s        890 s     642367 s   96504916 s          0 s
       #3  3400 MHz     204833 s        789 s      10276 s  109064337 s          0 s
       #4  3400 MHz     248281 s        810 s      11504 s  109018879 s          0 s
       #5  3404 MHz     137121 s        776 s       9794 s  109105990 s          0 s
       #6  3427 MHz     166355 s        798 s       9367 s  109104107 s          0 s
       #7  3420 MHz     143469 s        693 s       9874 s  109126665 s          0 s
       #8  3410 MHz     136323 s        908 s       9054 s  109124629 s          0 s
       
  Memory: 30.362831115722656 GB (7725.6640625 MB free)
  Uptime: 1.0928309e7 sec
  Load Avg:  1.0  1.0  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-11.0.1 (ORCJIT, skylake-avx512)

Comparison Build

Julia Version 1.6.2-pre.0
Commit dd122918ce (2021-04-23 21:21 UTC)
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 20.04.2 LTS
  uname: Linux 5.4.0-1037-aws #39-Ubuntu SMP Thu Jan 14 02:56:06 UTC 2021 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8124M CPU @ 3.00GHz: 
              speed         user         nice          sys         idle          irq
       #1  3404 MHz     320526 s       2643 s      32953 s  109021171 s          0 s
       #2  3414 MHz   12223962 s        890 s     649525 s   96506817 s          0 s
       #3  3397 MHz     205232 s        789 s      10296 s  109166818 s          0 s
       #4  3401 MHz     248763 s        810 s      11534 s  109121269 s          0 s
       #5  3403 MHz     137549 s        776 s       9808 s  109208449 s          0 s
       #6  3410 MHz     166369 s        798 s       9377 s  109206985 s          0 s
       #7  3409 MHz     143886 s        693 s       9886 s  109229139 s          0 s
       #8  3406 MHz     136397 s        908 s       9066 s  109227435 s          0 s
       
  Memory: 30.362831115722656 GB (7994.84375 MB free)
  Uptime: 1.0938599e7 sec
  Load Avg:  1.0  1.0  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-11.0.1 (ORCJIT, skylake-avx512)