Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ui: use stacktrace-like view for showing reports #524

Merged
merged 3 commits into from
May 30, 2023
Merged

Conversation

aviatesk
Copy link
Owner

@aviatesk aviatesk commented May 25, 2023

Since the stacktrace view shown by Julia Base upon exception is more
familiar to general users, it would be better to use the same view for
showing JET's abstract stacktrace.

Previously JET tries to "infer" the textual code representation of the
call-sites of each stack-frame, but now JET does not need to do so, and
JET can show the method signature of each abstract stack-frame from
their MethodInstance that is already available. Therefore, this commit
may result in some performance improvement.

Note that JET still computes the textual code representation with type
annotations for each error point. We may replace that part with
TypedSyntax.jl in the future since it would be more robust and nicer.

Examples: @report_call sum([])

Before

═════ 1 possible error found ═════
┌ @ reducedim.jl:996 Base.:(var"#sum#821")(:, pairs(NamedTuple()), #self#, a)
│┌ @ reducedim.jl:996 Base._sum(a, dims)
││┌ @ reducedim.jl:1000 Base.:(var"#_sum#823")(pairs(NamedTuple()), #self#, a, _3)
│││┌ @ reducedim.jl:1000 Base._sum(identity, a, :)
││││┌ @ reducedim.jl:1001 Base.:(var"#_sum#824")(pairs(NamedTuple()), #self#, f, a, _4)
│││││┌ @ reducedim.jl:1001 mapreduce(f, Base.add_sum, a)
││││││┌ @ reducedim.jl:357 Base.:(var"#mapreduce#814")(:, Base._InitialValue(), #self#, f, op, A)
│││││││┌ @ reducedim.jl:357 Base._mapreduce_dim(f, op, init, A, dims)
││││││││┌ @ reducedim.jl:365 Base._mapreduce(f, op, IndexStyle(A), A)
│││││││││┌ @ reduce.jl:432 Base.mapreduce_empty_iter(f, op, A, Base.IteratorEltype(A))
││││││││││┌ @ reduce.jl:380 Base.reduce_empty_iter(Base.MappingRF(f, op), itr, ItrEltype)
│││││││││││┌ @ reduce.jl:384 Base.reduce_empty(op, eltype(itr))
││││││││││││┌ @ reduce.jl:361 Base.mapreduce_empty(op.f, op.rf, T)
│││││││││││││┌ @ reduce.jl:372 Base.reduce_empty(op, T)
││││││││││││││┌ @ reduce.jl:352 Base.reduce_empty(+, T)
│││││││││││││││┌ @ reduce.jl:343 zero(T)
││││││││││││││││┌ @ missing.jl:106 Base.throw(Base.MethodError(zero, tuple(Base.Any)))
│││││││││││││││││ MethodError: no method matching zero(::Type{Any}): Base.throw(Base.MethodError(zero, tuple(Base.Any)::Tuple{DataType})::MethodError)
││││││││││││││││└──────────────────

After

═════ 1 possible error found ═════
┌ sum(a::Vector{Any}) @ Base ./reducedim.jl:996
│┌ sum(a::Vector{Any}; dims::Colon, kw::Base.@kwargs{}) @ Base ./reducedim.jl:996
││┌ _sum(a::Vector{Any}, ::Colon) @ Base ./reducedim.jl:1000
│││┌ _sum(a::Vector{Any}, ::Colon; kw::Base.@kwargs{}) @ Base ./reducedim.jl:1000
││││┌ _sum(f::typeof(identity), a::Vector{Any}, ::Colon) @ Base ./reducedim.jl:1001
│││││┌ _sum(f::typeof(identity), a::Vector{Any}, ::Colon; kw::Base.@kwargs{}) @ Base ./reducedim.jl:1001
││││││┌ mapreduce(f::typeof(identity), op::typeof(Base.add_sum), A::Vector{Any}) @ Base ./reducedim.jl:357
│││││││┌ mapreduce(f::typeof(identity), op::typeof(Base.add_sum), A::Vector{Any}; dims::Colon, init::Base._InitialValue) @ Base ./reducedim.jl:357
││││││││┌ _mapreduce_dim(f::typeof(identity), op::typeof(Base.add_sum), ::Base._InitialValue, A::Vector{Any}, ::Colon) @ Base ./reducedim.jl:365
│││││││││┌ _mapreduce(f::typeof(identity), op::typeof(Base.add_sum), ::IndexLinear, A::Vector{Any}) @ Base ./reduce.jl:432
││││││││││┌ mapreduce_empty_iter(f::typeof(identity), op::typeof(Base.add_sum), itr::Vector{Any}, ItrEltype::Base.HasEltype) @ Base ./reduce.jl:380
│││││││││││┌ reduce_empty_iter(op::Base.MappingRF{typeof(identity), typeof(Base.add_sum)}, itr::Vector{Any}, ::Base.HasEltype) @ Base ./reduce.jl:384
││││││││││││┌ reduce_empty(op::Base.MappingRF{typeof(identity), typeof(Base.add_sum)}, ::Type{Any}) @ Base ./reduce.jl:361
│││││││││││││┌ mapreduce_empty(::typeof(identity), op::typeof(Base.add_sum), T::Type{Any}) @ Base ./reduce.jl:372
││││││││││││││┌ reduce_empty(::typeof(Base.add_sum), ::Type{Any}) @ Base ./reduce.jl:352
│││││││││││││││┌ reduce_empty(::typeof(+), ::Type{Any}) @ Base ./reduce.jl:343
││││││││││││││││┌ zero(::Type{Any}) @ Base ./missing.jl:106
│││││││││││││││││ MethodError: no method matching zero(::Type{Any}): Base.throw(Base.MethodError(zero, tuple(Base.Any)::Tuple{DataType})::MethodError)
││││││││││││││││└────────────────────

Example 2

getprop(x) = x.nonexist;

report_call((Regex,)) do r
    getprop(r)
end

Before

═════ 1 possible error found ═════
┌ @ REPL[30]:2 getprop(r)
│┌ @ REPL[29]:1 x.nonexist
││┌ @ Base.jl:37 Base.getfield(x, f)
│││ type Regex has no field nonexist
││└──────────────

After

═════ 1 possible error found ═════
┌ (::var"https://github.com/aviatesk/JET.jl/pull/3#4")(r::Regex) @ Main ./REPL[12]:2
│┌ getprop(x::Regex) @ Main ./REPL[11]:1
││┌ getproperty(x::Regex, f::Symbol) @ Base ./Base.jl:37
│││ type Regex has no field nonexist: Base.getfield(x::Regex, f::Symbol)
││└────────────────────

@codecov-commenter
Copy link

codecov-commenter commented May 25, 2023

Codecov Report

Patch coverage: 93.50% and project coverage change: -0.44 ⚠️

Comparison is base (73a03d2) 89.79% compared to head (413dc26) 89.36%.

❗ Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.

Additional details and impacted files
@@            Coverage Diff             @@
##           master     #524      +/-   ##
==========================================
- Coverage   89.79%   89.36%   -0.44%     
==========================================
  Files          10       10              
  Lines        2980     3019      +39     
==========================================
+ Hits         2676     2698      +22     
- Misses        304      321      +17     
Impacted Files Coverage Δ
src/analyzers/optanalyzer.jl 93.57% <ø> (ø)
src/abstractinterpret/inferenceerrorreport.jl 86.62% <87.50%> (-3.77%) ⬇️
src/ui/print.jl 93.71% <92.72%> (-1.88%) ⬇️
src/JET.jl 81.93% <100.00%> (ø)
src/abstractinterpret/abstractanalyzer.jl 86.59% <100.00%> (ø)
src/analyzers/jetanalyzer.jl 86.70% <100.00%> (-0.02%) ⬇️
src/ui/vscode.jl 56.00% <100.00%> (-1.70%) ⬇️

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@github-actions
Copy link

github-actions bot commented May 25, 2023

JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 25 May 2023 - 15:24
  • Baseline: 25 May 2023 - 15:37
  • Package commits:
  • Target: ec6d49
  • Baseline: 8dc691
  • Julia commits:
  • Target: 94bc2f
  • Baseline: 94bc2f
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["JETAnalyzer{BasicPass} top-level", "simple"] 1.07 (5%) ❌ 0.99 (1%) ✅
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 0.86 (5%) ✅ 0.86 (1%) ✅
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 0.97 (5%) 0.99 (1%) ✅
["JETAnalyzer{SoundPass}", "identity(nothing)"] 0.94 (5%) ✅ 1.00 (1%)
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 0.92 (5%) ✅ 0.91 (1%) ✅
["JETAnalyzer{SoundPass}", "rand(Bool)"] 0.92 (5%) ✅ 0.93 (1%) ✅
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 0.82 (5%) ✅ 0.85 (1%) ✅
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 0.96 (5%) 0.97 (1%) ✅
["OptAnalyzer", "rand(Bool)"] 0.94 (5%) ✅ 1.00 (1%)
["OptAnalyzer", "sum(\"julia\") (cached)"] 0.89 (5%) ✅ 0.97 (1%) ✅
["OptAnalyzer", "sum(\"julia\")"] 0.89 (5%) ✅ 1.00 (1%)
["show(::IO, ::JETCallResult)", "report_call"] 3.67 (5%) ❌ 2.54 (1%) ❌
["show(::IO, ::JETCallResult)", "report_opt"] 0.82 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.0-DEV.1380
Commit 94bc2f3c9f4 (2023-05-25 00:11 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 4064 s 0 s 244 s 6895 s 0 s
 #2 2793 MHz 6121 s 0 s 264 s 4836 s 0 s
 Memory: 6.781208038330078 GB (4437.8046875 MB free)
 Uptime: 1128.52 sec
 Load Avg: 1.0 1.0 0.73
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.10.0-DEV.1380
Commit 94bc2f3c9f4 (2023-05-25 00:11 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 6477 s 0 s 410 s 12229 s 0 s
 #2 2793 MHz 11774 s 0 s 316 s 7054 s 0 s
 Memory: 6.781208038330078 GB (4360.84375 MB free)
 Uptime: 1921.54 sec
 Load Avg: 1.0 1.02 0.93
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 25 May 2023 - 15:24
  • Package commit: ec6d49
  • Julia commit: 94bc2f
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 226.071 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 640.996 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 336.180 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 50.913 ms (5%) 2.17 MiB (1%) 38040
["JETAnalyzer{BasicPass} top-level", "self analysis"] 13.379 s (5%) 1.380 s 1.14 GiB (1%) 21019339
["JETAnalyzer{BasicPass} top-level", "simple"] 9.891 ms (5%) 2.09 MiB (1%) 36121
["JETAnalyzer{BasicPass}", "identity(nothing)"] 88.800 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 146.656 ms (5%) 37.79 MiB (1%) 708410
["JETAnalyzer{BasicPass}", "rand(Bool)"] 50.487 ms (5%) 14.68 MiB (1%) 268049
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 139.800 μs (5%) 15.00 KiB (1%) 207
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 6.927 ms (5%) 1.94 MiB (1%) 33847
["JETAnalyzer{SoundPass}", "identity(nothing)"] 85.500 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 211.605 ms (5%) 36.421 ms 54.25 MiB (1%) 789087
["JETAnalyzer{SoundPass}", "rand(Bool)"] 53.791 ms (5%) 17.05 MiB (1%) 285890
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 144.700 μs (5%) 18.91 KiB (1%) 244
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 6.985 ms (5%) 2.00 MiB (1%) 35016
["OptAnalyzer", "identity(nothing)"] 138.300 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 535.676 ms (5%) 64.233 ms 199.72 MiB (1%) 2954551
["OptAnalyzer", "rand(Bool)"] 28.704 ms (5%) 13.73 MiB (1%) 204017
["OptAnalyzer", "sum(\"julia\") (cached)"] 253.199 μs (5%) 58.25 KiB (1%) 804
["OptAnalyzer", "sum(\"julia\")"] 14.134 ms (5%) 5.84 MiB (1%) 87463
["show(::IO, ::JETCallResult)", "report_call"] 4.959 ms (5%) 698.98 KiB (1%) 6186
["show(::IO, ::JETCallResult)", "report_opt"] 20.200 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1380
Commit 94bc2f3c9f4 (2023-05-25 00:11 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 4064 s 0 s 244 s 6895 s 0 s
 #2 2793 MHz 6121 s 0 s 264 s 4836 s 0 s
 Memory: 6.781208038330078 GB (4437.8046875 MB free)
 Uptime: 1128.52 sec
 Load Avg: 1.0 1.0 0.73
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 25 May 2023 - 15:37
  • Package commit: 8dc691
  • Julia commit: 94bc2f
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 225.045 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 652.774 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 335.991 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 50.397 ms (5%) 2.18 MiB (1%) 38286
["JETAnalyzer{BasicPass} top-level", "self analysis"] 12.810 s (5%) 1.168 s 1.15 GiB (1%) 21136157
["JETAnalyzer{BasicPass} top-level", "simple"] 9.255 ms (5%) 2.11 MiB (1%) 36472
["JETAnalyzer{BasicPass}", "identity(nothing)"] 90.400 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 145.868 ms (5%) 37.87 MiB (1%) 709859
["JETAnalyzer{BasicPass}", "rand(Bool)"] 50.854 ms (5%) 14.64 MiB (1%) 268536
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 162.499 μs (5%) 17.36 KiB (1%) 230
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 7.157 ms (5%) 1.96 MiB (1%) 34188
["JETAnalyzer{SoundPass}", "identity(nothing)"] 90.500 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 229.834 ms (5%) 34.847 ms 59.44 MiB (1%) 847624
["JETAnalyzer{SoundPass}", "rand(Bool)"] 58.269 ms (5%) 18.32 MiB (1%) 303100
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 176.299 μs (5%) 22.36 KiB (1%) 267
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 7.290 ms (5%) 2.07 MiB (1%) 36196
["OptAnalyzer", "identity(nothing)"] 136.000 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 534.880 ms (5%) 64.233 ms 199.82 MiB (1%) 2956302
["OptAnalyzer", "rand(Bool)"] 30.426 ms (5%) 13.72 MiB (1%) 204151
["OptAnalyzer", "sum(\"julia\") (cached)"] 283.900 μs (5%) 60.02 KiB (1%) 827
["OptAnalyzer", "sum(\"julia\")"] 15.827 ms (5%) 5.86 MiB (1%) 87728
["show(::IO, ::JETCallResult)", "report_call"] 1.352 ms (5%) 275.25 KiB (1%) 5086
["show(::IO, ::JETCallResult)", "report_opt"] 24.600 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1380
Commit 94bc2f3c9f4 (2023-05-25 00:11 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 6477 s 0 s 410 s 12229 s 0 s
 #2 2793 MHz 11774 s 0 s 316 s 7054 s 0 s
 Memory: 6.781208038330078 GB (4360.84375 MB free)
 Uptime: 1921.54 sec
 Load Avg: 1.0 1.02 0.93
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
CPU family: 6
Model: 106
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 6
BogoMIPS: 5586.87
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 96 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 2.5 MiB (2 instances)
L3 cache: 48 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Vendor :Intel
Architecture :UnknownIntel
Model Family: 0x06, Model: 0x6a, Stepping: 0x06, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (48, 1280, 49152) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 29 May 2023 - 09:42
  • Baseline: 29 May 2023 - 09:56
  • Package commits:
  • Target: 21eaff
  • Baseline: 8dc691
  • Julia commits:
  • Target: 248ced
  • Baseline: 248ced
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 0.81 (5%) ✅ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "self analysis"] 0.84 (5%) ✅ 0.99 (1%)
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 0.81 (5%) ✅ 0.86 (1%) ✅
["JETAnalyzer{SoundPass}", "identity(nothing)"] 0.89 (5%) ✅ 1.00 (1%)
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 0.87 (5%) ✅ 0.91 (1%) ✅
["JETAnalyzer{SoundPass}", "rand(Bool)"] 0.88 (5%) ✅ 0.92 (1%) ✅
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 0.76 (5%) ✅ 0.85 (1%) ✅
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 0.91 (5%) ✅ 0.97 (1%) ✅
["OptAnalyzer", "identity(nothing)"] 0.95 (5%) ✅ 1.00 (1%)
["OptAnalyzer", "println(QuoteNode(nothing))"] 0.93 (5%) ✅ 1.00 (1%)
["OptAnalyzer", "rand(Bool)"] 0.90 (5%) ✅ 1.00 (1%)
["OptAnalyzer", "sum(\"julia\") (cached)"] 0.90 (5%) ✅ 0.97 (1%) ✅
["OptAnalyzer", "sum(\"julia\")"] 0.88 (5%) ✅ 1.00 (1%)
["show(::IO, ::JETCallResult)", "report_call"] 3.40 (5%) ❌ 2.63 (1%) ❌
["show(::IO, ::JETCallResult)", "report_opt"] 0.91 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.0-DEV.1392
Commit 248ceda3c49 (2023-05-27 13:39 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 5500 s 0 s 225 s 6479 s 0 s
 #2 2593 MHz 4791 s 0 s 312 s 7065 s 0 s
 Memory: 6.781208038330078 GB (4669.57421875 MB free)
 Uptime: 1226.51 sec
 Load Avg: 1.0 1.0 0.74
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.10.0-DEV.1392
Commit 248ceda3c49 (2023-05-27 13:39 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 11606 s 0 s 378 s 8416 s 0 s
 #2 2593 MHz 6987 s 0 s 397 s 12962 s 0 s
 Memory: 6.781208038330078 GB (4691.6328125 MB free)
 Uptime: 2047.14 sec
 Load Avg: 1.0 1.01 0.93
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 29 May 2023 - 9:42
  • Package commit: 21eaff
  • Julia commit: 248ced
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 261.515 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 565.868 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 259.541 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 49.973 ms (5%) 2.17 MiB (1%) 38079
["JETAnalyzer{BasicPass} top-level", "self analysis"] 14.775 s (5%) 1.704 s 1.14 GiB (1%) 21072283
["JETAnalyzer{BasicPass} top-level", "simple"] 10.206 ms (5%) 2.09 MiB (1%) 36125
["JETAnalyzer{BasicPass}", "identity(nothing)"] 126.101 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 174.272 ms (5%) 37.76 MiB (1%) 707909
["JETAnalyzer{BasicPass}", "rand(Bool)"] 57.073 ms (5%) 14.62 MiB (1%) 268140
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 164.501 μs (5%) 15.00 KiB (1%) 207
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 7.743 ms (5%) 1.94 MiB (1%) 33847
["JETAnalyzer{SoundPass}", "identity(nothing)"] 109.501 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 255.207 ms (5%) 48.262 ms 54.20 MiB (1%) 788643
["JETAnalyzer{SoundPass}", "rand(Bool)"] 63.176 ms (5%) 16.97 MiB (1%) 286015
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 184.802 μs (5%) 18.91 KiB (1%) 244
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 7.422 ms (5%) 2.00 MiB (1%) 35016
["OptAnalyzer", "identity(nothing)"] 175.401 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 616.056 ms (5%) 83.249 ms 200.00 MiB (1%) 2959865
["OptAnalyzer", "rand(Bool)"] 34.211 ms (5%) 13.74 MiB (1%) 204146
["OptAnalyzer", "sum(\"julia\") (cached)"] 330.602 μs (5%) 58.25 KiB (1%) 804
["OptAnalyzer", "sum(\"julia\")"] 16.404 ms (5%) 5.84 MiB (1%) 87467
["show(::IO, ::JETCallResult)", "report_call"] 5.885 ms (5%) 724.26 KiB (1%) 6779
["show(::IO, ::JETCallResult)", "report_opt"] 26.200 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1392
Commit 248ceda3c49 (2023-05-27 13:39 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 5500 s 0 s 225 s 6479 s 0 s
 #2 2593 MHz 4791 s 0 s 312 s 7065 s 0 s
 Memory: 6.781208038330078 GB (4669.57421875 MB free)
 Uptime: 1226.51 sec
 Load Avg: 1.0 1.0 0.74
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 29 May 2023 - 9:56
  • Package commit: 8dc691
  • Julia commit: 248ced
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 258.509 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 698.406 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 261.992 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 52.228 ms (5%) 2.18 MiB (1%) 38324
["JETAnalyzer{BasicPass} top-level", "self analysis"] 17.499 s (5%) 1.690 s 1.15 GiB (1%) 21189233
["JETAnalyzer{BasicPass} top-level", "simple"] 10.647 ms (5%) 2.11 MiB (1%) 36475
["JETAnalyzer{BasicPass}", "identity(nothing)"] 120.801 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 173.062 ms (5%) 37.84 MiB (1%) 709361
["JETAnalyzer{BasicPass}", "rand(Bool)"] 57.149 ms (5%) 14.65 MiB (1%) 268632
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 202.202 μs (5%) 17.36 KiB (1%) 230
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 7.897 ms (5%) 1.95 MiB (1%) 34187
["JETAnalyzer{SoundPass}", "identity(nothing)"] 123.301 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 291.694 ms (5%) 49.072 ms 59.53 MiB (1%) 847357
["JETAnalyzer{SoundPass}", "rand(Bool)"] 71.456 ms (5%) 18.35 MiB (1%) 303332
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 244.702 μs (5%) 22.36 KiB (1%) 267
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 8.141 ms (5%) 2.06 MiB (1%) 36195
["OptAnalyzer", "identity(nothing)"] 184.901 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 660.932 ms (5%) 94.526 ms 200.10 MiB (1%) 2961624
["OptAnalyzer", "rand(Bool)"] 38.047 ms (5%) 13.74 MiB (1%) 204284
["OptAnalyzer", "sum(\"julia\") (cached)"] 367.404 μs (5%) 60.02 KiB (1%) 827
["OptAnalyzer", "sum(\"julia\")"] 18.741 ms (5%) 5.85 MiB (1%) 87731
["show(::IO, ::JETCallResult)", "report_call"] 1.729 ms (5%) 275.25 KiB (1%) 5086
["show(::IO, ::JETCallResult)", "report_opt"] 28.800 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1392
Commit 248ceda3c49 (2023-05-27 13:39 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 11606 s 0 s 378 s 8416 s 0 s
 #2 2593 MHz 6987 s 0 s 397 s 12962 s 0 s
 Memory: 6.781208038330078 GB (4691.6328125 MB free)
 Uptime: 2047.14 sec
 Load Avg: 1.0 1.01 0.93
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
CPU family: 6
Model: 85
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 7
BogoMIPS: 5187.80
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 2 MiB (2 instances)
L3 cache: 35.8 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Vulnerable
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Vendor :Intel
Architecture :Skylake
Model Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 1024, 36608) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 29 May 2023 - 11:16
  • Baseline: 29 May 2023 - 11:30
  • Package commits:
  • Target: e2ce80
  • Baseline: 8dc691
  • Julia commits:
  • Target: 0d5bd2
  • Baseline: 0d5bd2
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["JETAnalyzer{BasicPass} top-level", "simple"] 1.01 (5%) 0.99 (1%) ✅
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 0.83 (5%) ✅ 0.86 (1%) ✅
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 0.98 (5%) 0.99 (1%) ✅
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 0.83 (5%) ✅ 0.91 (1%) ✅
["JETAnalyzer{SoundPass}", "rand(Bool)"] 0.86 (5%) ✅ 0.93 (1%) ✅
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 0.84 (5%) ✅ 0.85 (1%) ✅
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 0.96 (5%) 0.97 (1%) ✅
["OptAnalyzer", "sum(\"julia\") (cached)"] 0.94 (5%) ✅ 0.97 (1%) ✅
["show(::IO, ::JETCallResult)", "report_call"] 4.23 (5%) ❌ 2.63 (1%) ❌

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.0-DEV.1393
Commit 0d5bd2f5baf (2023-05-29 09:16 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 4501 s 0 s 329 s 6358 s 0 s
 #2 2593 MHz 5658 s 0 s 207 s 5307 s 0 s
 Memory: 6.781208038330078 GB (4533.40234375 MB free)
 Uptime: 1127.54 sec
 Load Avg: 1.06 1.06 0.82
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.10.0-DEV.1393
Commit 0d5bd2f5baf (2023-05-29 09:16 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 11432 s 0 s 431 s 7306 s 0 s
 #2 2593 MHz 6835 s 0 s 353 s 11947 s 0 s
 Memory: 6.781208038330078 GB (4533.5625 MB free)
 Uptime: 1926.03 sec
 Load Avg: 1.1 1.07 1.0
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 29 May 2023 - 11:16
  • Package commit: e2ce80
  • Julia commit: 0d5bd2
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 239.379 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 631.106 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 337.564 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 49.270 ms (5%) 2.17 MiB (1%) 38080
["JETAnalyzer{BasicPass} top-level", "self analysis"] 13.083 s (5%) 1.288 s 1.14 GiB (1%) 21062526
["JETAnalyzer{BasicPass} top-level", "simple"] 9.687 ms (5%) 2.09 MiB (1%) 36125
["JETAnalyzer{BasicPass}", "identity(nothing)"] 94.501 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 163.549 ms (5%) 37.76 MiB (1%) 707909
["JETAnalyzer{BasicPass}", "rand(Bool)"] 53.621 ms (5%) 14.62 MiB (1%) 268146
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 144.801 μs (5%) 15.00 KiB (1%) 207
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 7.292 ms (5%) 1.94 MiB (1%) 33847
["JETAnalyzer{SoundPass}", "identity(nothing)"] 95.600 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 191.126 ms (5%) 54.20 MiB (1%) 788646
["JETAnalyzer{SoundPass}", "rand(Bool)"] 55.439 ms (5%) 17.01 MiB (1%) 286036
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 158.902 μs (5%) 18.91 KiB (1%) 244
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 7.196 ms (5%) 2.00 MiB (1%) 35016
["OptAnalyzer", "identity(nothing)"] 144.701 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 582.676 ms (5%) 69.311 ms 200.00 MiB (1%) 2959843
["OptAnalyzer", "rand(Bool)"] 31.278 ms (5%) 13.74 MiB (1%) 204152
["OptAnalyzer", "sum(\"julia\") (cached)"] 291.102 μs (5%) 58.25 KiB (1%) 804
["OptAnalyzer", "sum(\"julia\")"] 14.681 ms (5%) 5.84 MiB (1%) 87467
["show(::IO, ::JETCallResult)", "report_call"] 5.663 ms (5%) 724.26 KiB (1%) 6779
["show(::IO, ::JETCallResult)", "report_opt"] 22.300 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1393
Commit 0d5bd2f5baf (2023-05-29 09:16 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 4501 s 0 s 329 s 6358 s 0 s
 #2 2593 MHz 5658 s 0 s 207 s 5307 s 0 s
 Memory: 6.781208038330078 GB (4533.40234375 MB free)
 Uptime: 1127.54 sec
 Load Avg: 1.06 1.06 0.82
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 29 May 2023 - 11:30
  • Package commit: 8dc691
  • Julia commit: 0d5bd2
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 241.115 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 642.572 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 336.490 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 49.165 ms (5%) 2.18 MiB (1%) 38326
["JETAnalyzer{BasicPass} top-level", "self analysis"] 13.445 s (5%) 1.509 s 1.15 GiB (1%) 21179472
["JETAnalyzer{BasicPass} top-level", "simple"] 9.583 ms (5%) 2.11 MiB (1%) 36476
["JETAnalyzer{BasicPass}", "identity(nothing)"] 91.000 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 160.057 ms (5%) 37.84 MiB (1%) 709358
["JETAnalyzer{BasicPass}", "rand(Bool)"] 53.466 ms (5%) 14.65 MiB (1%) 268635
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 174.101 μs (5%) 17.36 KiB (1%) 230
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 7.414 ms (5%) 1.96 MiB (1%) 34188
["JETAnalyzer{SoundPass}", "identity(nothing)"] 96.701 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 231.626 ms (5%) 27.484 ms 59.52 MiB (1%) 847354
["JETAnalyzer{SoundPass}", "rand(Bool)"] 64.432 ms (5%) 18.35 MiB (1%) 303335
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 189.601 μs (5%) 22.36 KiB (1%) 267
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 7.481 ms (5%) 2.07 MiB (1%) 36196
["OptAnalyzer", "identity(nothing)"] 144.202 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 578.271 ms (5%) 67.750 ms 200.10 MiB (1%) 2961601
["OptAnalyzer", "rand(Bool)"] 31.506 ms (5%) 13.74 MiB (1%) 204287
["OptAnalyzer", "sum(\"julia\") (cached)"] 310.603 μs (5%) 60.02 KiB (1%) 827
["OptAnalyzer", "sum(\"julia\")"] 14.784 ms (5%) 5.86 MiB (1%) 87732
["show(::IO, ::JETCallResult)", "report_call"] 1.338 ms (5%) 275.25 KiB (1%) 5086
["show(::IO, ::JETCallResult)", "report_opt"] 21.700 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1393
Commit 0d5bd2f5baf (2023-05-29 09:16 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 11432 s 0 s 431 s 7306 s 0 s
 #2 2593 MHz 6835 s 0 s 353 s 11947 s 0 s
 Memory: 6.781208038330078 GB (4533.5625 MB free)
 Uptime: 1926.03 sec
 Load Avg: 1.1 1.07 1.0
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
CPU family: 6
Model: 85
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 7
BogoMIPS: 5187.81
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 2 MiB (2 instances)
L3 cache: 35.8 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Vulnerable
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Vendor :Intel
Architecture :Skylake
Model Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 1024, 36608) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 30 May 2023 - 09:47
  • Baseline: 30 May 2023 - 10:00
  • Package commits:
  • Target: 6112b5
  • Baseline: bc9e92
  • Julia commits:
  • Target: ed5bd4
  • Baseline: ed5bd4
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 0.82 (5%) ✅ 1.00 (1%)
["First-Time-To-JET", "sum(\"julia\")"] 0.65 (5%) ✅ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "simple"] 1.02 (5%) 0.99 (1%) ✅
["JETAnalyzer{BasicPass}", "identity(nothing)"] 1.10 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 1.06 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 0.80 (5%) ✅ 0.86 (1%) ✅
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 1.04 (5%) 0.99 (1%) ✅
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 0.87 (5%) ✅ 0.91 (1%) ✅
["JETAnalyzer{SoundPass}", "rand(Bool)"] 0.90 (5%) ✅ 0.93 (1%) ✅
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 0.90 (5%) ✅ 0.84 (1%) ✅
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 0.98 (5%) 0.97 (1%) ✅
["OptAnalyzer", "sum(\"julia\") (cached)"] 0.91 (5%) ✅ 0.97 (1%) ✅
["show(::IO, ::JETCallResult)", "report_call"] 4.03 (5%) ❌ 2.63 (1%) ❌
["show(::IO, ::JETCallResult)", "report_opt"] 0.87 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 4510 s 0 s 196 s 6164 s 0 s
 #2 2593 MHz 5667 s 0 s 341 s 4860 s 0 s
 Memory: 6.781208038330078 GB (4659.35546875 MB free)
 Uptime: 1094.8 sec
 Load Avg: 1.0 1.0 0.74
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 6675 s 0 s 260 s 11933 s 0 s
 #2 2593 MHz 11632 s 0 s 524 s 6727 s 0 s
 Memory: 6.781208038330078 GB (4595.95703125 MB free)
 Uptime: 1897.15 sec
 Load Avg: 1.0 1.01 0.93
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 30 May 2023 - 9:47
  • Package commit: 6112b5
  • Julia commit: ed5bd4
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 249.104 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 536.187 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 222.419 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 50.150 ms (5%) 2.17 MiB (1%) 38065
["JETAnalyzer{BasicPass} top-level", "self analysis"] 15.411 s (5%) 1.351 s 1.27 GiB (1%) 23558081
["JETAnalyzer{BasicPass} top-level", "simple"] 10.041 ms (5%) 2.08 MiB (1%) 35952
["JETAnalyzer{BasicPass}", "identity(nothing)"] 108.102 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 167.190 ms (5%) 37.63 MiB (1%) 703622
["JETAnalyzer{BasicPass}", "rand(Bool)"] 56.149 ms (5%) 14.64 MiB (1%) 266629
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 147.503 μs (5%) 14.91 KiB (1%) 204
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 7.742 ms (5%) 1.93 MiB (1%) 33675
["JETAnalyzer{SoundPass}", "identity(nothing)"] 102.302 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 196.255 ms (5%) 54.01 MiB (1%) 784339
["JETAnalyzer{SoundPass}", "rand(Bool)"] 59.198 ms (5%) 16.99 MiB (1%) 284504
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 175.304 μs (5%) 18.81 KiB (1%) 241
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 7.608 ms (5%) 1.99 MiB (1%) 34844
["OptAnalyzer", "identity(nothing)"] 147.202 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 596.815 ms (5%) 71.574 ms 199.77 MiB (1%) 2951779
["OptAnalyzer", "rand(Bool)"] 32.366 ms (5%) 13.72 MiB (1%) 203671
["OptAnalyzer", "sum(\"julia\") (cached)"] 289.305 μs (5%) 58.16 KiB (1%) 801
["OptAnalyzer", "sum(\"julia\")"] 14.887 ms (5%) 5.84 MiB (1%) 87265
["show(::IO, ::JETCallResult)", "report_call"] 5.827 ms (5%) 724.26 KiB (1%) 6779
["show(::IO, ::JETCallResult)", "report_opt"] 21.001 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 4510 s 0 s 196 s 6164 s 0 s
 #2 2593 MHz 5667 s 0 s 341 s 4860 s 0 s
 Memory: 6.781208038330078 GB (4659.35546875 MB free)
 Uptime: 1094.8 sec
 Load Avg: 1.0 1.0 0.74
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 30 May 2023 - 10:0
  • Package commit: bc9e92
  • Julia commit: ed5bd4
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 247.277 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 654.397 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 344.720 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 50.075 ms (5%) 2.18 MiB (1%) 38310
["JETAnalyzer{BasicPass} top-level", "self analysis"] 16.030 s (5%) 1.531 s 1.28 GiB (1%) 23667548
["JETAnalyzer{BasicPass} top-level", "simple"] 9.877 ms (5%) 2.11 MiB (1%) 36303
["JETAnalyzer{BasicPass}", "identity(nothing)"] 98.302 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 157.873 ms (5%) 37.71 MiB (1%) 705071
["JETAnalyzer{BasicPass}", "rand(Bool)"] 56.794 ms (5%) 14.60 MiB (1%) 267116
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 183.404 μs (5%) 17.27 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 7.461 ms (5%) 1.95 MiB (1%) 34016
["JETAnalyzer{SoundPass}", "identity(nothing)"] 99.202 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 226.606 ms (5%) 59.37 MiB (1%) 843065
["JETAnalyzer{SoundPass}", "rand(Bool)"] 65.672 ms (5%) 18.30 MiB (1%) 301816
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 194.804 μs (5%) 22.27 KiB (1%) 264
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 7.735 ms (5%) 2.06 MiB (1%) 36024
["OptAnalyzer", "identity(nothing)"] 149.303 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 596.063 ms (5%) 71.175 ms 199.88 MiB (1%) 2953776
["OptAnalyzer", "rand(Bool)"] 32.090 ms (5%) 13.73 MiB (1%) 203806
["OptAnalyzer", "sum(\"julia\") (cached)"] 317.505 μs (5%) 59.92 KiB (1%) 824
["OptAnalyzer", "sum(\"julia\")"] 15.178 ms (5%) 5.85 MiB (1%) 87530
["show(::IO, ::JETCallResult)", "report_call"] 1.445 ms (5%) 275.25 KiB (1%) 5086
["show(::IO, ::JETCallResult)", "report_opt"] 24.100 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 6675 s 0 s 260 s 11933 s 0 s
 #2 2593 MHz 11632 s 0 s 524 s 6727 s 0 s
 Memory: 6.781208038330078 GB (4595.95703125 MB free)
 Uptime: 1897.15 sec
 Load Avg: 1.0 1.01 0.93
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
CPU family: 6
Model: 85
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 7
BogoMIPS: 5187.81
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 2 MiB (2 instances)
L3 cache: 35.8 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Vulnerable
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Vendor :Intel
Architecture :Skylake
Model Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 1024, 36608) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 30 May 2023 - 10:00
  • Baseline: 30 May 2023 - 10:14
  • Package commits:
  • Target: 1abd02
  • Baseline: bc9e92
  • Julia commits:
  • Target: ed5bd4
  • Baseline: ed5bd4
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "sum(\"julia\")"] 0.84 (5%) ✅ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "self analysis"] 0.77 (5%) ✅ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "simple"] 0.78 (5%) ✅ 0.99 (1%) ✅
["JETAnalyzer{BasicPass}", "identity(nothing)"] 0.94 (5%) ✅ 1.00 (1%)
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 0.76 (5%) ✅ 0.86 (1%) ✅
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 0.95 (5%) 0.99 (1%) ✅
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 0.93 (5%) ✅ 0.92 (1%) ✅
["JETAnalyzer{SoundPass}", "rand(Bool)"] 0.94 (5%) ✅ 0.92 (1%) ✅
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 0.80 (5%) ✅ 0.84 (1%) ✅
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 0.98 (5%) 0.97 (1%) ✅
["OptAnalyzer", "sum(\"julia\") (cached)"] 0.91 (5%) ✅ 0.97 (1%) ✅
["OptAnalyzer", "sum(\"julia\")"] 0.86 (5%) ✅ 1.00 (1%)
["show(::IO, ::JETCallResult)", "report_call"] 4.44 (5%) ❌ 2.63 (1%) ❌
["show(::IO, ::JETCallResult)", "report_opt"] 1.74 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
 speed user nice sys idle irq
 #1 2294 MHz 9146 s 0 s 295 s 3639 s 0 s
 #2 2294 MHz 2386 s 0 s 333 s 10297 s 0 s
 Memory: 6.781208038330078 GB (4703.62890625 MB free)
 Uptime: 1316.15 sec
 Load Avg: 1.08 1.05 0.85
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, broadwell)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
 speed user nice sys idle irq
 #1 2294 MHz 13014 s 0 s 420 s 8564 s 0 s
 #2 2294 MHz 7568 s 0 s 463 s 13915 s 0 s
 Memory: 6.781208038330078 GB (4679.71484375 MB free)
 Uptime: 2210.75 sec
 Load Avg: 1.1 1.07 1.01
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, broadwell)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 30 May 2023 - 10:0
  • Package commit: 1abd02
  • Julia commit: ed5bd4
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 263.173 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 757.891 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 265.704 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 61.746 ms (5%) 2.17 MiB (1%) 38065
["JETAnalyzer{BasicPass} top-level", "self analysis"] 18.754 s (5%) 1.696 s 1.27 GiB (1%) 23558072
["JETAnalyzer{BasicPass} top-level", "simple"] 13.060 ms (5%) 2.08 MiB (1%) 35952
["JETAnalyzer{BasicPass}", "identity(nothing)"] 114.401 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 246.168 ms (5%) 37.63 MiB (1%) 703617
["JETAnalyzer{BasicPass}", "rand(Bool)"] 82.172 ms (5%) 14.57 MiB (1%) 266622
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 172.100 μs (5%) 14.91 KiB (1%) 204
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 10.650 ms (5%) 1.93 MiB (1%) 33675
["JETAnalyzer{SoundPass}", "identity(nothing)"] 112.302 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 341.628 ms (5%) 48.687 ms 54.55 MiB (1%) 784420
["JETAnalyzer{SoundPass}", "rand(Bool)"] 91.715 ms (5%) 16.92 MiB (1%) 284497
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 191.203 μs (5%) 18.81 KiB (1%) 241
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 11.745 ms (5%) 1.99 MiB (1%) 34844
["OptAnalyzer", "identity(nothing)"] 180.801 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 837.230 ms (5%) 96.379 ms 199.77 MiB (1%) 2951774
["OptAnalyzer", "rand(Bool)"] 49.485 ms (5%) 13.72 MiB (1%) 203666
["OptAnalyzer", "sum(\"julia\") (cached)"] 336.301 μs (5%) 58.16 KiB (1%) 801
["OptAnalyzer", "sum(\"julia\")"] 23.709 ms (5%) 5.84 MiB (1%) 87265
["show(::IO, ::JETCallResult)", "report_call"] 7.754 ms (5%) 724.26 KiB (1%) 6779
["show(::IO, ::JETCallResult)", "report_opt"] 40.200 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
 speed user nice sys idle irq
 #1 2294 MHz 9146 s 0 s 295 s 3639 s 0 s
 #2 2294 MHz 2386 s 0 s 333 s 10297 s 0 s
 Memory: 6.781208038330078 GB (4703.62890625 MB free)
 Uptime: 1316.15 sec
 Load Avg: 1.08 1.05 0.85
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, broadwell)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 30 May 2023 - 10:14
  • Package commit: bc9e92
  • Julia commit: ed5bd4
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 264.965 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 725.788 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 317.453 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 60.243 ms (5%) 2.18 MiB (1%) 38302
["JETAnalyzer{BasicPass} top-level", "self analysis"] 24.292 s (5%) 1.834 s 1.28 GiB (1%) 23667535
["JETAnalyzer{BasicPass} top-level", "simple"] 16.827 ms (5%) 2.11 MiB (1%) 36303
["JETAnalyzer{BasicPass}", "identity(nothing)"] 122.201 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 245.642 ms (5%) 37.71 MiB (1%) 705073
["JETAnalyzer{BasicPass}", "rand(Bool)"] 84.347 ms (5%) 14.66 MiB (1%) 267120
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 227.101 μs (5%) 17.27 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 11.168 ms (5%) 1.95 MiB (1%) 34016
["JETAnalyzer{SoundPass}", "identity(nothing)"] 114.401 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 367.168 ms (5%) 45.940 ms 59.37 MiB (1%) 843067
["JETAnalyzer{SoundPass}", "rand(Bool)"] 97.211 ms (5%) 18.37 MiB (1%) 301820
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 239.002 μs (5%) 22.27 KiB (1%) 264
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 11.949 ms (5%) 2.06 MiB (1%) 36024
["OptAnalyzer", "identity(nothing)"] 179.400 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 863.919 ms (5%) 90.177 ms 199.88 MiB (1%) 2953750
["OptAnalyzer", "rand(Bool)"] 50.448 ms (5%) 13.73 MiB (1%) 203808
["OptAnalyzer", "sum(\"julia\") (cached)"] 370.001 μs (5%) 59.92 KiB (1%) 824
["OptAnalyzer", "sum(\"julia\")"] 27.656 ms (5%) 5.85 MiB (1%) 87530
["show(::IO, ::JETCallResult)", "report_call"] 1.745 ms (5%) 275.25 KiB (1%) 5086
["show(::IO, ::JETCallResult)", "report_opt"] 23.100 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
 speed user nice sys idle irq
 #1 2294 MHz 13014 s 0 s 420 s 8564 s 0 s
 #2 2294 MHz 7568 s 0 s 463 s 13915 s 0 s
 Memory: 6.781208038330078 GB (4679.71484375 MB free)
 Uptime: 2210.75 sec
 Load Avg: 1.1 1.07 1.01
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, broadwell)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
CPU family: 6
Model: 79
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4589.36
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 512 KiB (2 instances)
L3 cache: 50 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Vendor :Intel
Architecture :Broadwell
Model Family: 0x06, Model: 0x4f, Stepping: 0x01, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 256, 51200) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 30 May 2023 - 10:46
  • Baseline: 30 May 2023 - 10:59
  • Package commits:
  • Target: 695d52
  • Baseline: 73a03d
  • Julia commits:
  • Target: ed5bd4
  • Baseline: ed5bd4
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "sum(\"julia\")"] 0.63 (5%) ✅ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "self analysis"] 0.78 (5%) ✅ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "simple"] 1.04 (5%) 0.99 (1%) ✅
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 1.11 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 0.90 (5%) ✅ 0.86 (1%) ✅
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 0.96 (5%) 0.99 (1%) ✅
["JETAnalyzer{SoundPass}", "identity(nothing)"] 1.05 (5%) ❌ 1.00 (1%)
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 0.90 (5%) ✅ 0.91 (1%) ✅
["JETAnalyzer{SoundPass}", "rand(Bool)"] 0.90 (5%) ✅ 0.93 (1%) ✅
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 0.92 (5%) ✅ 0.84 (1%) ✅
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 0.96 (5%) 0.97 (1%) ✅
["OptAnalyzer", "identity(nothing)"] 0.93 (5%) ✅ 1.00 (1%)
["OptAnalyzer", "rand(Bool)"] 0.94 (5%) ✅ 1.00 (1%)
["OptAnalyzer", "sum(\"julia\") (cached)"] 0.91 (5%) ✅ 0.97 (1%) ✅
["OptAnalyzer", "sum(\"julia\")"] 0.95 (5%) ✅ 1.00 (1%)
["show(::IO, ::JETCallResult)", "report_call"] 3.84 (5%) ❌ 2.63 (1%) ❌
["show(::IO, ::JETCallResult)", "report_opt"] 0.92 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 3172 s 0 s 298 s 8497 s 0 s
 #2 2593 MHz 7273 s 0 s 242 s 4481 s 0 s
 Memory: 6.781208038330078 GB (4642.84765625 MB free)
 Uptime: 1205.47 sec
 Load Avg: 1.0 1.0 0.75
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 4441 s 0 s 424 s 15188 s 0 s
 #2 2593 MHz 14222 s 0 s 358 s 5524 s 0 s
 Memory: 6.781208038330078 GB (4652.8828125 MB free)
 Uptime: 2016.78 sec
 Load Avg: 1.05 1.03 0.94
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 30 May 2023 - 10:46
  • Package commit: 695d52
  • Julia commit: ed5bd4
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 260.488 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 632.595 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 223.878 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 50.318 ms (5%) 2.17 MiB (1%) 38065
["JETAnalyzer{BasicPass} top-level", "self analysis"] 14.862 s (5%) 1.508 s 1.27 GiB (1%) 23558726
["JETAnalyzer{BasicPass} top-level", "simple"] 10.311 ms (5%) 2.08 MiB (1%) 35952
["JETAnalyzer{BasicPass}", "identity(nothing)"] 108.601 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 175.817 ms (5%) 37.63 MiB (1%) 703625
["JETAnalyzer{BasicPass}", "rand(Bool)"] 55.659 ms (5%) 14.64 MiB (1%) 266632
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 185.102 μs (5%) 14.91 KiB (1%) 204
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 7.732 ms (5%) 1.93 MiB (1%) 33675
["JETAnalyzer{SoundPass}", "identity(nothing)"] 119.001 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 200.431 ms (5%) 54.09 MiB (1%) 784348
["JETAnalyzer{SoundPass}", "rand(Bool)"] 60.807 ms (5%) 16.99 MiB (1%) 284507
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 206.402 μs (5%) 18.81 KiB (1%) 241
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 7.507 ms (5%) 1.99 MiB (1%) 34844
["OptAnalyzer", "identity(nothing)"] 169.903 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 630.516 ms (5%) 87.586 ms 199.77 MiB (1%) 2951811
["OptAnalyzer", "rand(Bool)"] 33.737 ms (5%) 13.72 MiB (1%) 203674
["OptAnalyzer", "sum(\"julia\") (cached)"] 319.804 μs (5%) 58.16 KiB (1%) 801
["OptAnalyzer", "sum(\"julia\")"] 15.993 ms (5%) 5.84 MiB (1%) 87265
["show(::IO, ::JETCallResult)", "report_call"] 5.989 ms (5%) 724.26 KiB (1%) 6779
["show(::IO, ::JETCallResult)", "report_opt"] 25.800 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 3172 s 0 s 298 s 8497 s 0 s
 #2 2593 MHz 7273 s 0 s 242 s 4481 s 0 s
 Memory: 6.781208038330078 GB (4642.84765625 MB free)
 Uptime: 1205.47 sec
 Load Avg: 1.0 1.0 0.75
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 30 May 2023 - 10:59
  • Package commit: 73a03d
  • Julia commit: ed5bd4
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 248.982 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 663.731 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 355.219 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 51.488 ms (5%) 2.18 MiB (1%) 38310
["JETAnalyzer{BasicPass} top-level", "self analysis"] 18.973 s (5%) 1.992 s 1.28 GiB (1%) 23667557
["JETAnalyzer{BasicPass} top-level", "simple"] 9.937 ms (5%) 2.11 MiB (1%) 36303
["JETAnalyzer{BasicPass}", "identity(nothing)"] 108.302 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 158.621 ms (5%) 37.71 MiB (1%) 705075
["JETAnalyzer{BasicPass}", "rand(Bool)"] 57.649 ms (5%) 14.60 MiB (1%) 267120
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 205.803 μs (5%) 17.27 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 8.060 ms (5%) 1.95 MiB (1%) 34017
["JETAnalyzer{SoundPass}", "identity(nothing)"] 113.301 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 221.812 ms (5%) 59.38 MiB (1%) 843071
["JETAnalyzer{SoundPass}", "rand(Bool)"] 67.735 ms (5%) 18.31 MiB (1%) 301820
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 223.502 μs (5%) 22.27 KiB (1%) 264
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 7.815 ms (5%) 2.06 MiB (1%) 36024
["OptAnalyzer", "identity(nothing)"] 183.603 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 614.203 ms (5%) 78.813 ms 199.88 MiB (1%) 2953781
["OptAnalyzer", "rand(Bool)"] 36.041 ms (5%) 13.73 MiB (1%) 203810
["OptAnalyzer", "sum(\"julia\") (cached)"] 351.906 μs (5%) 59.92 KiB (1%) 824
["OptAnalyzer", "sum(\"julia\")"] 16.921 ms (5%) 5.85 MiB (1%) 87530
["show(::IO, ::JETCallResult)", "report_call"] 1.561 ms (5%) 275.25 KiB (1%) 5086
["show(::IO, ::JETCallResult)", "report_opt"] 28.000 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 4441 s 0 s 424 s 15188 s 0 s
 #2 2593 MHz 14222 s 0 s 358 s 5524 s 0 s
 Memory: 6.781208038330078 GB (4652.8828125 MB free)
 Uptime: 2016.78 sec
 Load Avg: 1.05 1.03 0.94
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
CPU family: 6
Model: 85
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 7
BogoMIPS: 5187.81
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 2 MiB (2 instances)
L3 cache: 35.8 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Vulnerable
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Vendor :Intel
Architecture :Skylake
Model Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 1024, 36608) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 30 May 2023 - 11:02
  • Baseline: 30 May 2023 - 11:16
  • Package commits:
  • Target: dc311d
  • Baseline: 717a6d
  • Julia commits:
  • Target: ed5bd4
  • Baseline: ed5bd4
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "package loading"] 1.07 (5%) ❌ 1.00 (1%)
["First-Time-To-JET", "rand(Bool)"] 0.63 (5%) ✅ 1.00 (1%)
["First-Time-To-JET", "sum(\"julia\")"] 0.66 (5%) ✅ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "demo"] 1.10 (5%) ❌ 0.99 (1%)
["JETAnalyzer{BasicPass} top-level", "self analysis"] 1.10 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "simple"] 1.12 (5%) ❌ 0.99 (1%) ✅
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 0.69 (5%) ✅ 0.86 (1%) ✅
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 0.95 (5%) ✅ 0.99 (1%) ✅
["JETAnalyzer{SoundPass}", "identity(nothing)"] 1.50 (5%) ❌ 1.00 (1%)
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 0.92 (5%) ✅ 0.91 (1%) ✅
["JETAnalyzer{SoundPass}", "rand(Bool)"] 0.87 (5%) ✅ 0.93 (1%) ✅
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 0.72 (5%) ✅ 0.84 (1%) ✅
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 0.95 (5%) ✅ 0.97 (1%) ✅
["OptAnalyzer", "identity(nothing)"] 0.68 (5%) ✅ 1.00 (1%)
["OptAnalyzer", "println(QuoteNode(nothing))"] 0.82 (5%) ✅ 1.00 (1%)
["OptAnalyzer", "sum(\"julia\") (cached)"] 0.71 (5%) ✅ 0.97 (1%) ✅
["OptAnalyzer", "sum(\"julia\")"] 1.09 (5%) ❌ 1.00 (1%)
["show(::IO, ::JETCallResult)", "report_call"] 3.53 (5%) ❌ 2.63 (1%) ❌
["show(::IO, ::JETCallResult)", "report_opt"] 0.81 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
 speed user nice sys idle irq
 #1 2294 MHz 8179 s 0 s 357 s 4164 s 0 s
 #2 2294 MHz 3406 s 0 s 264 s 8983 s 0 s
 Memory: 6.781208038330078 GB (4695.35546875 MB free)
 Uptime: 1277.95 sec
 Load Avg: 1.0 1.02 0.86
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, broadwell)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
 speed user nice sys idle irq
 #1 2294 MHz 15596 s 0 s 443 s 5298 s 0 s
 #2 2294 MHz 4731 s 0 s 424 s 16112 s 0 s
 Memory: 6.781208038330078 GB (4679.73046875 MB free)
 Uptime: 2142.58 sec
 Load Avg: 1.0 1.02 1.0
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, broadwell)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 30 May 2023 - 11:2
  • Package commit: dc311d
  • Julia commit: ed5bd4
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 242.303 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 595.996 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 274.364 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 59.169 ms (5%) 2.17 MiB (1%) 38057
["JETAnalyzer{BasicPass} top-level", "self analysis"] 21.338 s (5%) 1.856 s 1.27 GiB (1%) 23558079
["JETAnalyzer{BasicPass} top-level", "simple"] 16.213 ms (5%) 2.08 MiB (1%) 35952
["JETAnalyzer{BasicPass}", "identity(nothing)"] 143.109 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 252.865 ms (5%) 37.63 MiB (1%) 703625
["JETAnalyzer{BasicPass}", "rand(Bool)"] 89.898 ms (5%) 14.64 MiB (1%) 266632
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 165.410 μs (5%) 14.91 KiB (1%) 204
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 10.776 ms (5%) 1.93 MiB (1%) 33675
["JETAnalyzer{SoundPass}", "identity(nothing)"] 118.607 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 357.309 ms (5%) 49.534 ms 54.16 MiB (1%) 784396
["JETAnalyzer{SoundPass}", "rand(Bool)"] 93.005 ms (5%) 17.03 MiB (1%) 284522
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 195.712 μs (5%) 18.81 KiB (1%) 241
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 12.035 ms (5%) 1.99 MiB (1%) 34844
["OptAnalyzer", "identity(nothing)"] 142.509 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 756.321 ms (5%) 80.802 ms 199.77 MiB (1%) 2951782
["OptAnalyzer", "rand(Bool)"] 51.184 ms (5%) 13.72 MiB (1%) 203674
["OptAnalyzer", "sum(\"julia\") (cached)"] 300.220 μs (5%) 58.16 KiB (1%) 801
["OptAnalyzer", "sum(\"julia\")"] 25.890 ms (5%) 5.84 MiB (1%) 87265
["show(::IO, ::JETCallResult)", "report_call"] 7.547 ms (5%) 724.26 KiB (1%) 6779
["show(::IO, ::JETCallResult)", "report_opt"] 23.601 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
 speed user nice sys idle irq
 #1 2294 MHz 8179 s 0 s 357 s 4164 s 0 s
 #2 2294 MHz 3406 s 0 s 264 s 8983 s 0 s
 Memory: 6.781208038330078 GB (4695.35546875 MB free)
 Uptime: 1277.95 sec
 Load Avg: 1.0 1.02 0.86
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, broadwell)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 30 May 2023 - 11:16
  • Package commit: 717a6d
  • Julia commit: ed5bd4
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 225.691 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 948.471 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 415.548 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 54.028 ms (5%) 2.18 MiB (1%) 38310
["JETAnalyzer{BasicPass} top-level", "self analysis"] 19.344 s (5%) 1.529 s 1.28 GiB (1%) 23667535
["JETAnalyzer{BasicPass} top-level", "simple"] 14.418 ms (5%) 2.11 MiB (1%) 36303
["JETAnalyzer{BasicPass}", "identity(nothing)"] 141.008 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 261.550 ms (5%) 37.71 MiB (1%) 705075
["JETAnalyzer{BasicPass}", "rand(Bool)"] 90.655 ms (5%) 14.60 MiB (1%) 267120
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 238.216 μs (5%) 17.27 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 11.352 ms (5%) 1.95 MiB (1%) 34016
["JETAnalyzer{SoundPass}", "identity(nothing)"] 79.305 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 390.315 ms (5%) 47.700 ms 59.37 MiB (1%) 843069
["JETAnalyzer{SoundPass}", "rand(Bool)"] 107.342 ms (5%) 18.31 MiB (1%) 301820
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 273.618 μs (5%) 22.27 KiB (1%) 264
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 12.705 ms (5%) 2.06 MiB (1%) 36025
["OptAnalyzer", "identity(nothing)"] 209.414 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 919.771 ms (5%) 96.985 ms 199.88 MiB (1%) 2953752
["OptAnalyzer", "rand(Bool)"] 50.202 ms (5%) 13.73 MiB (1%) 203810
["OptAnalyzer", "sum(\"julia\") (cached)"] 423.529 μs (5%) 59.92 KiB (1%) 824
["OptAnalyzer", "sum(\"julia\")"] 23.829 ms (5%) 5.85 MiB (1%) 87530
["show(::IO, ::JETCallResult)", "report_call"] 2.137 ms (5%) 275.25 KiB (1%) 5086
["show(::IO, ::JETCallResult)", "report_opt"] 29.302 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
 speed user nice sys idle irq
 #1 2294 MHz 15596 s 0 s 443 s 5298 s 0 s
 #2 2294 MHz 4731 s 0 s 424 s 16112 s 0 s
 Memory: 6.781208038330078 GB (4679.73046875 MB free)
 Uptime: 2142.58 sec
 Load Avg: 1.0 1.02 1.0
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, broadwell)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
CPU family: 6
Model: 79
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4589.64
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 512 KiB (2 instances)
L3 cache: 50 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Vendor :Intel
Architecture :Broadwell
Model Family: 0x06, Model: 0x4f, Stepping: 0x01, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 256, 51200) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 30 May 2023 - 11:15
  • Baseline: 30 May 2023 - 11:28
  • Package commits:
  • Target: 02f55d
  • Baseline: 717a6d
  • Julia commits:
  • Target: ed5bd4
  • Baseline: ed5bd4
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 0.92 (5%) ✅ 1.00 (1%)
["First-Time-To-JET", "sum(\"julia\")"] 0.86 (5%) ✅ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "simple"] 1.01 (5%) 0.99 (1%) ✅
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 1.05 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 0.86 (5%) ✅ 0.86 (1%) ✅
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 1.02 (5%) 0.99 (1%) ✅
["JETAnalyzer{SoundPass}", "identity(nothing)"] 0.94 (5%) ✅ 1.00 (1%)
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 0.91 (5%) ✅ 0.91 (1%) ✅
["JETAnalyzer{SoundPass}", "rand(Bool)"] 0.90 (5%) ✅ 0.93 (1%) ✅
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 0.85 (5%) ✅ 0.84 (1%) ✅
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 1.06 (5%) ❌ 0.97 (1%) ✅
["OptAnalyzer", "sum(\"julia\") (cached)"] 0.89 (5%) ✅ 0.97 (1%) ✅
["show(::IO, ::JETCallResult)", "report_call"] 4.17 (5%) ❌ 2.63 (1%) ❌
["show(::IO, ::JETCallResult)", "report_opt"] 1.11 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 7084 s 0 s 288 s 4215 s 0 s
 #2 2793 MHz 3019 s 0 s 221 s 8322 s 0 s
 Memory: 6.7812042236328125 GB (4447.55078125 MB free)
 Uptime: 1164.32 sec
 Load Avg: 1.0 1.02 0.79
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 9267 s 0 s 460 s 9749 s 0 s
 #2 2793 MHz 8875 s 0 s 289 s 10298 s 0 s
 Memory: 6.7812042236328125 GB (4482.0390625 MB free)
 Uptime: 1955.17 sec
 Load Avg: 1.0 1.01 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 30 May 2023 - 11:15
  • Package commit: 02f55d
  • Julia commit: ed5bd4
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 215.456 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 519.207 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 217.578 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 50.373 ms (5%) 2.17 MiB (1%) 38065
["JETAnalyzer{BasicPass} top-level", "self analysis"] 13.979 s (5%) 1.401 s 1.27 GiB (1%) 23549253
["JETAnalyzer{BasicPass} top-level", "simple"] 9.807 ms (5%) 2.08 MiB (1%) 35952
["JETAnalyzer{BasicPass}", "identity(nothing)"] 85.200 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 143.555 ms (5%) 37.63 MiB (1%) 703621
["JETAnalyzer{BasicPass}", "rand(Bool)"] 50.023 ms (5%) 14.64 MiB (1%) 266628
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 133.800 μs (5%) 14.91 KiB (1%) 204
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 6.344 ms (5%) 1.93 MiB (1%) 33675
["JETAnalyzer{SoundPass}", "identity(nothing)"] 82.200 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 209.001 ms (5%) 36.068 ms 54.19 MiB (1%) 784401
["JETAnalyzer{SoundPass}", "rand(Bool)"] 52.972 ms (5%) 17.03 MiB (1%) 284518
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 138.200 μs (5%) 18.81 KiB (1%) 241
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 6.907 ms (5%) 1.99 MiB (1%) 34844
["OptAnalyzer", "identity(nothing)"] 131.400 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 523.944 ms (5%) 62.679 ms 199.77 MiB (1%) 2951778
["OptAnalyzer", "rand(Bool)"] 28.479 ms (5%) 13.72 MiB (1%) 203670
["OptAnalyzer", "sum(\"julia\") (cached)"] 249.799 μs (5%) 58.16 KiB (1%) 801
["OptAnalyzer", "sum(\"julia\")"] 13.839 ms (5%) 5.84 MiB (1%) 87265
["show(::IO, ::JETCallResult)", "report_call"] 5.049 ms (5%) 724.26 KiB (1%) 6779
["show(::IO, ::JETCallResult)", "report_opt"] 20.600 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 7084 s 0 s 288 s 4215 s 0 s
 #2 2793 MHz 3019 s 0 s 221 s 8322 s 0 s
 Memory: 6.7812042236328125 GB (4447.55078125 MB free)
 Uptime: 1164.32 sec
 Load Avg: 1.0 1.02 0.79
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 30 May 2023 - 11:28
  • Package commit: 717a6d
  • Julia commit: ed5bd4
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 216.640 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 564.780 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 254.166 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 50.091 ms (5%) 2.18 MiB (1%) 38310
["JETAnalyzer{BasicPass} top-level", "self analysis"] 13.378 s (5%) 1.226 s 1.28 GiB (1%) 23658705
["JETAnalyzer{BasicPass} top-level", "simple"] 9.704 ms (5%) 2.11 MiB (1%) 36303
["JETAnalyzer{BasicPass}", "identity(nothing)"] 85.400 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 136.115 ms (5%) 37.71 MiB (1%) 705071
["JETAnalyzer{BasicPass}", "rand(Bool)"] 49.697 ms (5%) 14.60 MiB (1%) 267116
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 154.700 μs (5%) 17.27 KiB (1%) 227
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 6.215 ms (5%) 1.95 MiB (1%) 34016
["JETAnalyzer{SoundPass}", "identity(nothing)"] 87.100 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 229.806 ms (5%) 35.951 ms 59.37 MiB (1%) 843065
["JETAnalyzer{SoundPass}", "rand(Bool)"] 58.678 ms (5%) 18.30 MiB (1%) 301816
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 162.400 μs (5%) 22.27 KiB (1%) 264
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 6.529 ms (5%) 2.06 MiB (1%) 36024
["OptAnalyzer", "identity(nothing)"] 129.500 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 532.517 ms (5%) 64.559 ms 199.88 MiB (1%) 2953748
["OptAnalyzer", "rand(Bool)"] 28.118 ms (5%) 13.73 MiB (1%) 203806
["OptAnalyzer", "sum(\"julia\") (cached)"] 280.000 μs (5%) 59.92 KiB (1%) 824
["OptAnalyzer", "sum(\"julia\")"] 13.712 ms (5%) 5.85 MiB (1%) 87530
["show(::IO, ::JETCallResult)", "report_call"] 1.210 ms (5%) 275.25 KiB (1%) 5086
["show(::IO, ::JETCallResult)", "report_opt"] 18.600 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 9267 s 0 s 460 s 9749 s 0 s
 #2 2793 MHz 8875 s 0 s 289 s 10298 s 0 s
 Memory: 6.7812042236328125 GB (4482.0390625 MB free)
 Uptime: 1955.17 sec
 Load Avg: 1.0 1.01 0.95
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
CPU family: 6
Model: 106
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 6
BogoMIPS: 5586.87
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 96 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 2.5 MiB (2 instances)
L3 cache: 48 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Vendor :Intel
Architecture :UnknownIntel
Model Family: 0x06, Model: 0x6a, Stepping: 0x06, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (48, 1280, 49152) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 30 May 2023 - 14:04
  • Baseline: 30 May 2023 - 14:14
  • Package commits:
  • Target: d07eaa
  • Baseline: f5e299
  • Julia commits:
  • Target: ed5bd4
  • Baseline: ed5bd4
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 0.88 (5%) ✅ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "self analysis"] 1.16 (5%) ❌ 1.00 (1%)
["OptAnalyzer", "identity(nothing)"] 0.93 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 3933 s 0 s 177 s 6217 s 0 s
 #2 2593 MHz 6334 s 0 s 357 s 3655 s 0 s
 Memory: 6.7812042236328125 GB (4653.5234375 MB free)
 Uptime: 1041.56 sec
 Load Avg: 1.0 1.02 0.77
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 5314 s 0 s 316 s 10792 s 0 s
 #2 2593 MHz 11182 s 0 s 451 s 4821 s 0 s
 Memory: 6.7812042236328125 GB (4564.07421875 MB free)
 Uptime: 1652.98 sec
 Load Avg: 1.0 1.03 0.93
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 30 May 2023 - 14:4
  • Package commit: d07eaa
  • Julia commit: ed5bd4
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 248.742 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 545.147 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 219.195 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 51.072 ms (5%) 2.17 MiB (1%) 38065
["JETAnalyzer{BasicPass} top-level", "self analysis"] 17.779 s (5%) 1.583 s 1.27 GiB (1%) 23558248
["JETAnalyzer{BasicPass} top-level", "simple"] 9.991 ms (5%) 2.08 MiB (1%) 35952
["JETAnalyzer{BasicPass}", "identity(nothing)"] 104.801 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 164.513 ms (5%) 37.63 MiB (1%) 703623
["JETAnalyzer{BasicPass}", "rand(Bool)"] 54.699 ms (5%) 14.64 MiB (1%) 266630
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 170.302 μs (5%) 14.91 KiB (1%) 204
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 7.625 ms (5%) 1.93 MiB (1%) 33675
["JETAnalyzer{SoundPass}", "identity(nothing)"] 108.001 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 239.284 ms (5%) 44.425 ms 54.09 MiB (1%) 784370
["JETAnalyzer{SoundPass}", "rand(Bool)"] 59.625 ms (5%) 16.99 MiB (1%) 284505
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 181.802 μs (5%) 18.81 KiB (1%) 241
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 7.541 ms (5%) 1.99 MiB (1%) 34844
["OptAnalyzer", "identity(nothing)"] 159.302 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 607.027 ms (5%) 79.191 ms 199.77 MiB (1%) 2951780
["OptAnalyzer", "rand(Bool)"] 34.076 ms (5%) 13.72 MiB (1%) 203672
["OptAnalyzer", "sum(\"julia\") (cached)"] 316.304 μs (5%) 58.16 KiB (1%) 801
["OptAnalyzer", "sum(\"julia\")"] 15.899 ms (5%) 5.84 MiB (1%) 87265
["show(::IO, ::JETCallResult)", "report_call"] 5.746 ms (5%) 724.26 KiB (1%) 6779
["show(::IO, ::JETCallResult)", "report_opt"] 24.601 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 3933 s 0 s 177 s 6217 s 0 s
 #2 2593 MHz 6334 s 0 s 357 s 3655 s 0 s
 Memory: 6.7812042236328125 GB (4653.5234375 MB free)
 Uptime: 1041.56 sec
 Load Avg: 1.0 1.02 0.77
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 30 May 2023 - 14:14
  • Package commit: f5e299
  • Julia commit: ed5bd4
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 246.476 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 622.590 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 221.022 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 49.953 ms (5%) 2.17 MiB (1%) 38065
["JETAnalyzer{BasicPass} top-level", "self analysis"] 15.328 s (5%) 1.567 s 1.27 GiB (1%) 23549238
["JETAnalyzer{BasicPass} top-level", "simple"] 9.741 ms (5%) 2.08 MiB (1%) 35952
["JETAnalyzer{BasicPass}", "identity(nothing)"] 108.301 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 160.071 ms (5%) 37.63 MiB (1%) 703623
["JETAnalyzer{BasicPass}", "rand(Bool)"] 55.181 ms (5%) 14.64 MiB (1%) 266630
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 162.202 μs (5%) 14.91 KiB (1%) 204
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 7.701 ms (5%) 1.93 MiB (1%) 33675
["JETAnalyzer{SoundPass}", "identity(nothing)"] 104.401 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 236.412 ms (5%) 44.358 ms 54.09 MiB (1%) 784370
["JETAnalyzer{SoundPass}", "rand(Bool)"] 60.557 ms (5%) 16.99 MiB (1%) 284505
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 175.702 μs (5%) 18.81 KiB (1%) 241
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 7.498 ms (5%) 1.99 MiB (1%) 34844
["OptAnalyzer", "identity(nothing)"] 171.302 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 598.515 ms (5%) 77.305 ms 199.77 MiB (1%) 2951780
["OptAnalyzer", "rand(Bool)"] 34.080 ms (5%) 13.72 MiB (1%) 203672
["OptAnalyzer", "sum(\"julia\") (cached)"] 307.104 μs (5%) 58.16 KiB (1%) 801
["OptAnalyzer", "sum(\"julia\")"] 15.864 ms (5%) 5.84 MiB (1%) 87265
["show(::IO, ::JETCallResult)", "report_call"] 5.985 ms (5%) 724.26 KiB (1%) 6779
["show(::IO, ::JETCallResult)", "report_opt"] 25.600 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1397
Commit ed5bd4c9553 (2023-05-30 06:09 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: 
 speed user nice sys idle irq
 #1 2593 MHz 5314 s 0 s 316 s 10792 s 0 s
 #2 2593 MHz 11182 s 0 s 451 s 4821 s 0 s
 Memory: 6.7812042236328125 GB (4564.07421875 MB free)
 Uptime: 1652.98 sec
 Load Avg: 1.0 1.03 0.93
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, skylake-avx512)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
CPU family: 6
Model: 85
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 7
BogoMIPS: 5187.81
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 2 MiB (2 instances)
L3 cache: 35.8 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Vulnerable
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Vendor :Intel
Architecture :Skylake
Model Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 1024, 36608) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@aviatesk aviatesk force-pushed the avi/stacktrace branch 6 times, most recently from 5a73fa8 to 9a0cab7 Compare May 30, 2023 10:59
Since the stacktrace view shown by Julia Base upon exception is more
familiar to general users, it would be better to use the same view for
showing JET's abstract stacktrace.

Previously JET tries to "infer" the textual code representation of the
call-sites of each stack-frame, but now JET does not need to do so, and
JET can show the method signature of each abstract stack-frame from
their `MethodInstance` that is already available. Therefore, this commit
may result in some performance improvement.

Note that JET still computes the textual code representation with type
annotations for each error point. We may replace that part with
TypedSyntax.jl in the future since it would be more robust and nicer.

\## Examples: `@report_call sum([])`

> Before
```julia
═════ 1 possible error found ═════
┌ @ reducedim.jl:996 Base.:(var"#sum#821")(:, pairs(NamedTuple()), #self#, a)
│┌ @ reducedim.jl:996 Base._sum(a, dims)
││┌ @ reducedim.jl:1000 Base.:(var"#_sum#823")(pairs(NamedTuple()), #self#, a, _3)
│││┌ @ reducedim.jl:1000 Base._sum(identity, a, :)
││││┌ @ reducedim.jl:1001 Base.:(var"#_sum#824")(pairs(NamedTuple()), #self#, f, a, _4)
│││││┌ @ reducedim.jl:1001 mapreduce(f, Base.add_sum, a)
││││││┌ @ reducedim.jl:357 Base.:(var"#mapreduce#814")(:, Base._InitialValue(), #self#, f, op, A)
│││││││┌ @ reducedim.jl:357 Base._mapreduce_dim(f, op, init, A, dims)
││││││││┌ @ reducedim.jl:365 Base._mapreduce(f, op, IndexStyle(A), A)
│││││││││┌ @ reduce.jl:432 Base.mapreduce_empty_iter(f, op, A, Base.IteratorEltype(A))
││││││││││┌ @ reduce.jl:380 Base.reduce_empty_iter(Base.MappingRF(f, op), itr, ItrEltype)
│││││││││││┌ @ reduce.jl:384 Base.reduce_empty(op, eltype(itr))
││││││││││││┌ @ reduce.jl:361 Base.mapreduce_empty(op.f, op.rf, T)
│││││││││││││┌ @ reduce.jl:372 Base.reduce_empty(op, T)
││││││││││││││┌ @ reduce.jl:352 Base.reduce_empty(+, T)
│││││││││││││││┌ @ reduce.jl:343 zero(T)
││││││││││││││││┌ @ missing.jl:106 Base.throw(Base.MethodError(zero, tuple(Base.Any)))
│││││││││││││││││ MethodError: no method matching zero(::Type{Any}): Base.throw(Base.MethodError(zero, tuple(Base.Any)::Tuple{DataType})::MethodError)
││││││││││││││││└──────────────────
```
> After
```julia
═════ 1 possible error found ═════
┌ sum(a::Vector{Any}) @ Base ./reducedim.jl:996
│┌ sum(a::Vector{Any}; dims::Colon, kw::Base.@kwargs{}) @ Base ./reducedim.jl:996
││┌ _sum(a::Vector{Any}, ::Colon) @ Base ./reducedim.jl:1000
│││┌ _sum(a::Vector{Any}, ::Colon; kw::Base.@kwargs{}) @ Base ./reducedim.jl:1000
││││┌ _sum(f::typeof(identity), a::Vector{Any}, ::Colon) @ Base ./reducedim.jl:1001
│││││┌ _sum(f::typeof(identity), a::Vector{Any}, ::Colon; kw::Base.@kwargs{}) @ Base ./reducedim.jl:1001
││││││┌ mapreduce(f::typeof(identity), op::typeof(Base.add_sum), A::Vector{Any}) @ Base ./reducedim.jl:357
│││││││┌ mapreduce(f::typeof(identity), op::typeof(Base.add_sum), A::Vector{Any}; dims::Colon, init::Base._InitialValue) @ Base ./reducedim.jl:357
││││││││┌ _mapreduce_dim(f::typeof(identity), op::typeof(Base.add_sum), ::Base._InitialValue, A::Vector{Any}, ::Colon) @ Base ./reducedim.jl:365
│││││││││┌ _mapreduce(f::typeof(identity), op::typeof(Base.add_sum), ::IndexLinear, A::Vector{Any}) @ Base ./reduce.jl:432
││││││││││┌ mapreduce_empty_iter(f::typeof(identity), op::typeof(Base.add_sum), itr::Vector{Any}, ItrEltype::Base.HasEltype) @ Base ./reduce.jl:380
│││││││││││┌ reduce_empty_iter(op::Base.MappingRF{typeof(identity), typeof(Base.add_sum)}, itr::Vector{Any}, ::Base.HasEltype) @ Base ./reduce.jl:384
││││││││││││┌ reduce_empty(op::Base.MappingRF{typeof(identity), typeof(Base.add_sum)}, ::Type{Any}) @ Base ./reduce.jl:361
│││││││││││││┌ mapreduce_empty(::typeof(identity), op::typeof(Base.add_sum), T::Type{Any}) @ Base ./reduce.jl:372
││││││││││││││┌ reduce_empty(::typeof(Base.add_sum), ::Type{Any}) @ Base ./reduce.jl:352
│││││││││││││││┌ reduce_empty(::typeof(+), ::Type{Any}) @ Base ./reduce.jl:343
││││││││││││││││┌ zero(::Type{Any}) @ Base ./missing.jl:106
│││││││││││││││││ MethodError: no method matching zero(::Type{Any}): Base.throw(Base.MethodError(zero, tuple(Base.Any)::Tuple{DataType})::MethodError)
││││││││││││││││└────────────────────
```

\## Example 2
```julia
getprop(x) = x.nonexist;

report_call((Regex,)) do r
    getprop(r)
end
```

> Before
```julia
═════ 1 possible error found ═════
┌ @ REPL[30]:2 getprop(r)
│┌ @ REPL[29]:1 x.nonexist
││┌ @ Base.jl:37 Base.getfield(x, f)
│││ type Regex has no field nonexist
││└──────────────
```
> After
```julia
═════ 1 possible error found ═════
┌ (::var"#3#4")(r::Regex) @ Main ./REPL[12]:2
│┌ getprop(x::Regex) @ Main ./REPL[11]:1
││┌ getproperty(x::Regex, f::Symbol) @ Base ./Base.jl:37
│││ type Regex has no field nonexist: Base.getfield(x::Regex, f::Symbol)
││└────────────────────
```
@aviatesk aviatesk merged commit f5e2992 into master May 30, 2023
@aviatesk aviatesk deleted the avi/stacktrace branch May 30, 2023 13:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants