Add baseline benchmarks #4777

ggwpez · 2022-01-24T18:04:28Z

CI does currently not work because of a problem in Substrate, but should, once fixed.

Update the weights for pallet Balances to see that the production profile causes lower weights
Add the baseline benchmarks to Polkadot and Kusama

related paritytech/bench-bot#79 and paritytech/substrate#10692

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

ggwpez · 2022-01-24T18:06:52Z

/benchmark runtime polkadot pallet_balances

parity-benchapp · 2022-01-24T18:06:54Z

Benchmark Runtime Polkadot Pallet for branch "oty-test-bench-bot" with command cargo run --quiet --profile=production --features=runtime-benchmarks -- benchmark --chain=polkadot-dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/polkadot/src/weights/

Toolchain: stable-x86_64-unknown-linux-gnu (default)
rustc 1.57.0 (f1edd0429 2021-11-29)

Results

Pallet: "pallet_balances", Extrinsic: "transfer", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    30.35
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    30.35
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "transfer_keep_alive", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    23.39
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    23.39
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "set_balance_creating", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    15.19
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    15.19
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "set_balance_killing", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    17.27
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    17.27
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "force_transfer", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:2 w:2)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    30.72
              µs

Reads = 2
Writes = 2

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    30.72
              µs

Reads = 2
Writes = 2

Pallet: "pallet_balances", Extrinsic: "transfer_all", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    28.22
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    28.22
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "force_unreserve", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=     13.5
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=     13.5
              µs

Reads = 1
Writes = 1

…-- benchmark --chain=polkadot-dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/polkadot/src/weights/

ggwpez · 2022-01-24T19:55:18Z

/benchy runtime kusama pallet_balances

parity-benchapp · 2022-01-24T19:55:20Z

Benchmark Runtime Kusama Pallet for branch "oty-test-bench-bot" with command cargo run --quiet --profile=production --features=runtime-benchmarks -- benchmark --chain=kusama-dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/kusama/src/weights/

Toolchain: stable-x86_64-unknown-linux-gnu (default)
rustc 1.57.0 (f1edd0429 2021-11-29)

Results

Pallet: "pallet_balances", Extrinsic: "transfer", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    29.99
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    29.99
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "transfer_keep_alive", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    23.26
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    23.26
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "set_balance_creating", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    14.78
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    14.78
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "set_balance_killing", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    17.21
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    17.21
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "force_transfer", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:2 w:2)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    30.53
              µs

Reads = 2
Writes = 2

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    30.53
              µs

Reads = 2
Writes = 2

Pallet: "pallet_balances", Extrinsic: "transfer_all", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    27.93
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    27.93
              µs

Reads = 1
Writes = 1

Pallet: "pallet_balances", Extrinsic: "force_unreserve", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: System Account (r:1 w:1)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    13.64
              µs

Reads = 1
Writes = 1

Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    13.64
              µs

Reads = 1
Writes = 1

…-- benchmark --chain=kusama-dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/kusama/src/weights/

runtime/polkadot/src/lib.rs

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

This reverts commit d0fcc4f.

ggwpez · 2022-01-26T17:13:22Z

/benchthis runtime polkadot frame_benchmarking::baseline

ggwpez · 2022-01-26T17:14:45Z

/bench runtime kusama frame_benchmarking::baseline

ggwpez · 2022-01-27T16:57:55Z

/bench runtime kusama frame_benchmarking::baseline

joao-paulo-parity · 2022-01-28T18:15:34Z

/bench runtime kusama frame_benchmarking::baseline

parity-benchapp · 2022-01-28T18:27:07Z

Benchmark Runtime Kusama Pallet for branch "oty-test-bench-bot" with command cargo run --quiet --profile=production --features=runtime-benchmarks -- benchmark --chain=kusama-dev --steps=50 --repeat=20 --pallet=frame_benchmarking::baseline --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/kusama/src/weights/frame_benchmarking_baseline.rs

Toolchain: stable-x86_64-unknown-linux-gnu (default)
rustc 1.57.0 (f1edd0429 2021-11-29)

Results

Pallet: "frame_benchmarking::baseline", Extrinsic: "addition", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.128
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.127     0.004    3.1%
20000     0.131     0.003    2.2%
40000     0.136     0.004    2.9%
60000     0.135     0.004    2.9%
80000     0.127     0.003    2.3%
100000     0.131     0.007    5.3%
120000     0.107         0    0.0%
140000     0.128     0.002    1.5%
160000     0.127     0.002    1.5%
180000     0.112     0.004    3.5%
200000     0.127     0.003    2.3%
220000     0.128     0.002    1.5%
240000     0.122     0.007    5.7%
260000     0.123     0.005    4.0%
280000     0.133     0.007    5.2%
300000     0.134     0.004    2.9%
320000     0.135     0.006    4.4%
340000     0.133     0.004    3.0%
360000     0.134     0.005    3.7%
380000     0.132     0.004    3.0%
400000     0.132     0.003    2.2%
420000     0.122     0.003    2.4%
440000      0.13     0.004    3.0%
460000     0.123     0.002    1.6%
480000     0.133     0.003    2.2%
500000     0.134     0.004    2.9%
520000     0.123     0.007    5.6%
540000     0.135     0.002    1.4%
560000     0.132     0.003    2.2%
580000     0.124     0.002    1.6%
600000      0.14     0.003    2.1%
620000     0.135     0.004    2.9%
640000     0.138     0.003    2.1%
660000     0.129     0.003    2.3%
680000     0.117     0.004    3.4%
700000     0.123     0.002    1.6%
720000     0.115      0.01    8.6%
740000      0.13     0.004    3.0%
760000     0.132     0.003    2.2%
780000     0.127     0.002    1.5%
800000     0.133     0.004    3.0%
820000     0.134     0.004    2.9%
840000     0.124     0.005    4.0%
860000     0.132     0.004    3.0%
880000     0.125     0.007    5.6%
900000     0.122     0.005    4.0%
920000     0.132     0.003    2.2%
940000     0.128     0.003    2.3%
960000     0.125     0.001    0.8%
980000     0.128     0.005    3.9%
1000000     0.141     0.006    4.2%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.128
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "subtraction", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.128
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.137     0.005    3.6%
20000     0.128     0.003    2.3%
40000     0.139     0.005    3.5%
60000     0.128     0.004    3.1%
80000     0.124     0.004    3.2%
100000     0.137     0.001    0.7%
120000     0.139     0.003    2.1%
140000     0.137     0.003    2.1%
160000     0.114     0.005    4.3%
180000     0.128     0.001    0.7%
200000     0.132     0.003    2.2%
220000     0.128     0.006    4.6%
240000     0.131     0.001    0.7%
260000     0.129     0.002    1.5%
280000     0.125     0.003    2.4%
300000     0.127     0.008    6.2%
320000     0.129     0.004    3.1%
340000     0.137     0.003    2.1%
360000      0.13     0.004    3.0%
380000     0.101     0.001    0.9%
400000     0.124     0.002    1.6%
420000     0.127     0.004    3.1%
440000     0.125     0.009    7.2%
460000     0.122     0.007    5.7%
480000     0.131     0.003    2.2%
500000     0.131     0.004    3.0%
520000     0.122     0.002    1.6%
540000     0.136     0.007    5.1%
560000     0.143     0.005    3.4%
580000     0.125     0.004    3.2%
600000      0.13     0.003    2.3%
620000     0.132     0.004    3.0%
640000     0.119     0.003    2.5%
660000     0.127     0.002    1.5%
680000     0.127     0.002    1.5%
700000     0.136     0.005    3.6%
720000     0.139     0.002    1.4%
740000      0.13     0.003    2.3%
760000      0.13     0.003    2.3%
780000     0.126     0.003    2.3%
800000     0.142     0.005    3.5%
820000     0.138     0.004    2.8%
840000     0.134     0.005    3.7%
860000     0.137     0.003    2.1%
880000     0.131     0.002    1.5%
900000      0.14     0.004    2.8%
920000     0.131     0.003    2.2%
940000      0.14     0.002    1.4%
960000     0.135     0.007    5.1%
980000     0.132     0.003    2.2%
1000000     0.133     0.003    2.2%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.128
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "multiplication", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.134
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.133     0.002    1.5%
20000     0.138     0.004    2.8%
40000     0.134     0.001    0.7%
60000     0.137     0.003    2.1%
80000     0.132     0.004    3.0%
100000     0.137     0.002    1.4%
120000     0.137     0.002    1.4%
140000     0.132     0.003    2.2%
160000     0.132     0.001    0.7%
180000     0.129     0.001    0.7%
200000     0.133     0.001    0.7%
220000     0.134     0.005    3.7%
240000     0.141     0.004    2.8%
260000     0.135     0.005    3.7%
280000     0.136     0.006    4.4%
300000     0.136     0.002    1.4%
320000     0.135     0.004    2.9%
340000     0.139     0.001    0.7%
360000      0.14     0.004    2.8%
380000     0.122      0.01    8.1%
400000     0.127     0.004    3.1%
420000     0.134     0.005    3.7%
440000     0.138     0.003    2.1%
460000     0.126      0.01    7.9%
480000     0.129     0.003    2.3%
500000     0.119     0.012   10.0%
520000     0.133     0.004    3.0%
540000     0.139     0.004    2.8%
560000     0.137     0.004    2.9%
580000     0.135     0.005    3.7%
600000     0.133     0.002    1.5%
620000     0.112     0.003    2.6%
640000     0.134     0.002    1.4%
660000      0.14     0.003    2.1%
680000     0.135     0.002    1.4%
700000     0.114     0.003    2.6%
720000     0.129     0.001    0.7%
740000     0.131     0.004    3.0%
760000      0.13     0.006    4.6%
780000     0.141     0.004    2.8%
800000     0.144     0.004    2.7%
820000     0.134     0.003    2.2%
840000     0.127     0.011    8.6%
860000     0.138     0.002    1.4%
880000     0.136     0.001    0.7%
900000     0.141     0.004    2.8%
920000     0.137     0.005    3.6%
940000     0.138     0.003    2.1%
960000      0.14     0.006    4.2%
980000     0.149     0.004    2.6%
1000000     0.137     0.002    1.4%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.133
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "division", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.147
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.145     0.001    0.6%
20000     0.142      0.01    7.0%
40000     0.155     0.002    1.2%
60000     0.146     0.002    1.3%
80000     0.143     0.007    4.8%
100000     0.134     0.005    3.7%
120000     0.135     0.004    2.9%
140000     0.145     0.003    2.0%
160000     0.139     0.004    2.8%
180000     0.158     0.002    1.2%
200000     0.142     0.004    2.8%
220000     0.142     0.001    0.7%
240000     0.143     0.001    0.6%
260000     0.142     0.009    6.3%
280000     0.146     0.003    2.0%
300000     0.148     0.003    2.0%
320000     0.142     0.013    9.1%
340000     0.153     0.004    2.6%
360000     0.141     0.003    2.1%
380000     0.138     0.005    3.6%
400000     0.146     0.003    2.0%
420000      0.14     0.004    2.8%
440000     0.128     0.003    2.3%
460000     0.133     0.008    6.0%
480000     0.138     0.013    9.4%
500000     0.146     0.003    2.0%
520000     0.143     0.005    3.4%
540000     0.143     0.004    2.7%
560000     0.142     0.002    1.4%
580000     0.139     0.005    3.5%
600000     0.145     0.002    1.3%
620000     0.132     0.003    2.2%
640000     0.147     0.001    0.6%
660000     0.142     0.007    4.9%
680000     0.132     0.005    3.7%
700000     0.127     0.009    7.0%
720000     0.142     0.002    1.4%
740000     0.145     0.002    1.3%
760000     0.135     0.007    5.1%
780000     0.136     0.004    2.9%
800000     0.137     0.003    2.1%
820000     0.136      0.01    7.3%
840000     0.113     0.003    2.6%
860000      0.11     0.002    1.8%
880000      0.15     0.003    2.0%
900000     0.122     0.007    5.7%
920000     0.111     0.003    2.7%
940000     0.142     0.002    1.4%
960000      0.14     0.003    2.1%
980000     0.136     0.005    3.6%
1000000      0.14     0.003    2.1%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.147
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "hashing", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    19700
    + i    0.224
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     19690      26.1    0.1%
    2     19710     23.31    0.1%
    4     19720     25.39    0.1%
    6     19680     53.84    0.2%
    8     19690     21.56    0.1%
   10     19700      21.4    0.1%
   12     19720     43.01    0.2%
   14     19700     44.16    0.2%
   16     19720     43.69    0.2%
   18     19710     49.47    0.2%
   20     19700     28.24    0.1%
   22     19740     33.07    0.1%
   24     19720     21.79    0.1%
   26     19680     39.65    0.2%
   28     19690        43    0.2%
   30     19700      45.5    0.2%
   32     19720     29.04    0.1%
   34     19720     43.67    0.2%
   36     19710     68.82    0.3%
   38     19700     39.62    0.2%
   40     19720     31.33    0.1%
   42     19710     27.27    0.1%
   44     19740      43.7    0.2%
   46     19720     42.17    0.2%
   48     19720     21.83    0.1%
   50     19700     15.86    0.0%
   52     19700     28.52    0.1%
   54     19700      22.1    0.1%
   56     19730     30.48    0.1%
   58     19990       304    1.5%
   60     19690     20.21    0.1%
   62     19790     94.89    0.4%
   64     19920     108.6    0.5%
   66     19720     21.68    0.1%
   68     19700     21.49    0.1%
   70     19720     32.33    0.1%
   72     19690     20.78    0.1%
   74     19690     20.16    0.1%
   76     19720     44.77    0.2%
   78     19730     29.51    0.1%
   80     19740     43.06    0.2%
   82     19720     40.29    0.2%
   84     19720     15.49    0.0%
   86     19720     29.76    0.1%
   88     19720     44.91    0.2%
   90     19700     40.45    0.2%
   92     19720     55.64    0.2%
   94     19790     35.05    0.1%
   96     19710     24.45    0.1%
   98     19700     33.97    0.1%
  100     19700      40.9    0.2%

Quality and confidence:
param     error
i         0.116

Model:
Time ~=    19710
    + i     0.32
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "sr25519_verification", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    1.018
    + i    47.43
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    1     48.42     0.188    0.3%
    2     95.77     0.297    0.3%
    3     143.2     0.195    0.1%
    4     190.7     0.569    0.2%
    5     237.5     0.258    0.1%
    6     284.9     0.518    0.1%
    7     331.7     0.488    0.1%
    8     379.2     0.682    0.1%
    9     426.6     0.593    0.1%
   10     473.9      0.38    0.0%
   11     521.5     0.695    0.1%
   12     567.9     0.532    0.0%
   13     615.3     0.475    0.0%
   14     663.7     1.681    0.2%
   15     710.6     1.528    0.2%
   16     757.2     0.757    0.0%
   17       809     7.344    0.9%
   18     861.1      8.35    0.9%
   19       899     0.708    0.0%
   20       947     1.928    0.2%
   21      1011     12.58    1.2%
   22      1042     1.254    0.1%
   23      1093     10.09    0.9%
   24      1138     7.808    0.6%
   25      1195      11.8    0.9%
   26      1237     11.15    0.9%
   27      1282     11.71    0.9%
   28      1333     11.71    0.8%
   29      1372     1.248    0.0%
   30      1428        10    0.7%
   31      1477      12.1    0.8%
   32      1527     13.01    0.8%
   33      1563     7.893    0.5%
   34      1612     9.905    0.6%
   35      1664     13.16    0.7%
   36      1702     1.749    0.1%
   37      1757     12.24    0.6%
   38      1796     0.847    0.0%
   39      1861     14.02    0.7%
   40      1897     9.968    0.5%
   41      1945        12    0.6%
   42      2003     15.04    0.7%
   43      2040     12.95    0.6%
   44      2094     12.71    0.6%
   45      2139     12.78    0.5%
   46      2182     11.57    0.5%
   47      2238     15.16    0.6%
   48      2299     6.184    0.2%
   49      2326     13.03    0.5%
   50      2373     13.19    0.5%
   51      2414     8.247    0.3%
   52      2478     13.85    0.5%
   53      2515     14.37    0.5%
   54      2560     12.95    0.5%
   55      2609     12.24    0.4%
   56      2649     8.177    0.3%
   57      2715     12.07    0.4%
   58      2763     10.48    0.3%
   59      2809     13.41    0.4%
   60      2859     20.36    0.7%
   61      2901     16.45    0.5%
   62      2940     13.59    0.4%
   63      3007     9.492    0.3%
   64      3058     9.776    0.3%
   65      3086     14.92    0.4%
   66      3134     12.84    0.4%
   67      3182     13.16    0.4%
   68      3236     12.02    0.3%
   69      3285     13.63    0.4%
   70      3335     14.94    0.4%
   71      3384      16.9    0.4%
   72      3415     12.87    0.3%
   73      3470     11.62    0.3%
   74      3519     9.233    0.2%
   75      3565     22.02    0.6%
   76      3610     15.91    0.4%
   77      3652     13.14    0.3%
   78      3711     3.613    0.0%
   79      3776     14.19    0.3%
   80      3821        14    0.3%
   81      3867     18.34    0.4%
   82      3905      13.3    0.3%
   83      3944     11.96    0.3%
   84      3993     12.63    0.3%
   85      4040     14.45    0.3%
   86      4099      18.9    0.4%
   87      4147      12.3    0.2%
   88      4200     13.34    0.3%
   89      4237     14.61    0.3%
   90      4281     19.21    0.4%
   91      4328     10.74    0.2%
   92      4376      5.19    0.1%
   93      4416     17.33    0.3%
   94      4474      19.7    0.4%
   95      4517      4.85    0.1%
   96      4574     16.06    0.3%
   97      4602      16.9    0.3%
   98      4686     16.61    0.3%
   99      4719     14.17    0.3%
  100      4759     11.79    0.2%

Quality and confidence:
param     error
i         0.014

Model:
Time ~=        0
    + i    47.62
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "storage_read", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: Skipped Metadata (r:0 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    2.014
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.126     0.009    7.1%
   20     33.25     0.131    0.3%
   40      64.7     0.197    0.3%
   60      96.3     0.445    0.4%
   80     129.2     0.776    0.6%
  100     163.3     1.448    0.8%
  120     201.4     1.504    0.7%
  140     237.3     1.132    0.4%
  160     272.1     1.074    0.3%
  180     309.7     1.028    0.3%
  200     340.6     2.494    0.7%
  220     384.6     0.986    0.2%
  240     438.6     8.319    1.8%
  260     468.3     2.068    0.4%
  280     515.7     5.622    1.0%
  300     551.6     2.768    0.5%
  320       597     6.571    1.1%
  340     628.1     8.009    1.2%
  360     675.1     12.24    1.8%
  380     705.3      3.73    0.5%
  400     739.3     3.526    0.4%
  420     778.3     10.01    1.2%
  440     819.7     3.227    0.3%
  460     887.3      11.7    1.3%
  480     889.2     3.826    0.4%
  500     961.2     12.35    1.2%
  520     993.2     6.245    0.6%
  540      1037      11.8    1.1%
  560      1072     5.772    0.5%
  580      1100     9.338    0.8%
  600      1146     3.567    0.3%
  620      1200     13.78    1.1%
  640      1246     10.26    0.8%
  660      1292     9.428    0.7%
  680      1339      10.7    0.7%
  700      1361     10.15    0.7%
  720      1400     13.14    0.9%
  740      1454     12.59    0.8%
  760      1477     5.191    0.3%
  780      1521     9.816    0.6%
  800      1543     6.791    0.4%
  820      1604      8.12    0.5%
  840      1648     8.174    0.4%
  860      1701      6.53    0.3%
  880      1729     15.59    0.9%
  900      1803      11.4    0.6%
  920      1820     11.09    0.6%
  940      1892     7.701    0.4%
  960      1949     15.82    0.8%
  980      1975     16.58    0.8%
 1000      2003     8.639    0.4%

Quality and confidence:
param     error
i         0.003

Model:
Time ~=        0
    + i    2.027
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "storage_write", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: Skipped Metadata (r:0 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    0.323
              µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.118     0.005    4.2%
   20      4.74     0.062    1.3%
   40     9.831     0.051    0.5%
   60     14.75     0.049    0.3%
   80     19.57     0.077    0.3%
  100     24.66     0.059    0.2%
  120     31.88      0.14    0.4%
  140     37.31     0.104    0.2%
  160     42.23     0.478    1.1%
  180     47.68     0.088    0.1%
  200     52.99     0.156    0.2%
  220     59.21     0.191    0.3%
  240     64.29     0.209    0.3%
  260     69.99      0.22    0.3%
  280     76.96     0.677    0.8%
  300     82.05     0.356    0.4%
  320     87.64     0.202    0.2%
  340     93.43     0.285    0.3%
  360       101     0.436    0.4%
  380     105.4     0.498    0.4%
  400     113.9     1.068    0.9%
  420     119.1     0.711    0.5%
  440     124.7     0.739    0.5%
  460     131.4     1.563    1.1%
  480     140.8     2.137    1.5%
  500     144.3     1.124    0.7%
  520     150.8     0.946    0.6%
  540     160.5     1.409    0.8%
  560     164.5      0.86    0.5%
  580     173.3      2.96    1.7%
  600     178.8     1.758    0.9%
  620     186.3     3.223    1.7%
  640     204.6     0.906    0.4%
  660     202.8     2.744    1.3%
  680     209.6     2.891    1.3%
  700     219.3      2.41    1.0%
  720       224     3.642    1.6%
  740       229     3.174    1.3%
  760     236.6     4.391    1.8%
  780     243.9     5.021    2.0%
  800     257.6     0.718    0.2%
  820     256.3      6.57    2.5%
  840     264.2     6.029    2.2%
  860     273.4      3.23    1.1%
  880     282.2     4.062    1.4%
  900     289.3     3.762    1.3%
  920     294.1     3.735    1.2%
  940     300.2     3.463    1.1%
  960     308.9     3.076    0.9%
  980     318.1     7.928    2.4%
 1000     325.8     0.647    0.1%

Quality and confidence:
param     error
i             0

Model:
Time ~=        0
    + i    0.329
              µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)

…oty-test-bench-bot

…-- benchmark --chain=kusama-dev --steps=50 --repeat=20 --pallet=frame_benchmarking::baseline --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/kusama/src/weights/frame_benchmarking_baseline.rs

ggwpez · 2022-01-29T12:39:23Z

/benchthis runtime polkadot frame_benchmarking::baseline

parity-benchapp · 2022-01-29T12:39:24Z

Benchmark Runtime Polkadot Pallet for branch "oty-test-bench-bot" with command cargo run --quiet --profile=production --features=runtime-benchmarks -- benchmark --chain=polkadot-dev --steps=50 --repeat=20 --pallet=frame_benchmarking::baseline --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/polkadot/src/weights/frame_benchmarking_baseline.rs

Toolchain: stable-x86_64-unknown-linux-gnu (default)
rustc 1.57.0 (f1edd0429 2021-11-29)

Results

Pallet: "frame_benchmarking::baseline", Extrinsic: "addition", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.112
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.106     0.004    3.7%
20000     0.108     0.002    1.8%
40000     0.105     0.004    3.8%
60000     0.117     0.003    2.5%
80000     0.113     0.002    1.7%
100000     0.113     0.002    1.7%
120000     0.108     0.004    3.7%
140000     0.107     0.002    1.8%
160000     0.117     0.002    1.7%
180000     0.106     0.003    2.8%
200000     0.118     0.004    3.3%
220000      0.11     0.002    1.8%
240000     0.115     0.002    1.7%
260000     0.116     0.003    2.5%
280000      0.12     0.002    1.6%
300000     0.107     0.003    2.8%
320000     0.116     0.003    2.5%
340000     0.111     0.001    0.9%
360000     0.111     0.005    4.5%
380000     0.112     0.005    4.4%
400000     0.118     0.004    3.3%
420000     0.115     0.001    0.8%
440000     0.107     0.004    3.7%
460000      0.11     0.005    4.5%
480000      0.12     0.003    2.5%
500000     0.115     0.002    1.7%
520000     0.116     0.001    0.8%
540000     0.113     0.005    4.4%
560000     0.105     0.003    2.8%
580000     0.112     0.004    3.5%
600000     0.118     0.004    3.3%
620000     0.113     0.003    2.6%
640000     0.111     0.007    6.3%
660000     0.109     0.004    3.6%
680000     0.112     0.001    0.8%
700000     0.113     0.006    5.3%
720000     0.113     0.003    2.6%
740000     0.113     0.005    4.4%
760000     0.117     0.005    4.2%
780000     0.115     0.003    2.6%
800000     0.116     0.002    1.7%
820000     0.113     0.003    2.6%
840000     0.111     0.004    3.6%
860000     0.114     0.002    1.7%
880000     0.111     0.003    2.7%
900000     0.113     0.002    1.7%
920000     0.109     0.004    3.6%
940000     0.109     0.004    3.6%
960000     0.112     0.003    2.6%
980000     0.114     0.001    0.8%
1000000      0.11     0.002    1.8%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.112
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "subtraction", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.112
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.109     0.004    3.6%
20000     0.108     0.003    2.7%
40000     0.118     0.001    0.8%
60000     0.119     0.002    1.6%
80000     0.112     0.003    2.6%
100000     0.115     0.004    3.4%
120000     0.111     0.004    3.6%
140000     0.109     0.006    5.5%
160000     0.109     0.003    2.7%
180000     0.106     0.001    0.9%
200000     0.115     0.004    3.4%
220000     0.109     0.004    3.6%
240000     0.104     0.002    1.9%
260000     0.109     0.004    3.6%
280000     0.112     0.002    1.7%
300000     0.112     0.004    3.5%
320000     0.115     0.001    0.8%
340000     0.107     0.002    1.8%
360000      0.11     0.003    2.7%
380000      0.11     0.002    1.8%
400000     0.114     0.003    2.6%
420000     0.117     0.003    2.5%
440000     0.113     0.003    2.6%
460000     0.116     0.004    3.4%
480000     0.117     0.003    2.5%
500000      0.11     0.004    3.6%
520000     0.111     0.003    2.7%
540000     0.112     0.002    1.7%
560000     0.112     0.003    2.6%
580000     0.112     0.003    2.6%
600000     0.118     0.004    3.3%
620000     0.108     0.001    0.9%
640000     0.112     0.006    5.3%
660000      0.11     0.003    2.7%
680000     0.106     0.003    2.8%
700000     0.111     0.003    2.7%
720000     0.114     0.003    2.6%
740000     0.117     0.003    2.5%
760000     0.112     0.005    4.4%
780000     0.111     0.005    4.5%
800000      0.11     0.003    2.7%
820000      0.11     0.003    2.7%
840000      0.12     0.005    4.1%
860000     0.114     0.002    1.7%
880000     0.112     0.003    2.6%
900000     0.109     0.003    2.7%
920000     0.107     0.002    1.8%
940000     0.117     0.003    2.5%
960000      0.11     0.003    2.7%
980000     0.116     0.001    0.8%
1000000     0.111     0.005    4.5%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.112
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "multiplication", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.112
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.116     0.006    5.1%
20000     0.107     0.003    2.8%
40000     0.111     0.003    2.7%
60000     0.105     0.002    1.9%
80000     0.116     0.001    0.8%
100000     0.116     0.003    2.5%
120000     0.112     0.003    2.6%
140000     0.108     0.002    1.8%
160000     0.112     0.005    4.4%
180000     0.107     0.003    2.8%
200000     0.111     0.003    2.7%
220000     0.116     0.002    1.7%
240000     0.116     0.002    1.7%
260000     0.112     0.006    5.3%
280000     0.114     0.004    3.5%
300000     0.112     0.003    2.6%
320000     0.117     0.004    3.4%
340000      0.11     0.002    1.8%
360000     0.112     0.006    5.3%
380000     0.108     0.003    2.7%
400000     0.107     0.003    2.8%
420000     0.114     0.003    2.6%
440000     0.117     0.004    3.4%
460000     0.112     0.004    3.5%
480000     0.107     0.004    3.7%
500000     0.111     0.004    3.6%
520000     0.107     0.003    2.8%
540000      0.11     0.004    3.6%
560000      0.11     0.001    0.9%
580000     0.121     0.005    4.1%
600000      0.11     0.003    2.7%
620000     0.106     0.001    0.9%
640000     0.109     0.003    2.7%
660000     0.117     0.003    2.5%
680000     0.107     0.006    5.6%
700000     0.111     0.004    3.6%
720000     0.109     0.002    1.8%
740000     0.114     0.006    5.2%
760000     0.111     0.003    2.7%
780000     0.107     0.003    2.8%
800000     0.114     0.004    3.5%
820000     0.107     0.003    2.8%
840000     0.118     0.004    3.3%
860000     0.107     0.002    1.8%
880000     0.116     0.003    2.5%
900000      0.11     0.003    2.7%
920000     0.109     0.004    3.6%
940000     0.116     0.003    2.5%
960000     0.109     0.005    4.5%
980000     0.113     0.004    3.5%
1000000      0.11     0.007    6.3%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.112
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "division", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.111
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.112     0.003    2.6%
20000     0.116     0.003    2.5%
40000     0.108     0.003    2.7%
60000     0.117     0.005    4.2%
80000     0.109     0.003    2.7%
100000     0.105     0.003    2.8%
120000     0.109     0.004    3.6%
140000      0.11     0.003    2.7%
160000     0.115     0.003    2.6%
180000     0.113     0.002    1.7%
200000     0.105     0.004    3.8%
220000     0.111     0.003    2.7%
240000     0.106     0.004    3.7%
260000      0.11     0.003    2.7%
280000     0.106     0.002    1.8%
300000     0.113     0.004    3.5%
320000     0.116     0.002    1.7%
340000      0.11     0.003    2.7%
360000     0.116     0.003    2.5%
380000     0.119     0.004    3.3%
400000     0.107     0.002    1.8%
420000     0.113     0.005    4.4%
440000      0.11     0.002    1.8%
460000     0.107     0.003    2.8%
480000     0.107     0.003    2.8%
500000     0.111     0.004    3.6%
520000      0.11     0.002    1.8%
540000     0.112     0.003    2.6%
560000     0.111     0.003    2.7%
580000     0.109     0.004    3.6%
600000     0.109     0.004    3.6%
620000     0.106     0.004    3.7%
640000     0.112     0.005    4.4%
660000     0.118     0.003    2.5%
680000     0.106     0.002    1.8%
700000     0.113     0.006    5.3%
720000     0.118     0.004    3.3%
740000     0.112     0.004    3.5%
760000     0.108     0.004    3.7%
780000     0.106     0.003    2.8%
800000     0.105     0.002    1.9%
820000     0.113     0.008    7.0%
840000     0.114     0.002    1.7%
860000     0.111     0.004    3.6%
880000     0.107     0.003    2.8%
900000     0.118     0.003    2.5%
920000     0.114     0.004    3.5%
940000     0.112     0.003    2.6%
960000     0.118     0.003    2.5%
980000     0.107     0.003    2.8%
1000000     0.113     0.002    1.7%

Quality and confidence:
param     error
i             0

Model:
Time ~=    0.111
    + i        0
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "hashing", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    19610
    + i    0.135
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     19590     35.59    0.1%
    2     19580     34.83    0.1%
    4     19580     13.05    0.0%
    6     19610     31.17    0.1%
    8     19610     40.93    0.2%
   10     19640     54.65    0.2%
   12     19610     40.94    0.2%
   14     19600     31.33    0.1%
   16     19600     22.92    0.1%
   18     19600     34.42    0.1%
   20     19590     21.52    0.1%
   22     19630      34.1    0.1%
   24     19610     29.21    0.1%
   26     19590     15.44    0.0%
   28     19590     31.97    0.1%
   30     19610     22.77    0.1%
   32     19630     33.19    0.1%
   34     19650     34.49    0.1%
   36     19660     43.98    0.2%
   38     19590     19.29    0.0%
   40     19610     19.72    0.1%
   42     19630     31.87    0.1%
   44     19650      42.3    0.2%
   46     19650     70.88    0.3%
   48     19650     35.68    0.1%
   50     19590     37.15    0.1%
   52     19590     9.478    0.0%
   54     19600     37.95    0.1%
   56     19600     30.05    0.1%
   58     19570     33.87    0.1%
   60     19710     139.7    0.7%
   62     19590     42.64    0.2%
   64     19630     57.84    0.2%
   66     19820     108.9    0.5%
   68     19620     10.94    0.0%
   70     19590     33.34    0.1%
   72     19610     18.88    0.0%
   74     19610      40.4    0.2%
   76     19610     62.02    0.3%
   78     19600     54.39    0.2%
   80     19620     52.53    0.2%
   82     19610     32.56    0.1%
   84     19670     27.72    0.1%
   86     19640     55.08    0.2%
   88     19640     27.22    0.1%
   90     19580     37.89    0.1%
   92     19600     40.28    0.2%
   94     19610     37.26    0.1%
   96     19610     38.65    0.1%
   98     19630     42.23    0.2%
  100     19600     34.44    0.1%

Quality and confidence:
param     error
i         0.088

Model:
Time ~=    19610
    + i    0.203
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "sr25519_verification", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    0.897
    + i    47.34
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    1     48.17     0.135    0.2%
    2     95.57     0.279    0.2%
    3     142.7     0.418    0.2%
    4     189.6     0.362    0.1%
    5     237.1     0.331    0.1%
    6     283.7     0.277    0.0%
    7     331.3      0.65    0.1%
    8     378.6     0.327    0.0%
    9     425.2     0.421    0.0%
   10     473.2      0.81    0.1%
   11     520.4     1.081    0.2%
   12     567.5     1.247    0.2%
   13     614.9     1.112    0.1%
   14     665.9      8.16    1.2%
   15     709.2     0.993    0.1%
   16       757     1.325    0.1%
   17       804     1.874    0.2%
   18     853.2     6.518    0.7%
   19     897.5     0.842    0.0%
   20     946.3     1.267    0.1%
   21      1004     10.03    0.9%
   22      1039     1.575    0.1%
   23      1085      1.04    0.0%
   24      1136     8.133    0.7%
   25      1181     4.701    0.3%
   26      1228     0.782    0.0%
   27      1279     10.38    0.8%
   28      1320     0.948    0.0%
   29      1378     13.53    0.9%
   30      1417     4.176    0.2%
   31      1472     14.91    1.0%
   32      1522     14.36    0.9%
   33      1558     1.639    0.1%
   34      1611     10.52    0.6%
   35      1665     12.25    0.7%
   36      1699     1.342    0.0%
   37      1755     12.34    0.7%
   38      1813     11.85    0.6%
   39      1865     7.645    0.4%
   40      1899     12.88    0.6%
   41      1940     11.63    0.5%
   42      1983     7.649    0.3%
   43      2064     9.306    0.4%
   44      2102     8.744    0.4%
   45      2134     12.07    0.5%
   46      2177     10.06    0.4%
   47      2224     10.84    0.4%
   48      2275     12.04    0.5%
   49      2329     12.78    0.5%
   50      2376     12.85    0.5%
   51      2426     11.81    0.4%
   52      2469     14.23    0.5%
   53      2506        11    0.4%
   54      2564     14.56    0.5%
   55      2599      9.44    0.3%
   56      2660      17.8    0.6%
   57      2706     12.32    0.4%
   58      2753     19.42    0.7%
   59      2800     15.11    0.5%
   60      2861     6.878    0.2%
   61      2893     15.94    0.5%
   62      2947      11.8    0.4%
   63      2997     12.79    0.4%
   64      3043     13.85    0.4%
   65      3090     7.151    0.2%
   66      3128     15.48    0.4%
   67      3194     16.83    0.5%
   68      3224      14.7    0.4%
   69      3270      14.7    0.4%
   70      3333     9.488    0.2%
   71      3380     14.19    0.4%
   72      3436     12.56    0.3%
   73      3466     11.13    0.3%
   74      3512     18.12    0.5%
   75      3575     12.15    0.3%
   76      3646        11    0.3%
   77      3682     11.52    0.3%
   78      3710     8.417    0.2%
   79      3749     10.27    0.2%
   80      3803     2.328    0.0%
   81      3838     12.95    0.3%
   82      3895     17.54    0.4%
   83      3938     10.31    0.2%
   84      3993     12.73    0.3%
   85      4031     21.24    0.5%
   86      4096     9.475    0.2%
   87      4141     27.32    0.6%
   88      4186     20.02    0.4%
   89      4216     20.61    0.4%
   90      4284     9.261    0.2%
   91      4319     9.357    0.2%
   92      4370     17.74    0.4%
   93      4414      18.9    0.4%
   94      4445     16.48    0.3%
   95      4510     18.38    0.4%
   96      4552      13.2    0.2%
   97      4615     20.12    0.4%
   98      4656     10.62    0.2%
   99      4706     10.34    0.2%
  100      4752     18.71    0.3%

Quality and confidence:
param     error
i         0.015

Model:
Time ~=        0
    + i    47.55
              µs

Reads = 0 + (0 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "storage_read", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: Skipped Metadata (r:0 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i     1.96
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.116     0.008    6.8%
   20     32.54     0.379    1.1%
   40      61.2     0.222    0.3%
   60     94.54     0.352    0.3%
   80     123.2     0.801    0.6%
  100     157.7     0.895    0.5%
  120     194.3     0.654    0.3%
  140     226.7     0.943    0.4%
  160     266.5     2.119    0.7%
  180     298.1     1.694    0.5%
  200     333.6     1.161    0.3%
  220     367.4     2.493    0.6%
  240     411.1     2.357    0.5%
  260     447.7     1.898    0.4%
  280     486.2     2.642    0.5%
  300     525.6      2.85    0.5%
  320     567.2      2.08    0.3%
  340     606.9     4.797    0.7%
  360       645     9.438    1.4%
  380     674.9     10.75    1.5%
  400     715.4     9.848    1.3%
  420     742.7     2.125    0.2%
  440     783.3      10.5    1.3%
  460     836.1     4.943    0.5%
  480     880.2     8.938    1.0%
  500     918.3     6.386    0.6%
  520     967.2     11.34    1.1%
  540       985     5.685    0.5%
  560      1043     13.46    1.2%
  580      1079     8.491    0.7%
  600      1102     6.001    0.5%
  620      1159      11.9    1.0%
  640      1200     9.643    0.8%
  660      1232     6.511    0.5%
  680      1272     13.76    1.0%
  700      1346      4.11    0.3%
  720      1342     5.962    0.4%
  740      1387     10.06    0.7%
  760      1457     8.497    0.5%
  780      1482     14.35    0.9%
  800      1500     8.153    0.5%
  820      1548     6.564    0.4%
  840      1600      14.1    0.8%
  860      1639      8.66    0.5%
  880      1711     11.95    0.6%
  900      1745     10.27    0.5%
  920      1775     7.676    0.4%
  940      1838      12.3    0.6%
  960      1872     15.82    0.8%
  980      1918     12.34    0.6%
 1000      1967     9.369    0.4%

Quality and confidence:
param     error
i         0.003

Model:
Time ~=        0
    + i    1.973
              µs

Reads = 0 + (1 * i)
Writes = 0 + (0 * i)

Pallet: "frame_benchmarking::baseline", Extrinsic: "storage_write", Lowest values: [], Highest values: [], Steps: 50, Repeat: 20
Raw Storage Info
========
Storage: Skipped Metadata (r:0 w:0)

Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + i    0.318
              µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)

Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    i   mean µs  sigma µs       %
    0     0.117     0.003    2.5%
   20     4.685     0.022    0.4%
   40     9.709     0.082    0.8%
   60     14.51     0.077    0.5%
   80     19.24     0.054    0.2%
  100     24.31     0.094    0.3%
  120     30.04     0.262    0.8%
  140        36     0.124    0.3%
  160     41.61     0.192    0.4%
  180     47.93      0.53    1.1%
  200      52.8     0.209    0.3%
  220     58.68     0.378    0.6%
  240     63.92     0.083    0.1%
  260     69.43     0.255    0.3%
  280     75.37     0.476    0.6%
  300     80.71     0.479    0.5%
  320     86.51     0.519    0.5%
  340     93.05     0.548    0.5%
  360     98.38     0.663    0.6%
  380     105.2     0.746    0.7%
  400     111.5     0.748    0.6%
  420     117.2     0.587    0.5%
  440       125     1.171    0.9%
  460     129.1     0.571    0.4%
  480       142     1.007    0.7%
  500     143.8     0.954    0.6%
  520     148.9     0.431    0.2%
  540       157     0.336    0.2%
  560       162     0.872    0.5%
  580     168.7     1.987    1.1%
  600     179.2     3.215    1.7%
  620     182.8     1.537    0.8%
  640     195.7      4.49    2.2%
  660     195.5     2.804    1.4%
  680     205.6     2.653    1.2%
  700     217.2     2.101    0.9%
  720     220.1     2.602    1.1%
  740     228.6     2.714    1.1%
  760     236.2     3.129    1.3%
  780     243.2     2.478    1.0%
  800     246.9     5.352    2.1%
  820     258.7      0.83    0.3%
  840     258.4     4.347    1.6%
  860     266.4     3.063    1.1%
  880     274.9     5.019    1.8%
  900       283     4.178    1.4%
  920     290.4     4.221    1.4%
  940     295.1     3.779    1.2%
  960     304.9     2.174    0.7%
  980     310.9     2.195    0.7%
 1000     322.4     0.752    0.2%

Quality and confidence:
param     error
i             0

Model:
Time ~=        0
    + i    0.323
              µs

Reads = 0 + (0 * i)
Writes = 0 + (1 * i)

…-- benchmark --chain=polkadot-dev --steps=50 --repeat=20 --pallet=frame_benchmarking::baseline --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --header=./file_header.txt --output=./runtime/polkadot/src/weights/frame_benchmarking_baseline.rs

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

ggwpez · 2022-01-30T14:02:45Z

runtime/kusama/src/weights/frame_benchmarking_baseline.rs

+/// Weight functions for `frame_benchmarking::baseline`.
+pub struct WeightInfo<T>(PhantomData<T>);
+impl<T: frame_system::Config> frame_benchmarking::baseline::WeightInfo for WeightInfo<T> {
+	fn addition(_i: u32, ) -> Weight {


@ reviewers:
The ignored parameters here are a known issue; https://github.com/paritytech/substrate/issues/10638

gavofyork · 2022-01-30T14:16:49Z

CI failing.

runtime/kusama/src/weights/mod.rs

runtime/polkadot/src/weights/mod.rs

shawntabrizi · 2022-01-30T17:24:16Z

We dont need to expose the mod since it is not used, and it will probably fix the compiler error

shawntabrizi · 2022-01-30T19:37:04Z

bot merge

Don't merge this

d0fcc4f

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

ggwpez self-assigned this Jan 24, 2022

github-actions bot added the A3-in_progress Pull request is in progress. No review needed at this stage. label Jan 24, 2022

shawntabrizi reviewed Jan 25, 2022

View reviewed changes

runtime/polkadot/src/lib.rs Outdated Show resolved Hide resolved

shawntabrizi approved these changes Jan 25, 2022

View reviewed changes

ggwpez added 2 commits January 26, 2022 18:11

Add baseline benches

0b9c96d

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

Revert "Don't merge this"

5f3565b

This reverts commit d0fcc4f.

joao-paulo-parity mentioned this pull request Jan 27, 2022

bench-bot is not responding to commands sometimes paritytech/bench-bot#83

Closed

Merge branch 'master' of https://github.com/paritytech/polkadot into …

37395fa

…oty-test-bench-bot

paritytech deleted a comment from parity-benchapp bot Jan 28, 2022

Parity Bot and others added 2 commits January 29, 2022 13:19

Add weight modules

04d0eb6

Signed-off-by: Oliver Tale-Yazdi <oliver.tale-yazdi@parity.io>

ggwpez added A0-please_review Pull request needs code review. B0-silent Changes should not be mentioned in any release notes C1-low PR touches the given topic and has a low impact on builders. and removed A3-in_progress Pull request is in progress. No review needed at this stage. labels Jan 30, 2022

ggwpez added the D3-trivial 🧸 PR contains trivial changes in a runtime directory that do not require an audit. label Jan 30, 2022

ggwpez changed the title ~~[DO NOT MERGE] Test Bench Bot~~ Add baseline benchmarks Jan 30, 2022

ggwpez commented Jan 30, 2022

View reviewed changes

ggwpez marked this pull request as ready for review January 30, 2022 14:03

gavofyork approved these changes Jan 30, 2022

View reviewed changes

shawntabrizi reviewed Jan 30, 2022

View reviewed changes

runtime/kusama/src/weights/mod.rs Outdated Show resolved Hide resolved

shawntabrizi reviewed Jan 30, 2022

View reviewed changes

runtime/polkadot/src/weights/mod.rs Outdated Show resolved Hide resolved

Apply suggestions from code review

deeede3

paritytech-processbot bot merged commit 594e3b9 into master Jan 30, 2022

paritytech-processbot bot deleted the oty-test-bench-bot branch January 30, 2022 19:37

chevdor mentioned this pull request Feb 3, 2022

Add benchmark baseline paritytech/cumulus#952

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add baseline benchmarks #4777

Add baseline benchmarks #4777

ggwpez commented Jan 24, 2022 •

edited

Loading

ggwpez commented Jan 24, 2022

parity-benchapp bot commented Jan 24, 2022 •

edited

Loading

ggwpez commented Jan 24, 2022

parity-benchapp bot commented Jan 24, 2022 •

edited

Loading

ggwpez commented Jan 26, 2022

ggwpez commented Jan 26, 2022

ggwpez commented Jan 27, 2022

joao-paulo-parity commented Jan 28, 2022

parity-benchapp bot commented Jan 28, 2022 •

edited

Loading

ggwpez commented Jan 29, 2022

parity-benchapp bot commented Jan 29, 2022 •

edited

Loading

ggwpez Jan 30, 2022

gavofyork commented Jan 30, 2022

shawntabrizi commented Jan 30, 2022

shawntabrizi commented Jan 30, 2022

Add baseline benchmarks #4777

Add baseline benchmarks #4777

Conversation

ggwpez commented Jan 24, 2022 • edited Loading

ggwpez commented Jan 24, 2022

parity-benchapp bot commented Jan 24, 2022 • edited Loading

ggwpez commented Jan 24, 2022

parity-benchapp bot commented Jan 24, 2022 • edited Loading

ggwpez commented Jan 26, 2022

ggwpez commented Jan 26, 2022

ggwpez commented Jan 27, 2022

joao-paulo-parity commented Jan 28, 2022

parity-benchapp bot commented Jan 28, 2022 • edited Loading

ggwpez commented Jan 29, 2022

parity-benchapp bot commented Jan 29, 2022 • edited Loading

ggwpez Jan 30, 2022

Choose a reason for hiding this comment

gavofyork commented Jan 30, 2022

shawntabrizi commented Jan 30, 2022

shawntabrizi commented Jan 30, 2022

ggwpez commented Jan 24, 2022 •

edited

Loading

parity-benchapp bot commented Jan 24, 2022 •

edited

Loading

parity-benchapp bot commented Jan 24, 2022 •

edited

Loading

parity-benchapp bot commented Jan 28, 2022 •

edited

Loading

parity-benchapp bot commented Jan 29, 2022 •

edited

Loading