Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[mpm] Support integration test template variable #3533

Merged
merged 4 commits into from
Jul 26, 2022

Conversation

jolestar
Copy link
Member

@jolestar jolestar commented Jul 14, 2022

Pull request type

Please check the type of change your PR introduces:

  • Bugfix
  • Feature
  • Code style update (formatting, renaming)
  • Refactoring (no functional changes, no api changes)
  • Build related changes
  • Documentation content changes
  • Other (please describe):

What is the current behavior?

Issue Number: #3537 #3513

What is the new behavior?

Other information

Move PR starcoinorg/move#5

@codecov
Copy link

codecov bot commented Jul 14, 2022

Codecov Report

Merging #3533 (ecd1c5c) into master (6011f5f) will decrease coverage by 0.07%.
The diff coverage is 0.00%.

❗ Current head ecd1c5c differs from pull request most recent head 230db1a. Consider uploading reports for the commit 230db1a to get more accurate results

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #3533      +/-   ##
==========================================
- Coverage   29.41%   29.34%   -0.06%     
==========================================
  Files         589      589              
  Lines       49805    49753      -52     
  Branches    23433    23425       -8     
==========================================
- Hits        14643    14595      -48     
+ Misses      21015    20848     -167     
- Partials    14147    14310     +163     
Flag Coverage Δ
unittests 29.34% <0.00%> (-0.06%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
rpc/api/src/lib.rs 100.00% <ø> (ø)
types/src/account.rs 7.62% <0.00%> (ø)
vm/starcoin-transactional-test-harness/src/lib.rs 0.19% <0.00%> (+0.01%) ⬆️
...oin-transactional-test-harness/src/remote_state.rs 0.00% <0.00%> (ø)
rpc/server/src/module/mod.rs 0.00% <0.00%> (-16.66%) ⬇️
vm/types/src/transaction/error.rs 3.58% <0.00%> (-7.14%) ⬇️
executor/src/block_executor.rs 30.24% <0.00%> (-6.97%) ⬇️
consensus/src/consensus.rs 55.56% <0.00%> (-6.34%) ⬇️
chain/src/chain.rs 33.34% <0.00%> (-5.31%) ⬇️
commons/accumulator/src/tree.rs 53.70% <0.00%> (-5.15%) ⬇️
... and 105 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6011f5f...230db1a. Read the comment docs.

@github-actions
Copy link

Benchmark for 7a703d9

Click to view benchmark
Test Base PR %
accumulator_append 597.5±14.91µs 596.7±11.58µs -0.13%
block_apply/block_apply_10 265.3±0.76ms 266.4±4.36ms +0.41%
block_apply/block_apply_1000 27.2±0.09s 27.0±0.04s -0.74%
get_with_proof/db_store 37.0±0.30µs 36.1±0.43µs -2.43%
get_with_proof/mem_store 31.5±0.22µs 31.4±0.21µs -0.32%
put_and_commit/db_store/1 95.4±4.86µs 95.3±4.68µs -0.10%
put_and_commit/db_store/10 849.7±38.93µs 853.9±37.63µs +0.49%
put_and_commit/db_store/100 7.4±0.33ms 7.4±0.32ms 0.00%
put_and_commit/db_store/5 439.3±21.44µs 440.1±22.33µs +0.18%
put_and_commit/db_store/50 3.8±0.18ms 3.8±0.29ms 0.00%
put_and_commit/mem_store/1 61.4±5.63µs 61.6±5.53µs +0.33%
put_and_commit/mem_store/10 577.2±49.04µs 575.1±46.45µs -0.36%
put_and_commit/mem_store/100 5.7±0.82ms 5.7±0.82ms 0.00%
put_and_commit/mem_store/5 291.3±25.34µs 291.6±25.34µs +0.10%
put_and_commit/mem_store/50 2.8±0.18ms 2.8±0.18ms 0.00%
query_block/query_block_in(10)_times(100) 3.9±0.14ms 3.9±0.18ms 0.00%
query_block/query_block_in(10)_times(1000) 39.2±0.91ms 38.9±1.17ms -0.77%
query_block/query_block_in(10)_times(10000) 390.8±5.56ms 394.4±6.82ms +0.92%
query_block/query_block_in(1000)_times(100) 955.5±8.33µs 961.2±11.08µs +0.60%
query_block/query_block_in(1000)_times(1000) 9.5±0.05ms 9.5±0.06ms 0.00%
query_block/query_block_in(1000)_times(10000) 94.9±1.08ms 95.5±0.63ms +0.63%
storage_transaction 1089.3±341.68µs 1055.0±284.57µs -3.15%
vm/transaction_execution/1 313.9±2.40ms 313.4±0.96ms -0.16%
vm/transaction_execution/10 98.7±0.34ms 99.7±1.93ms +1.01%
vm/transaction_execution/20 91.9±0.19ms 92.4±0.23ms +0.54%
vm/transaction_execution/5 120.3±0.71ms 120.8±0.37ms +0.42%
vm/transaction_execution/50 107.0±1.75ms 107.1±0.44ms +0.09%

@jolestar jolestar marked this pull request as draft July 15, 2022 04:05
@jolestar jolestar marked this pull request as ready for review July 15, 2022 13:12
@jolestar jolestar force-pushed the mpm_integration_test_var branch from 896919b to b131318 Compare July 15, 2022 13:20
@jolestar jolestar requested review from baichuan3 and welbon July 15, 2022 13:21
@jolestar
Copy link
Member Author

集成测试改了一下输出,为了能在后面拿到前面交易的数据,把交易信息以及执行的 output 也都记录在 exp 文件里了。

效果还可以,就是输出有点多, @muzixinly @welbon 一起给看看

//# run --signers creator --args {{$.block[0].number}} --args {{$.view[0].sequence_number}}
script{
fun main(_sender: signer, block_number: u64, sequence_number: u64){
assert!(block_number == 2, 1000);
assert!(sequence_number == 1, 1001);
}
}

https://github.com/starcoinorg/starcoin/blob/b1313189a025461451e2d6dadb8facc6faf7ed87/vm/starcoin-transactional-test-harness/tests/cases/arg_variable.exp

@baichuan3
Copy link

集成测试改了一下输出,为了能在后面拿到前面交易的数据,把交易信息以及执行的 output 也都记录在 exp 文件里了。

效果还可以,就是输出有点多, @muzixinly @welbon 一起给看看

//# run --signers creator --args {{$.block[0].number}} --args {{$.view[0].sequence_number}}
script{
fun main(_sender: signer, block_number: u64, sequence_number: u64){
assert!(block_number == 2, 1000);
assert!(sequence_number == 1, 1001);
}
}

https://github.com/starcoinorg/starcoin/blob/b1313189a025461451e2d6dadb8facc6faf7ed87/vm/starcoin-transactional-test-harness/tests/cases/arg_variable.exp

输出很丰富,当单文件test case很多的时候,输出也会很多,如果有个参数来控制输出就更好了。

@baichuan3
Copy link

额外,proposal投票时,依赖rcp调用,state.get_with_proof_by_root_raw,这次的集成测试里会支持类似rpc调用能力? @jolestar

@jolestar
Copy link
Member Author

集成测试改了一下输出,为了能在后面拿到前面交易的数据,把交易信息以及执行的 output 也都记录在 exp 文件里了。
效果还可以,就是输出有点多, @muzixinly @welbon 一起给看看

//# run --signers creator --args {{$.block[0].number}} --args {{$.view[0].sequence_number}}
script{
fun main(_sender: signer, block_number: u64, sequence_number: u64){
assert!(block_number == 2, 1000);
assert!(sequence_number == 1, 1001);
}
}

https://github.com/starcoinorg/starcoin/blob/b1313189a025461451e2d6dadb8facc6faf7ed87/vm/starcoin-transactional-test-harness/tests/cases/arg_variable.exp

输出很丰富,当单文件test case很多的时候,输出也会很多,如果有个参数来控制输出就更好了。

这个输出是用来判断结果的,多次输出要保持一致,如果通过参数控制的话两次输出就不一样了。

@jolestar
Copy link
Member Author

额外,proposal投票时,依赖rcp调用,state.get_with_proof_by_root_raw,这次的集成测试里会支持类似rpc调用能力? @jolestar

加了一个 RPC 调用的命令 call-api, 不过参数解析那里还有类型转换的问题,得想个办法。

//# init --rpc http://main.seed.starcoin.org --block-number 6860000
//# faucet --addr creator --amount 100000000000
//# call-api chain.get_block_by_number [6860000]
//TODO how to convert the type.
//# run --signers creator --args {{$.call-api[0].head.number}} --args x"{{$.call-api[0].block_hash}}"
script{
use StarcoinFramework::Vector;
fun main(_sender: signer, block_number: u64, block_hash: vector<u8>){
assert!(block_number == 6860000, 1000);
assert!(Vector::length(&block_hash) == 32, 1001);
}
}

@jolestar jolestar force-pushed the mpm_integration_test_var branch from a952563 to 193c29a Compare July 20, 2022 15:21
@github-actions
Copy link

Benchmark for e41d954

Click to view benchmark
Test Base PR %
accumulator_append 590.6±15.00µs 589.1±11.59µs -0.25%
block_apply/block_apply_10 264.8±0.78ms 267.4±0.67ms +0.98%
block_apply/block_apply_1000 27.4±0.04s 27.3±0.02s -0.36%
get_with_proof/db_store 36.3±0.23µs 37.1±0.30µs +2.20%
get_with_proof/mem_store 31.3±0.24µs 31.5±0.14µs +0.64%
put_and_commit/db_store/1 95.7±4.65µs 95.4±7.51µs -0.31%
put_and_commit/db_store/10 851.4±41.44µs 852.4±39.29µs +0.12%
put_and_commit/db_store/100 7.3±0.33ms 7.4±0.33ms +1.37%
put_and_commit/db_store/5 435.2±21.39µs 436.4±22.12µs +0.28%
put_and_commit/db_store/50 3.8±0.17ms 3.8±0.16ms 0.00%
put_and_commit/mem_store/1 61.6±5.70µs 61.5±5.73µs -0.16%
put_and_commit/mem_store/10 578.5±49.35µs 574.6±47.37µs -0.67%
put_and_commit/mem_store/100 5.7±0.83ms 5.7±0.83ms 0.00%
put_and_commit/mem_store/5 291.7±25.52µs 289.2±24.68µs -0.86%
put_and_commit/mem_store/50 2.8±0.18ms 2.8±0.18ms 0.00%
query_block/query_block_in(10)_times(100) 3.9±0.13ms 3.8±0.13ms -2.56%
query_block/query_block_in(10)_times(1000) 38.9±1.42ms 39.0±0.71ms +0.26%
query_block/query_block_in(10)_times(10000) 385.0±4.27ms 388.7±7.10ms +0.96%
query_block/query_block_in(1000)_times(100) 945.5±5.05µs 939.6±4.99µs -0.62%
query_block/query_block_in(1000)_times(1000) 9.5±0.06ms 9.3±0.09ms -2.11%
query_block/query_block_in(1000)_times(10000) 95.3±0.93ms 94.1±0.59ms -1.26%
storage_transaction 1061.2±294.13µs 1059.3±290.66µs -0.18%
vm/transaction_execution/1 312.6±0.61ms 314.7±4.90ms +0.67%
vm/transaction_execution/10 98.5±0.15ms 98.7±0.38ms +0.20%
vm/transaction_execution/20 91.8±0.16ms 92.0±0.10ms +0.22%
vm/transaction_execution/5 120.3±0.65ms 120.7±0.47ms +0.33%
vm/transaction_execution/50 106.5±0.20ms 107.3±1.39ms +0.75%

@baichuan3
Copy link

baichuan3 commented Jul 22, 2022

在投票场景,用下面的测试代码遇到了几个问题:
1)参数异常,
Error: Invalid command. Got error error: Found argument '0x6bfb460477adf9dd0455d3de2fc7f211::SBTModule::DaoMemberBody<0x6bfb460477adf9dd0455d3de2fc7f211::SBTModule::SbtTestDAO>>","0xd5cd5dc44799c989a84b7d4a810259f373b13a9bf8ee21ecbed0fab264e2090d"]' which wasn't expected, or isn't valid in this context

call-api 的USAGE里的描述是这样的,参数感觉被截断了,应该怎么填?
ARGS:
api method to call, example: node.info
api params, should be a json array string [default: ]

2)在集成测试场景,state.get_with_proof_by_root_raw第一个参数access path应该是泛型来动态生成的,为了测试,在指定seed节点时,能否通过指定publicekey来复用某个指定的address时,会有安全问题?

具体的测试代码如下:

//# init --rpc http://barnard.seed.starcoin.org --block-number 6201718

//# faucet --addr creator --amount 100000000000

//# faucet --addr alice --amount 10000000000

//# call-api state.get_with_proof_by_root_raw ["0x6bfb460477adf9dd0455d3de2fc7f211/1/0x00000000000000000000000000000001::IdentifierNFT::IdentifierNFT<0x6bfb460477adf9dd0455d3de2fc7f211::SBTModule::DaoMember<0x6bfb460477adf9dd0455d3de2fc7f211::SBTModule::SbtTestDAO>, 0x6bfb460477adf9dd0455d3de2fc7f211::SBTModule::DaoMemberBody<0x6bfb460477adf9dd0455d3de2fc7f211::SBTModule::SbtTestDAO>>","0xd5cd5dc44799c989a84b7d4a810259f373b13a9bf8ee21ecbed0fab264e2090d"]

//TODO how to convert the type.
//# run --signers creator --args x"{{$.call-api[0]}}"
script{
use StarcoinFramework::Debug;

fun main(_sender: signer, snpashot_raw_proofs: vector<u8>){
    Debug::print(&snpashot_raw_proofs);
}

}

@jolestar 帮看下

@jolestar
Copy link
Member Author

//# call-api state.get_with_proof_by_root_raw ["0x6bfb460477adf9dd0455d3de2fc7f211/1/0x00000000000000000000000000000001::IdentifierNFT::IdentifierNFT<0x6bfb460477adf9dd0455d3de2fc7f211::SBTModule::DaoMember<0x6bfb460477adf9dd0455d3de2fc7f211::SBTModule::SbtTestDAO>, 0x6bfb460477adf9dd0455d3de2fc7f211::SBTModule::DaoMemberBody<0x6bfb460477adf9dd0455d3de2fc7f211::SBTModule::SbtTestDAO>>","0xd5cd5dc44799c989a84b7d4a810259f373b13a9bf8ee21ecbed0fab264e2090d"]

多了一个空格

call-api state.get_with_proof_by_root_raw ["0x6bfb460477adf9dd0455d3de2fc7f211/1/0x00000000000000000000000000000001::IdentifierNFT::IdentifierNFT<0x6bfb460477adf9dd0455d3de2fc7f211::SBTModule::DaoMember<0x6bfb460477adf9dd0455d3de2fc7f211::SBTModule::SbtTestDAO>,0x6bfb460477adf9dd0455d3de2fc7f211::SBTModule::DaoMemberBody<0x6bfb460477adf9dd0455d3de2fc7f211::SBTModule::SbtTestDAO>>","0xd5cd5dc44799c989a84b7d4a810259f373b13a9bf8ee21ecbed0fab264e2090d"]

命令行参数是以空格切分的

@github-actions
Copy link

Benchmark for f19de5e

Click to view benchmark
Test Base PR %
accumulator_append 591.4±20.33µs 591.2±12.08µs -0.03%
block_apply/block_apply_10 264.8±0.53ms 267.3±0.52ms +0.94%
block_apply/block_apply_1000 27.1±0.03s 27.3±0.02s +0.74%
get_with_proof/db_store 36.0±0.25µs 36.2±0.24µs +0.56%
get_with_proof/mem_store 31.5±0.59µs 31.5±0.27µs 0.00%
put_and_commit/db_store/1 94.5±4.82µs 95.8±5.36µs +1.38%
put_and_commit/db_store/10 848.4±38.79µs 852.7±39.93µs +0.51%
put_and_commit/db_store/100 7.3±0.31ms 7.3±0.31ms 0.00%
put_and_commit/db_store/5 436.9±21.83µs 436.8±21.25µs -0.02%
put_and_commit/db_store/50 3.8±0.18ms 3.8±0.18ms 0.00%
put_and_commit/mem_store/1 61.7±5.61µs 61.6±5.60µs -0.16%
put_and_commit/mem_store/10 574.2±46.28µs 579.9±48.93µs +0.99%
put_and_commit/mem_store/100 5.6±0.34ms 5.7±0.83ms +1.79%
put_and_commit/mem_store/5 291.5±26.73µs 292.5±25.59µs +0.34%
put_and_commit/mem_store/50 2.8±0.18ms 2.8±0.18ms 0.00%
query_block/query_block_in(10)_times(100) 3.9±0.08ms 3.9±0.13ms 0.00%
query_block/query_block_in(10)_times(1000) 38.9±1.25ms 38.8±1.24ms -0.26%
query_block/query_block_in(10)_times(10000) 390.5±7.88ms 388.2±5.65ms -0.59%
query_block/query_block_in(1000)_times(100) 956.3±6.89µs 938.9±7.70µs -1.82%
query_block/query_block_in(1000)_times(1000) 9.5±0.08ms 9.4±0.09ms -1.05%
query_block/query_block_in(1000)_times(10000) 95.9±0.89ms 93.7±0.53ms -2.29%
storage_transaction 1070.9±292.74µs 1100.1±356.35µs +2.73%
vm/transaction_execution/1 313.5±0.59ms 314.4±1.01ms +0.29%
vm/transaction_execution/10 98.7±0.17ms 99.4±1.34ms +0.71%
vm/transaction_execution/20 92.2±0.28ms 92.6±1.73ms +0.43%
vm/transaction_execution/5 120.4±0.20ms 121.4±1.64ms +0.83%
vm/transaction_execution/50 106.6±0.17ms 106.5±0.27ms -0.09%

@jolestar jolestar force-pushed the mpm_integration_test_var branch from 99541c0 to 370ab18 Compare July 22, 2022 17:09
@jolestar
Copy link
Member Author

支持了 hack 任意账号, 可以用任意账号发交易 resolve #3537

@jolestar jolestar requested a review from pause125 July 22, 2022 17:12
@jolestar
Copy link
Member Author

integration-test 的输出格式有变化,会 break 掉集成测试的 exp 文件:

Screen Shot 2022-07-23 at 01 13 42

需要重新生成一下 exp 文件

@jolestar jolestar force-pushed the mpm_integration_test_var branch from e066e12 to c795122 Compare July 22, 2022 17:25
Ok(kept) if kept.is_success() => Ok(None),
match output.output.status {
TransactionStatusView::Executed => {
self.hack_account(addr)?;
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

所有 faucet 的 Address 都被 hack 可能存在两个问题:

  1. 存在需要验证签名的需求,如果所有 Address 都被 hack 了,那就无法进行签名验证了;
  2. 如果想 hack 某个 Address, 但又不需要 faucet,开发者却必须用 faucet 指令去 hack,有点不太友好。

也行可以在 init 里面增加选项,hack 指定的 Address?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

所有 faucet 的 Address 都被 hack 可能存在两个问题:

  1. 存在需要验证签名的需求,如果所有 Address 都被 hack 了,那就无法进行签名验证了;
  2. 如果想 hack 某个 Address, 但又不需要 faucet,开发者却必须用 faucet 指令去 hack,有点不太友好。

也行可以在 init 里面增加选项,hack 指定的 Address?

这个问题我也想过:

  1. 验证签名的逻辑很难在合约里实现。好像没遇到类似的需求。
  2. 用 faucet 的好处是 faucet 后的账号一定存在,这样直接 hack auth key 就行。但如果在 init 里面增加,当目标账号不存在时, 还有个创建账号的问题。

@lerencao 也帮忙看看。

@github-actions
Copy link

Benchmark for ef41c8e

Click to view benchmark
Test Base PR %
accumulator_append 596.6±11.62µs 590.2±10.61µs -1.07%
block_apply/block_apply_10 264.8±0.90ms 264.9±0.66ms +0.04%
block_apply/block_apply_1000 27.1±0.07s 27.1±0.05s 0.00%
get_with_proof/db_store 36.5±0.25µs 36.1±0.24µs -1.10%
get_with_proof/mem_store 31.8±0.53µs 31.3±0.16µs -1.57%
put_and_commit/db_store/1 95.3±4.92µs 95.1±5.14µs -0.21%
put_and_commit/db_store/10 856.9±39.75µs 850.1±40.07µs -0.79%
put_and_commit/db_store/100 7.3±0.32ms 7.3±0.31ms 0.00%
put_and_commit/db_store/5 433.1±21.58µs 436.8±30.83µs +0.85%
put_and_commit/db_store/50 3.8±0.17ms 3.8±0.17ms 0.00%
put_and_commit/mem_store/1 61.4±5.59µs 61.5±5.72µs +0.16%
put_and_commit/mem_store/10 571.9±46.52µs 577.5±48.49µs +0.98%
put_and_commit/mem_store/100 5.6±0.34ms 5.6±0.82ms 0.00%
put_and_commit/mem_store/5 289.2±24.34µs 291.6±25.76µs +0.83%
put_and_commit/mem_store/50 2.8±0.19ms 2.8±0.19ms 0.00%
query_block/query_block_in(10)_times(100) 3.9±0.11ms 3.9±0.08ms 0.00%
query_block/query_block_in(10)_times(1000) 38.6±0.79ms 39.1±1.49ms +1.30%
query_block/query_block_in(10)_times(10000) 389.8±9.51ms 394.9±8.54ms +1.31%
query_block/query_block_in(1000)_times(100) 947.6±10.43µs 943.2±8.20µs -0.46%
query_block/query_block_in(1000)_times(1000) 9.5±0.07ms 9.4±0.05ms -1.05%
query_block/query_block_in(1000)_times(10000) 94.9±0.79ms 95.4±1.00ms +0.53%
storage_transaction 1057.8±283.93µs 1050.5±286.31µs -0.69%
vm/transaction_execution/1 314.2±0.24ms 314.3±0.69ms +0.03%
vm/transaction_execution/10 98.9±0.21ms 99.2±0.16ms +0.30%
vm/transaction_execution/20 92.5±0.84ms 92.6±0.90ms +0.11%
vm/transaction_execution/5 120.6±0.16ms 121.6±1.22ms +0.83%
vm/transaction_execution/50 106.5±0.14ms 106.8±0.28ms +0.28%

@jolestar jolestar force-pushed the mpm_integration_test_var branch from ecd1c5c to 230db1a Compare July 26, 2022 07:24
@github-actions
Copy link

Benchmark for c0ffdb9

Click to view benchmark
Test Base PR %
accumulator_append 615.0±12.62µs 605.8±13.62µs -1.50%
block_apply/block_apply_10 268.6±0.71ms 265.5±1.84ms -1.15%
block_apply/block_apply_1000 27.3±0.04s 27.4±0.04s +0.37%
get_with_proof/db_store 37.0±0.27µs 36.3±0.48µs -1.89%
get_with_proof/mem_store 31.7±0.21µs 31.3±0.35µs -1.26%
put_and_commit/db_store/1 96.6±5.25µs 98.4±5.23µs +1.86%
put_and_commit/db_store/10 883.5±46.52µs 860.7±41.76µs -2.58%
put_and_commit/db_store/100 7.4±0.32ms 7.3±0.33ms -1.35%
put_and_commit/db_store/5 426.5±22.21µs 448.4±27.37µs +5.13%
put_and_commit/db_store/50 3.8±0.18ms 3.8±0.17ms 0.00%
put_and_commit/mem_store/1 62.4±5.81µs 61.6±5.84µs -1.28%
put_and_commit/mem_store/10 580.2±50.81µs 575.7±48.11µs -0.78%
put_and_commit/mem_store/100 5.7±0.85ms 5.7±0.85ms 0.00%
put_and_commit/mem_store/5 292.1±25.30µs 291.1±26.73µs -0.34%
put_and_commit/mem_store/50 2.8±0.19ms 2.8±0.19ms 0.00%
query_block/query_block_in(10)_times(100) 3.8±0.13ms 3.9±0.11ms +2.63%
query_block/query_block_in(10)_times(1000) 38.0±1.34ms 39.1±0.76ms +2.89%
query_block/query_block_in(10)_times(10000) 387.6±8.87ms 387.9±6.54ms +0.08%
query_block/query_block_in(1000)_times(100) 942.0±8.23µs 953.1±6.39µs +1.18%
query_block/query_block_in(1000)_times(1000) 9.5±0.16ms 9.6±0.05ms +1.05%
query_block/query_block_in(1000)_times(10000) 94.6±1.18ms 95.7±1.12ms +1.16%
storage_transaction 1078.9±300.46µs 1074.4±290.93µs -0.42%
vm/transaction_execution/1 313.3±0.72ms 312.5±0.96ms -0.26%
vm/transaction_execution/10 99.2±0.97ms 98.8±0.63ms -0.40%
vm/transaction_execution/20 92.3±0.41ms 92.1±0.52ms -0.22%
vm/transaction_execution/5 120.6±0.82ms 121.1±2.11ms +0.41%
vm/transaction_execution/50 106.7±0.45ms 107.7±3.70ms +0.94%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
5 participants