Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Schedule lsqb to run every day #4122

Merged
merged 3 commits into from
Aug 22, 2024
Merged

Schedule lsqb to run every day #4122

merged 3 commits into from
Aug 22, 2024

Conversation

ray6080
Copy link
Contributor

@ray6080 ray6080 commented Aug 22, 2024

Description

Schedule LSQB benchmark to run at scale factor 100 per day.

@ray6080 ray6080 requested a review from mewim August 22, 2024 00:18
@mewim mewim merged commit 595ab31 into master Aug 22, 2024
15 of 16 checks passed
@mewim mewim deleted the lsqb branch August 22, 2024 00:36
Copy link

Benchmark Result

Master commit hash: f37cdd14b39548c3bfde485aaa7b2b382b15ff22
Branch commit hash: c7d31012a7260f88913befdfb3b5c31623867cac

Query Group Query Name Mean Time - Commit (ms) Mean Time - Master (ms) Diff
aggregation q24 680.63 678.17 2.46 (0.36%)
aggregation q28 11607.04 11641.99 -34.96 (-0.30%)
filter q14 160.39 159.51 0.88 (0.55%)
filter q15 160.96 166.15 -5.18 (-3.12%)
filter q16 340.68 341.40 -0.72 (-0.21%)
filter q17 481.07 480.28 0.78 (0.16%)
filter q18 1989.03 1996.15 -7.12 (-0.36%)
fixed_size_expr_evaluator q07 575.33 571.95 3.38 (0.59%)
fixed_size_expr_evaluator q08 802.59 790.07 12.52 (1.58%)
fixed_size_expr_evaluator q09 793.17 786.70 6.47 (0.82%)
fixed_size_expr_evaluator q10 273.67 273.93 -0.25 (-0.09%)
fixed_size_expr_evaluator q11 268.36 269.03 -0.67 (-0.25%)
fixed_size_expr_evaluator q12 267.07 267.04 0.03 (0.01%)
fixed_size_expr_evaluator q13 1509.13 1504.10 5.03 (0.33%)
fixed_size_seq_scan q23 153.05 152.12 0.93 (0.61%)
join q31 12.50 12.20 0.31 (2.51%)
ldbc_snb_ic q35 772.75 773.22 -0.46 (-0.06%)
ldbc_snb_ic q36 48.05 43.78 4.27 (9.75%)
ldbc_snb_is q32 9.21 9.92 -0.72 (-7.22%)
ldbc_snb_is q33 16.98 18.17 -1.19 (-6.54%)
ldbc_snb_is q34 7.97 8.56 -0.59 (-6.87%)
multi-rel multi-rel-large-scan 2750.38 2768.80 -18.42 (-0.67%)
multi-rel multi-rel-lookup 56.71 62.64 -5.93 (-9.46%)
multi-rel multi-rel-small-scan 53.97 48.63 5.33 (10.97%)
order_by q25 164.51 161.57 2.93 (1.82%)
order_by q26 482.00 481.83 0.17 (0.04%)
order_by q27 1440.18 1436.95 3.23 (0.23%)
scan_after_filter q01 206.39 205.56 0.83 (0.41%)
scan_after_filter q02 192.60 194.46 -1.86 (-0.96%)
shortest_path_ldbc100 q39 113.88 114.52 -0.65 (-0.56%)
var_size_expr_evaluator q03 2128.59 2119.87 8.73 (0.41%)
var_size_expr_evaluator q04 2316.41 2357.82 -41.41 (-1.76%)
var_size_expr_evaluator q05 2664.05 2668.04 -3.99 (-0.15%)
var_size_expr_evaluator q06 1398.43 1398.33 0.10 (0.01%)
var_size_seq_scan q19 1515.92 1518.68 -2.77 (-0.18%)
var_size_seq_scan q20 3215.71 3232.03 -16.32 (-0.50%)
var_size_seq_scan q21 2471.45 2464.50 6.95 (0.28%)
var_size_seq_scan q22 135.00 136.27 -1.27 (-0.93%)

Copy link

codecov bot commented Aug 22, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 83.99%. Comparing base (4020110) to head (77a5e6c).
Report is 6 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #4122      +/-   ##
==========================================
+ Coverage   83.98%   83.99%   +0.01%     
==========================================
  Files        1305     1306       +1     
  Lines       51376    51412      +36     
  Branches     7138     7140       +2     
==========================================
+ Hits        43148    43185      +37     
+ Misses       8079     8078       -1     
  Partials      149      149              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

ted-wq-x pushed a commit to ted-wq-x/kuzu that referenced this pull request Nov 14, 2024
* schedule lsqb to run every day

* update ci workflow for setting env

* fix

(cherry picked from commit 595ab31)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants