Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automatically upload binary dataset to s3 #4114

Merged
merged 10 commits into from
Aug 21, 2024
Merged

Automatically upload binary dataset to s3 #4114

merged 10 commits into from
Aug 21, 2024

Conversation

mewim
Copy link
Member

@mewim mewim commented Aug 20, 2024

No description provided.

Copy link

Benchmark Result

Master commit hash: 700b10f71c4e9ea19b4cd7e57ec864a38033225e
Branch commit hash: 1e89b53956b59eb89dea84a87b45f0ee3a3618a2

Query Group Query Name Mean Time - Commit (ms) Mean Time - Master (ms) Diff
aggregation q24 675.44 668.53 6.91 (1.03%)
aggregation q28 12165.31 11953.42 211.89 (1.77%)
copy node-Comment 65543.52 68567.14 -3023.62 (-4.41%)
copy node-Forum 5445.47 5609.97 -164.50 (-2.93%)
copy node-Organisation 1531.47 1542.22 -10.75 (-0.70%)
copy node-Person 2761.43 2926.52 -165.09 (-5.64%)
copy node-Place 1520.54 1462.74 57.80 (3.95%)
copy node-Post 27089.48 27296.52 -207.04 (-0.76%)
copy node-Tag 1527.63 1626.23 -98.60 (-6.06%)
copy node-Tagclass 1415.54 1400.46 15.08 (1.08%)
copy rel-comment-hasCreator 60016.53 55925.00 4091.53 (7.32%)
copy rel-comment-hasTag 77810.71 77494.42 316.29 (0.41%)
copy rel-comment-isLocatedIn 64233.83 64822.00 -588.17 (-0.91%)
copy rel-containerOf 17477.88 16836.69 641.19 (3.81%)
copy rel-forum-hasTag 3773.93 4038.90 -264.97 (-6.56%)
copy rel-hasInterest 2704.90 2867.67 -162.77 (-5.68%)
copy rel-hasMember 53704.85 53480.62 224.23 (0.42%)
copy rel-hasModerator 2242.81 1873.10 369.71 (19.74%)
copy rel-hasType 391.91 719.59 -327.68 (-45.54%)
copy rel-isPartOf 602.69 575.30 27.39 (4.76%)
copy rel-isSubclassOf 332.13 387.40 -55.27 (-14.27%)
copy rel-knows 5720.07 6089.40 -369.33 (-6.07%)
copy rel-likes-comment 88955.24 86746.41 2208.83 (2.55%)
copy rel-likes-post 34737.91 34424.23 313.68 (0.91%)
copy rel-organisation-isLocatedIn 712.45 466.05 246.40 (52.87%)
copy rel-person-isLocatedIn 777.27 918.55 -141.28 (-15.38%)
copy rel-post-hasCreator 16263.29 18421.75 -2158.46 (-11.72%)
copy rel-post-hasTag 21864.83 22652.77 -787.94 (-3.48%)
copy rel-post-isLocatedIn 17544.40 18384.76 -840.36 (-4.57%)
copy rel-replyOf-comment 73626.54 64846.55 8779.99 (13.54%)
copy rel-replyOf-post 48786.76 47921.58 865.18 (1.81%)
copy rel-studyAt 802.02 975.53 -173.51 (-17.79%)
copy rel-workAt 1062.63 1164.92 -102.29 (-8.78%)
filter q14 152.27 144.67 7.61 (5.26%)
filter q15 156.73 147.65 9.08 (6.15%)
filter q16 332.67 321.50 11.16 (3.47%)
filter q17 484.08 465.22 18.86 (4.05%)
filter q18 1948.94 1993.28 -44.34 (-2.22%)
fixed_size_expr_evaluator q07 571.78 555.62 16.16 (2.91%)
fixed_size_expr_evaluator q08 777.28 777.35 -0.07 (-0.01%)
fixed_size_expr_evaluator q09 779.97 778.60 1.37 (0.18%)
fixed_size_expr_evaluator q10 264.81 257.71 7.10 (2.76%)
fixed_size_expr_evaluator q11 259.95 251.64 8.31 (3.30%)
fixed_size_expr_evaluator q12 259.59 250.60 8.99 (3.59%)
fixed_size_expr_evaluator q13 1516.33 1484.57 31.76 (2.14%)
fixed_size_seq_scan q23 147.17 133.27 13.90 (10.43%)
join q31 11.90 11.39 0.51 (4.51%)
ldbc_snb_ic q35 776.19 771.29 4.91 (0.64%)
ldbc_snb_ic q36 49.15 48.19 0.96 (2.00%)
ldbc_snb_is q32 9.29 8.69 0.61 (6.99%)
ldbc_snb_is q33 19.33 15.30 4.03 (26.31%)
ldbc_snb_is q34 8.23 7.73 0.50 (6.48%)
multi-rel multi-rel-large-scan 2811.89 2881.53 -69.64 (-2.42%)
multi-rel multi-rel-lookup 60.19 66.20 -6.02 (-9.09%)
multi-rel multi-rel-small-scan 48.03 53.93 -5.91 (-10.95%)
order_by q25 159.29 148.91 10.38 (6.97%)
order_by q26 474.31 464.11 10.20 (2.20%)
order_by q27 1429.67 1422.50 7.17 (0.50%)
scan_after_filter q01 197.55 192.10 5.45 (2.84%)
scan_after_filter q02 189.40 182.94 6.45 (3.53%)
shortest_path_ldbc100 q39 147.57 97.14 50.43 (51.91%)
var_size_expr_evaluator q03 2083.71 2071.60 12.11 (0.58%)
var_size_expr_evaluator q04 2254.86 2263.46 -8.60 (-0.38%)
var_size_expr_evaluator q05 2633.56 2624.07 9.49 (0.36%)
var_size_expr_evaluator q06 1391.17 1337.83 53.34 (3.99%)
var_size_seq_scan q19 1516.24 1484.97 31.27 (2.11%)
var_size_seq_scan q20 3137.63 3194.70 -57.07 (-1.79%)
var_size_seq_scan q21 2431.32 2430.11 1.21 (0.05%)
var_size_seq_scan q22 133.20 133.10 0.10 (0.08%)

Copy link

Benchmark Result

Master commit hash: 4020110b4c018ac6789bdb31f5af64ee8dc0469f
Branch commit hash: af67d562bab291e668ae569751b2027e04de7489

Query Group Query Name Mean Time - Commit (ms) Mean Time - Master (ms) Diff
aggregation q24 670.85 671.95 -1.09 (-0.16%)
aggregation q28 11843.71 11910.39 -66.68 (-0.56%)
filter q14 151.49 151.38 0.12 (0.08%)
filter q15 153.22 154.79 -1.57 (-1.01%)
filter q16 327.77 328.20 -0.44 (-0.13%)
filter q17 473.86 476.84 -2.99 (-0.63%)
filter q18 1895.37 1900.48 -5.11 (-0.27%)
fixed_size_expr_evaluator q07 562.50 563.22 -0.73 (-0.13%)
fixed_size_expr_evaluator q08 774.13 775.78 -1.64 (-0.21%)
fixed_size_expr_evaluator q09 772.60 774.32 -1.72 (-0.22%)
fixed_size_expr_evaluator q10 267.96 265.41 2.55 (0.96%)
fixed_size_expr_evaluator q11 261.42 259.34 2.09 (0.80%)
fixed_size_expr_evaluator q12 259.59 258.57 1.02 (0.39%)
fixed_size_expr_evaluator q13 1487.01 1484.77 2.24 (0.15%)
fixed_size_seq_scan q23 143.67 145.20 -1.53 (-1.05%)
join q31 12.24 12.12 0.13 (1.04%)
ldbc_snb_ic q35 763.00 1037.84 -274.84 (-26.48%)
ldbc_snb_ic q36 55.57 52.55 3.02 (5.74%)
ldbc_snb_is q32 9.35 10.35 -1.00 (-9.69%)
ldbc_snb_is q33 15.35 17.76 -2.41 (-13.56%)
ldbc_snb_is q34 9.17 7.58 1.59 (20.95%)
multi-rel multi-rel-large-scan 2841.38 2861.49 -20.11 (-0.70%)
multi-rel multi-rel-lookup 70.31 50.94 19.37 (38.02%)
multi-rel multi-rel-small-scan 61.96 49.08 12.88 (26.24%)
order_by q25 157.67 157.19 0.48 (0.31%)
order_by q26 476.60 478.13 -1.53 (-0.32%)
order_by q27 1413.30 1414.46 -1.16 (-0.08%)
scan_after_filter q01 197.92 199.24 -1.32 (-0.66%)
scan_after_filter q02 186.66 187.30 -0.64 (-0.34%)
shortest_path_ldbc100 q39 122.11 114.31 7.80 (6.82%)
var_size_expr_evaluator q03 2082.39 2086.16 -3.77 (-0.18%)
var_size_expr_evaluator q04 2225.72 2216.28 9.44 (0.43%)
var_size_expr_evaluator q05 2702.13 2699.20 2.93 (0.11%)
var_size_expr_evaluator q06 1372.97 1375.88 -2.92 (-0.21%)
var_size_seq_scan q19 1479.64 1474.04 5.60 (0.38%)
var_size_seq_scan q20 3107.85 3167.00 -59.15 (-1.87%)
var_size_seq_scan q21 2414.86 2405.87 9.00 (0.37%)
var_size_seq_scan q22 132.35 130.96 1.39 (1.06%)

Copy link

codecov bot commented Aug 21, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 83.99%. Comparing base (4020110) to head (5ea5276).
Report is 1 commits behind head on master.

Additional details and impacted files
@@           Coverage Diff           @@
##           master    #4114   +/-   ##
=======================================
  Coverage   83.98%   83.99%           
=======================================
  Files        1305     1305           
  Lines       51376    51376           
  Branches     7138     7137    -1     
=======================================
+ Hits        43148    43151    +3     
+ Misses       8079     8076    -3     
  Partials      149      149           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@mewim mewim merged commit e90380e into master Aug 21, 2024
23 checks passed
@mewim mewim deleted the tinysnb-binary branch August 21, 2024 02:59
ted-wq-x pushed a commit to ted-wq-x/kuzu that referenced this pull request Nov 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants