Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Log slow IO operations #3067

Merged
merged 10 commits into from
Oct 8, 2021
Merged

Log slow IO operations #3067

merged 10 commits into from
Oct 8, 2021

Conversation

eddyashton
Copy link
Member

First pass just logs the most expensive call to read_entry. Will generalise this to wrap all IO operations, and report if they take over some threshold.

src/host/ledger.h Outdated Show resolved Hide resolved
src/host/ledger.h Outdated Show resolved Hide resolved
@ghost
Copy link

ghost commented Oct 8, 2021

ledger_logging@34181 aka 20211008.22 vs main ewma over 20 builds from 33719 to 34113

Click to see table
build_id build_number tpcc_sgx_cft^ tpcc_sgx_cft_mem tpcc_sgx_bft^ tpcc_sgx_bft_mem ls_sgx_cft^ ls_sgx_cft_mem ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem ls_js_sgx_cft^ ls_js_sgx_cft_mem ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem CHAMP put (/s)^ CHAMP get (/s)^ Historical query (/s)^
33719 20211004.15 6878.85 9.10992e+07 1801.04 1.63975e+08 24438.7 1.82232e+07 4331.17 1.58639e+07 2751.85 1.03588e+07 2602.68 1.08831e+07 1796.84 8.2617e+06 1.49227e+06 3.58042e+07 nan
33724 20211004.17 6564.67 9.18856e+07 1874.15 1.76296e+08 24825.3 1.7961e+07 4408.15 1.63882e+07 2753.4 1.50774e+07 2613.04 1.4291e+07 1841.12 8.2617e+06 1.38508e+06 3.63114e+07 nan
33726 20211004.18 6620.37 9.21478e+07 2040.8 1.52179e+08 24168.6 1.84853e+07 4420.32 1.56017e+07 2796.07 1.00967e+07 2601.17 1.45532e+07 1831.48 8.2617e+06 1.4642e+06 3.66362e+07 nan
33733 20211005.1 6372.55 9.08371e+07 2055.06 1.46936e+08 24055.4 1.7961e+07 4386.69 1.58639e+07 2793.32 1.48153e+07 2635.9 1.48153e+07 1833.13 8.2617e+06 1.45155e+06 3.64406e+07 nan
33801 20211005.20 6757.24 9.16235e+07 2056.16 1.84947e+08 23586.7 1.82232e+07 4379.64 1.56017e+07 2744.98 1.45532e+07 2647.81 1.53396e+07 1824.47 8.52384e+06 1.45548e+06 3.58669e+07 7723.88
33828 20211005.28 6616.47 9.21478e+07 2134.71 1.48771e+08 24685 1.84853e+07 4397.62 1.56017e+07 2747.05 1.45532e+07 2655.43 1.48153e+07 1838.74 1.03588e+07 1.48104e+06 3.65708e+07 8419.74
33846 20211005.33 6764.41 9.21478e+07 2057.61 1.49557e+08 24652.1 1.92717e+07 4682.93 1.58639e+07 2774.57 1.03588e+07 2635.92 1.00967e+07 1823.89 8.2617e+06 1.4683e+06 3.58036e+07 8483.54
33853 20211006.1 6724.34 9.13613e+07 1971.22 1.52179e+08 23813.9 1.84853e+07 4564.88 1.56017e+07 2774.71 1.50774e+07 2620.99 1.08831e+07 1815.45 8.52384e+06 1.45465e+06 3.58669e+07 8567.16
33868 20211006.6 6324.38 9.16235e+07 2018.73 1.5113e+08 24389.9 1.84853e+07 4590.95 1.56017e+07 2703.88 1.27181e+07 2630.89 1.53396e+07 1827.27 1.03588e+07 1.44888e+06 3.59298e+07 7730.87
33876 20211006.7 6503.48 9.18856e+07 2035.66 1.50082e+08 24348.1 1.84853e+07 4587.58 1.56017e+07 2801.24 1.03588e+07 2675.02 1.08831e+07 1845.32 8.2617e+06 1.45671e+06 3.51884e+07 8612.83
33878 20211006.8 6627.39 9.16235e+07 2143.78 1.61878e+08 24714.3 1.9796e+07 4542.04 1.58639e+07 2713.41 1.45532e+07 2640.49 1.08831e+07 1844.03 7.73741e+06 1.45237e+06 3.58669e+07 8702.62
33879 20211006.9 6770.99 9.18856e+07 1951.38 1.75772e+08 24731.7 1.76989e+07 4509.17 1.56017e+07 2744.7 1.48153e+07 2639.81 1.08831e+07 1834.94 8.2617e+06 1.47539e+06 3.59298e+07 8364.45
33924 20211006.22 6581.35 9.13613e+07 2137.19 1.45101e+08 23779.3 1.76989e+07 4593.54 1.58639e+07 2780.11 1.00967e+07 2659.76 1.35046e+07 1814.67 8.52384e+06 1.4773e+06 3.58669e+07 7904.07
33982 20211006.37 6645.5 9.18856e+07 2208.54 1.4012e+08 24610 1.87475e+07 4490.68 1.56017e+07 2777.93 1.03588e+07 2648.8 1.50774e+07 1831.75 7.99955e+06 1.48642e+06 3.63766e+07 8529.81
34014 20211006.45 6634.3 9.05749e+07 1833.44 1.96481e+08 24411.3 1.7961e+07 4551.4 1.56017e+07 2759.75 1.40289e+07 2666.57 1.0621e+07 1838.85 7.99955e+06 1.45227e+06 3.58669e+07 8343.98
34025 20211006.48 6739.41 9.31964e+07 2299.34 1.39596e+08 24814.4 1.87475e+07 4545.41 1.53396e+07 2711.64 1.27181e+07 2623.08 1.45532e+07 1839.55 8.2617e+06 1.46191e+06 3.59298e+07 8464.13
34040 20211007.1 6812.71 9.26721e+07 2029.28 1.53227e+08 24726.8 1.84853e+07 4515.6 1.63882e+07 2802.03 1.40289e+07 2587.59 1.03588e+07 1836.15 8.2617e+06 1.45952e+06 3.47708e+07 8512.75
34063 20211007.7 6507.04 9.16235e+07 2107.08 1.47722e+08 24405.6 1.84853e+07 4546.7 1.56017e+07 2739.58 1.03588e+07 2668.88 1.32424e+07 1835.97 8.2617e+06 1.45072e+06 3.56174e+07 8201.98
34106 20211008.2 6613.84 9.21478e+07 2213.34 1.38023e+08 23277.2 1.84853e+07 4576.12 1.58639e+07 2758.08 1.27181e+07 2682.67 1.53396e+07 1833.06 8.2617e+06 1.4453e+06 3.58042e+07 8338.91
34113 20211008.3 6696.89 9.08371e+07 2110.65 1.52703e+08 24682.6 1.87475e+07 4401.81 1.53396e+07 2781.38 1.29803e+07 2699.15 1.32424e+07 1807.96 8.52384e+06 1.4562e+06 3.59298e+07 8694.73

images

@eddyashton eddyashton marked this pull request as ready for review October 8, 2021 14:20
@eddyashton eddyashton requested a review from a team October 8, 2021 14:20
@eddyashton eddyashton added the 1.x-todo PRs which should be backported to 1.x label Oct 8, 2021
src/host/main.cpp Outdated Show resolved Hide resolved
@eddyashton eddyashton merged commit e0f9ccb into microsoft:main Oct 8, 2021
eddyashton added a commit to eddyashton/CCF that referenced this pull request Oct 8, 2021
eddyashton added a commit that referenced this pull request Oct 8, 2021
@achamayou achamayou removed the 1.x-todo PRs which should be backported to 1.x label Dec 2, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants