Replication stats (total & per item): lag, initial scan progress #6092

CyberROFL · 2024-06-28T19:07:20Z

Changelog entry

Replication statistics (total & per item):

lag;
initial scan progress.

Changelog category

Improvement

Additional information

...

github-actions · 2024-06-29T19:18:46Z

⚪ 2024-06-29 19:18:46 UTC Pre-commit check for fa8db0d has started.
⚪ 2024-06-29 19:21:42 UTC Build linux-x86_64-release-clang14 is running...
🔴 2024-06-29 19:28:47 UTC Build failed. see the build logs.

github-actions · 2024-06-29T19:28:53Z

⚪ 2024-06-29 19:28:52 UTC Pre-commit check for fa8db0d has started.
⚪ 2024-06-29 19:31:50 UTC Build linux-x86_64-release-asan is running...
🔴 2024-06-29 19:51:19 UTC Build failed. see the build logs.
🔴 2024-06-29 19:51:21 UTC Tests run skipped.

github-actions · 2024-06-29T19:39:05Z

⚪ 2024-06-29 19:39:05 UTC Pre-commit check for fa8db0d has started.
⚪ 2024-06-29 19:42:09 UTC Build linux-x86_64-relwithdebinfo is running...
🔴 2024-06-29 19:47:47 UTC Build failed. see the build logs.
🔴 2024-06-29 19:47:48 UTC Tests run skipped.

github-actions · 2024-06-30T11:57:07Z

⚪ 2024-06-30 11:57:07 UTC Pre-commit check for de58eb3 has started.
⚪ 2024-06-30 12:00:03 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-06-30 12:36:34 UTC Build successful.

github-actions · 2024-06-30T11:57:16Z

⚪ 2024-06-30 11:57:16 UTC Pre-commit check for de58eb3 has started.
⚪ 2024-06-30 12:00:20 UTC Build linux-x86_64-release-asan is running...
🟢 2024-06-30 12:35:26 UTC Build successful.
⚪ 2024-06-30 12:35:46 UTC Tests are running...
🔴 2024-06-30 14:57:21 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
15634	15009	0	102	349	174

🟡 2024-06-30 14:58:20 UTC ydbd size 5.5 GiB changed* by +374.2 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash	main: `c56118c`	merge: `de58eb3`	diff	diff %
ydbd size	5 902 121 360 Bytes	5 902 504 584 Bytes	+374.2 KiB	+0.006%
ydbd stripped size	1 269 085 448 Bytes	1 269 155 144 Bytes	+68.1 KiB	+0.005%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-06-30T12:09:45Z

⚪ 2024-06-30 12:09:45 UTC Pre-commit check for de58eb3 has started.
⚪ 2024-06-30 12:12:49 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-06-30 13:18:35 UTC Build successful.
⚪ 2024-06-30 13:18:56 UTC Tests are running...
🔴 2024-06-30 15:57:31 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
76634	63236	0	3	13377	18

🟡 2024-06-30 15:58:17 UTC ydbd size 8.4 GiB changed* by +526.4 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash	main: `c56118c`	merge: `de58eb3`	diff	diff %
ydbd size	8 999 169 672 Bytes	8 999 708 680 Bytes	+526.4 KiB	+0.006%
ydbd stripped size	492 128 712 Bytes	492 152 776 Bytes	+23.5 KiB	+0.005%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-07-01T13:44:00Z

⚪ 2024-07-01 13:44:00 UTC Pre-commit check for f26c6b2 has started.
⚪ 2024-07-01 13:47:30 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-07-01 14:31:28 UTC Build successful.

github-actions · 2024-07-01T13:55:43Z

⚪ 2024-07-01 13:55:42 UTC Pre-commit check for f26c6b2 has started.
⚪ 2024-07-01 13:59:09 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-07-01 15:05:08 UTC Build successful.
⚪ 2024-07-01 15:05:23 UTC Tests are running...
🔴 2024-07-01 17:31:51 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
76669	63274	0	3	13379	13

🟡 2024-07-01 17:32:26 UTC ydbd size 8.3 GiB changed* by +1.6 MiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash	main: `823fbb3`	merge: `f26c6b2`	diff	diff %
ydbd size	8 953 048 544 Bytes	8 954 705 728 Bytes	+1.6 MiB	+0.019%
ydbd stripped size	488 239 144 Bytes	488 308 936 Bytes	+68.2 KiB	+0.014%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-07-01T13:58:18Z

⚪ 2024-07-01 13:58:18 UTC Pre-commit check for f26c6b2 has started.
⚪ 2024-07-01 14:01:49 UTC Build linux-x86_64-release-asan is running...
🟢 2024-07-01 14:50:04 UTC Build successful.
⚪ 2024-07-01 14:50:17 UTC Tests are running...
🔴 2024-07-01 17:05:45 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
15666	15038	0	105	348	175

🟡 2024-07-01 17:06:38 UTC ydbd size 5.4 GiB changed* by +1.4 MiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash	main: `c98299a`	merge: `f26c6b2`	diff	diff %
ydbd size	5 831 085 544 Bytes	5 832 541 624 Bytes	+1.4 MiB	+0.025%
ydbd stripped size	1 251 053 512 Bytes	1 251 293 064 Bytes	+233.9 KiB	+0.019%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

ydb/core/tx/replication/controller/tx_describe_replication.cpp

ydb/public/lib/ydb_cli/commands/ydb_service_scheme.cpp

ydb/public/sdk/cpp/client/draft/ydb_replication.h

…-platform#6092)

CyberROFL self-assigned this Jun 28, 2024

CyberROFL requested a review from Enjection June 28, 2024 19:07

github-actions bot added new-feature improvement labels Jun 28, 2024

CyberROFL removed the new-feature label Jun 28, 2024

CyberROFL marked this pull request as ready for review June 28, 2024 19:08

CyberROFL added the rebase-and-check Rebase PR with the current base branch and check label Jun 29, 2024

github-actions bot removed the rebase-and-check Rebase PR with the current base branch and check label Jun 29, 2024

Replication stats (total & per item): lag, initial scan progress

58b1598

CyberROFL force-pushed the initial-scan-progress branch from b39b115 to 58b1598 Compare June 30, 2024 11:53

Test & fix

e8e84d9

Enjection requested changes Jul 1, 2024

View reviewed changes

ydb/core/tx/replication/controller/tx_describe_replication.cpp Show resolved Hide resolved

ydb/public/lib/ydb_cli/commands/ydb_service_scheme.cpp Show resolved Hide resolved

ydb/public/sdk/cpp/client/draft/ydb_replication.h Show resolved Hide resolved

Enjection approved these changes Jul 1, 2024

View reviewed changes

CyberROFL merged commit a48b189 into ydb-platform:main Jul 1, 2024
8 of 12 checks passed

CyberROFL deleted the initial-scan-progress branch July 1, 2024 18:13

This was referenced Jul 2, 2024

YYQ-3398 fixed result set size counting #6157

Merged

Kqprun fixed fault and logs printing for multi node usage #6295

Merged

GrigoriyPA mentioned this pull request Jul 9, 2024

Kqprun added request time info printing #6479

Merged

CyberROFL added a commit to CyberROFL/ydb that referenced this pull request Jul 12, 2024

Replication stats (total & per item): lag, initial scan progress (ydb…

8f88212

…-platform#6092)

CyberROFL mentioned this pull request Jul 12, 2024

24-1-async-replication: Sync with main #6618

Merged

GrigoriyPA mentioned this pull request Jul 12, 2024

YQ-3405 fixed endless retries for external error #6626

Merged

This was referenced Jul 12, 2024

YQ-3345 fixed WM counters and unit test #6643

Merged

YQ-3152 fix error failed to execute callable ResWrite! #6752

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Replication stats (total & per item): lag, initial scan progress #6092

Replication stats (total & per item): lag, initial scan progress #6092

CyberROFL commented Jun 28, 2024 •

edited

Loading

github-actions bot commented Jun 29, 2024 •

edited

Loading

github-actions bot commented Jun 29, 2024 •

edited

Loading

github-actions bot commented Jun 29, 2024 •

edited

Loading

github-actions bot commented Jun 30, 2024 •

edited

Loading

github-actions bot commented Jun 30, 2024 •

edited

Loading

github-actions bot commented Jun 30, 2024 •

edited

Loading

github-actions bot commented Jul 1, 2024 •

edited

Loading

github-actions bot commented Jul 1, 2024 •

edited

Loading

github-actions bot commented Jul 1, 2024 •

edited

Loading

Replication stats (total & per item): lag, initial scan progress #6092

Replication stats (total & per item): lag, initial scan progress #6092

Conversation

CyberROFL commented Jun 28, 2024 • edited Loading

Changelog entry

Changelog category

Additional information

github-actions bot commented Jun 29, 2024 • edited Loading

github-actions bot commented Jun 29, 2024 • edited Loading

github-actions bot commented Jun 29, 2024 • edited Loading

github-actions bot commented Jun 30, 2024 • edited Loading

github-actions bot commented Jun 30, 2024 • edited Loading

github-actions bot commented Jun 30, 2024 • edited Loading

github-actions bot commented Jul 1, 2024 • edited Loading

github-actions bot commented Jul 1, 2024 • edited Loading

github-actions bot commented Jul 1, 2024 • edited Loading

CyberROFL commented Jun 28, 2024 •

edited

Loading

github-actions bot commented Jun 29, 2024 •

edited

Loading

github-actions bot commented Jun 29, 2024 •

edited

Loading

github-actions bot commented Jun 29, 2024 •

edited

Loading

github-actions bot commented Jun 30, 2024 •

edited

Loading

github-actions bot commented Jun 30, 2024 •

edited

Loading

github-actions bot commented Jun 30, 2024 •

edited

Loading

github-actions bot commented Jul 1, 2024 •

edited

Loading

github-actions bot commented Jul 1, 2024 •

edited

Loading

github-actions bot commented Jul 1, 2024 •

edited

Loading