YQ kqprun fixed AS pools and added validations #9030

GrigoriyPA · 2024-09-10T15:52:54Z

Changelog entry

Fixed AS pools and added validations

Changelog category

Improvement

Additional information

AS fixes

Fixed AS pools in testlib (make it such as ydbd)
Added AS configuration in default config (copied from YQ prod)

New flags

Added options for storage settings
Added option for timeline printing
Added timeout option for requests

Other

Added validations on invalid flags combinations
Added script for flame graph extracting
Changed default ResultsRowsLimit to 0 (from 1000)
Fixed query plan printing after fail

github-actions · 2024-09-10T15:54:48Z

⚪ 2024-09-10 15:54:47 UTC Pre-commit check linux-x86_64-release-asan for 898a338 has started.
⚪ 2024-09-10 15:54:59 UTC Artifacts will be uploaded here
⚪ 2024-09-10 15:57:39 UTC ya make is running...
🔴 2024-09-10 16:54:02 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
7893	7857	0	16	3	17

🟢 2024-09-10 16:54:50 UTC Build successful.
🟢 2024-09-10 16:55:20 UTC ydbd size 5.6 GiB changed* by -96 Bytes, which is <= 0 Bytes vs main: OK

ydbd size dash	main: `26c9911`	merge: `898a338`	diff	diff %
ydbd size	6 038 719 744 Bytes	6 038 719 648 Bytes	-96 Bytes	-0.000%
ydbd stripped size	1 511 295 472 Bytes	1 511 295 408 Bytes	-64 Bytes	-0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-09-10T15:54:50Z

⚪ 2024-09-10 15:54:49 UTC Pre-commit check linux-x86_64-release-clang14 for 898a338 has started.
⚪ 2024-09-10 15:54:55 UTC Artifacts will be uploaded here
⚪ 2024-09-10 15:57:30 UTC ya make is running...
🟢 2024-09-10 16:04:22 UTC Build successful.

github-actions · 2024-09-10T15:57:21Z

⚪ 2024-09-10 15:57:20 UTC Pre-commit check linux-x86_64-relwithdebinfo for 898a338 has started.
⚪ 2024-09-10 15:58:02 UTC Artifacts will be uploaded here
⚪ 2024-09-10 16:01:26 UTC ya make is running...
🟡 2024-09-10 16:53:35 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
11391	9909	0	24	1430	28

⚪ 2024-09-10 16:54:48 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-09-10 17:03:35 UTC Tests successful.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
155 (only retried tests)	132	0	0	0	23

🟢 2024-09-10 17:03:42 UTC Build successful.
🟢 2024-09-10 17:04:20 UTC ydbd size 8.4 GiB changed* by -32 Bytes, which is <= 0 Bytes vs main: OK

ydbd size dash	main: `ce3201c`	merge: `898a338`	diff	diff %
ydbd size	9 026 362 848 Bytes	9 026 362 816 Bytes	-32 Bytes	-0.000%
ydbd stripped size	487 745 192 Bytes	487 745 192 Bytes	0 Bytes	0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-09-11T07:11:46Z

⚪ 2024-09-11 07:11:45 UTC Pre-commit check linux-x86_64-release-clang14 for 89fe93e has started.
⚪ 2024-09-11 07:11:55 UTC Artifacts will be uploaded here
⚪ 2024-09-11 07:14:46 UTC ya make is running...
🟢 2024-09-11 07:22:29 UTC Build successful.

github-actions · 2024-09-11T07:12:41Z

⚪ 2024-09-11 07:12:41 UTC Pre-commit check linux-x86_64-release-asan for 89fe93e has started.
⚪ 2024-09-11 07:12:51 UTC Artifacts will be uploaded here
⚪ 2024-09-11 07:15:32 UTC ya make is running...
🔴 2024-09-11 08:12:52 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
7891	7849	0	20	4	18

🟢 2024-09-11 08:13:35 UTC Build successful.
🟢 2024-09-11 08:14:04 UTC ydbd size 5.6 GiB changed* by -96 Bytes, which is <= 0 Bytes vs main: OK

ydbd size dash	main: `a8fb87e`	merge: `89fe93e`	diff	diff %
ydbd size	6 038 971 496 Bytes	6 038 971 400 Bytes	-96 Bytes	-0.000%
ydbd stripped size	1 511 346 800 Bytes	1 511 346 736 Bytes	-64 Bytes	-0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-09-11T07:12:42Z

⚪ 2024-09-11 07:12:41 UTC Pre-commit check linux-x86_64-relwithdebinfo for 89fe93e has started.
⚪ 2024-09-11 07:12:51 UTC Artifacts will be uploaded here
⚪ 2024-09-11 07:15:25 UTC ya make is running...
🟢 2024-09-11 08:03:16 UTC Tests successful.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
11389	10031	0	0	1331	27

🟢 2024-09-11 08:04:13 UTC Build successful.
🟢 2024-09-11 08:04:51 UTC ydbd size 8.4 GiB changed* by -32 Bytes, which is <= 0 Bytes vs main: OK

ydbd size dash	main: `a8fb87e`	merge: `89fe93e`	diff	diff %
ydbd size	9 026 603 144 Bytes	9 026 603 112 Bytes	-32 Bytes	-0.000%
ydbd stripped size	487 764 200 Bytes	487 764 200 Bytes	0 Bytes	0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-09-12T22:15:25Z

⚪ 2024-09-12 22:15:25 UTC Pre-commit check linux-x86_64-release-clang14 for 7cf9a03 has started.
⚪ 2024-09-12 22:15:34 UTC Artifacts will be uploaded here
⚪ 2024-09-12 22:18:11 UTC ya make is running...
🟢 2024-09-12 22:23:55 UTC Build successful.

github-actions · 2024-09-12T22:15:45Z

⚪ 2024-09-12 22:15:44 UTC Pre-commit check linux-x86_64-release-asan for 7cf9a03 has started.
⚪ 2024-09-12 22:15:54 UTC Artifacts will be uploaded here
⚪ 2024-09-12 22:18:40 UTC ya make is running...
🔴 2024-09-12 23:19:27 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
7925	7885	0	21	0	19

🟢 2024-09-12 23:20:09 UTC Build successful.
🟢 2024-09-12 23:20:43 UTC ydbd size 5.6 GiB changed* by +368 Bytes, which is < 100.0 KiB vs main: OK

ydbd size dash	main: `e3b7f65`	merge: `7cf9a03`	diff	diff %
ydbd size	6 051 289 856 Bytes	6 051 290 224 Bytes	+368 Bytes	+0.000%
ydbd stripped size	1 514 262 544 Bytes	1 514 262 608 Bytes	+64 Bytes	+0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-09-12T22:16:09Z

⚪ 2024-09-12 22:16:08 UTC Pre-commit check linux-x86_64-relwithdebinfo for 7cf9a03 has started.
⚪ 2024-09-12 22:16:18 UTC Artifacts will be uploaded here
⚪ 2024-09-12 22:19:07 UTC ya make is running...
🟡 2024-09-12 23:06:36 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
11429	10055	0	1	1343	30

⚪ 2024-09-12 23:07:36 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-09-12 23:16:27 UTC Tests successful.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
44 (only retried tests)	21	0	0	0	23

🟢 2024-09-12 23:16:34 UTC Build successful.
🟢 2024-09-12 23:17:14 UTC ydbd size 8.4 GiB changed* by -32 Bytes, which is <= 0 Bytes vs main: OK

ydbd size dash	main: `c1760bd`	merge: `7cf9a03`	diff	diff %
ydbd size	9 041 615 816 Bytes	9 041 615 784 Bytes	-32 Bytes	-0.000%
ydbd stripped size	488 595 144 Bytes	488 595 144 Bytes	0 Bytes	0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-09-13T09:07:11Z

⚪ 2024-09-13 09:07:10 UTC Pre-commit check linux-x86_64-release-clang14 for 85a74f3 has started.
⚪ 2024-09-13 09:07:36 UTC Artifacts will be uploaded here
⚪ 2024-09-13 09:10:18 UTC ya make is running...
🟢 2024-09-13 09:16:18 UTC Build successful.

github-actions · 2024-09-13T09:07:27Z

⚪ 2024-09-13 09:07:26 UTC Pre-commit check linux-x86_64-relwithdebinfo for 85a74f3 has started.
⚪ 2024-09-13 09:08:26 UTC Artifacts will be uploaded here
⚪ 2024-09-13 09:11:47 UTC ya make is running...
🟡 2024-09-13 10:00:36 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
11429	10068	0	1	1337	23

⚪ 2024-09-13 10:01:36 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-09-13 10:10:42 UTC Tests successful.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
31 (only retried tests)	12	0	0	0	19

🟢 2024-09-13 10:10:49 UTC Build successful.
🟢 2024-09-13 10:11:32 UTC ydbd size 8.4 GiB changed* by +92.2 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash	main: `a3a6517`	merge: `85a74f3`	diff	diff %
ydbd size	9 041 957 648 Bytes	9 042 052 024 Bytes	+92.2 KiB	+0.001%
ydbd stripped size	488 846 248 Bytes	488 846 248 Bytes	0 Bytes	0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-09-13T09:07:52Z

⚪ 2024-09-13 09:07:51 UTC Pre-commit check linux-x86_64-release-asan for 85a74f3 has started.
⚪ 2024-09-13 09:08:30 UTC Artifacts will be uploaded here
⚪ 2024-09-13 09:11:45 UTC ya make is running...
🔴 2024-09-13 10:10:43 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
7924	7887	0	16	1	20

🟢 2024-09-13 10:11:25 UTC Build successful.
🟡 2024-09-13 10:11:55 UTC ydbd size 5.6 GiB changed* by +137.1 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash	main: `a3a6517`	merge: `85a74f3`	diff	diff %
ydbd size	6 051 723 584 Bytes	6 051 864 024 Bytes	+137.1 KiB	+0.002%
ydbd stripped size	1 514 603 760 Bytes	1 514 632 112 Bytes	+27.7 KiB	+0.002%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-09-13T11:10:08Z

⚪ 2024-09-13 11:10:07 UTC Pre-commit check linux-x86_64-release-clang14 for 3355e00 has started.
⚪ 2024-09-13 11:10:15 UTC Artifacts will be uploaded here
⚪ 2024-09-13 11:13:07 UTC ya make is running...
🟢 2024-09-13 11:34:24 UTC Build successful.

github-actions · 2024-09-13T11:10:15Z

⚪ 2024-09-13 11:10:14 UTC Pre-commit check linux-x86_64-release-asan for 3355e00 has started.
⚪ 2024-09-13 11:10:22 UTC Artifacts will be uploaded here
⚪ 2024-09-13 11:13:09 UTC ya make is running...
🔴 2024-09-13 12:23:09 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
7929	7882	0	27	0	20

🟢 2024-09-13 12:23:51 UTC Build successful.
🟡 2024-09-13 12:24:24 UTC ydbd size 5.6 GiB changed* by +272.0 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash	main: `f315577`	merge: `3355e00`	diff	diff %
ydbd size	6 051 942 240 Bytes	6 052 220 784 Bytes	+272.0 KiB	+0.005%
ydbd stripped size	1 514 676 912 Bytes	1 514 682 896 Bytes	+5.8 KiB	+0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-09-13T11:10:30Z

⚪ 2024-09-13 11:10:29 UTC Pre-commit check linux-x86_64-relwithdebinfo for 3355e00 has started.
⚪ 2024-09-13 11:10:40 UTC Artifacts will be uploaded here
⚪ 2024-09-13 11:13:28 UTC ya make is running...
🟡 2024-09-13 12:13:42 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
11436	9924	0	16	1462	34

⚪ 2024-09-13 12:14:41 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-09-13 12:21:41 UTC Tests successful.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
176 (only retried tests)	151	0	0	0	25

🟢 2024-09-13 12:21:48 UTC Build successful.
🟡 2024-09-13 12:22:26 UTC ydbd size 8.4 GiB changed* by +877.2 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash	main: `f315577`	merge: `3355e00`	diff	diff %
ydbd size	9 042 108 856 Bytes	9 043 007 088 Bytes	+877.2 KiB	+0.010%
ydbd stripped size	488 864 360 Bytes	488 863 592 Bytes	-768 Bytes	-0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-09-13T12:45:23Z

⚪ 2024-09-13 12:45:23 UTC Pre-commit check linux-x86_64-release-clang14 for c9c3658 has started.
⚪ 2024-09-13 12:45:32 UTC Artifacts will be uploaded here
⚪ 2024-09-13 12:48:12 UTC ya make is running...
🟢 2024-09-13 12:54:13 UTC Build successful.

github-actions · 2024-09-13T12:45:59Z

⚪ 2024-09-13 12:45:59 UTC Pre-commit check linux-x86_64-release-asan for c9c3658 has started.
⚪ 2024-09-13 12:46:09 UTC Artifacts will be uploaded here
⚪ 2024-09-13 12:48:54 UTC ya make is running...
🔴 2024-09-13 13:50:49 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
7933	7892	0	15	6	20

🟢 2024-09-13 13:51:31 UTC Build successful.
🟡 2024-09-13 13:52:01 UTC ydbd size 5.6 GiB changed* by +240.8 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash	main: `47ba04b`	merge: `c9c3658`	diff	diff %
ydbd size	6 052 482 296 Bytes	6 052 728 904 Bytes	+240.8 KiB	+0.004%
ydbd stripped size	1 514 733 392 Bytes	1 514 760 944 Bytes	+26.9 KiB	+0.002%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-09-13T12:50:15Z

⚪ 2024-09-13 12:50:15 UTC Pre-commit check linux-x86_64-relwithdebinfo for c9c3658 has started.
⚪ 2024-09-13 12:51:07 UTC Artifacts will be uploaded here
⚪ 2024-09-13 12:54:24 UTC ya make is running...
🟡 2024-09-13 13:39:17 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
11436	10081	0	1	1337	17

⚪ 2024-09-13 13:40:19 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-09-13 14:17:12 UTC Tests successful.

Test history | Ya make output

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
23 (only retried tests)	9	0	0	0	14

🟢 2024-09-13 14:17:19 UTC Build successful.
🟢 2024-09-13 14:17:57 UTC ydbd size 8.4 GiB changed* by -16 Bytes, which is <= 0 Bytes vs main: OK

ydbd size dash	main: `acee834`	merge: `c9c3658`	diff	diff %
ydbd size	9 043 659 032 Bytes	9 043 659 016 Bytes	-16 Bytes	-0.000%
ydbd stripped size	488 880 936 Bytes	488 880 936 Bytes	0 Bytes	0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions bot added the new-feature label Sep 10, 2024

GrigoriyPA requested review from dorooleg, Hor911 and uzhastik September 10, 2024 16:01

github-actions bot added improvement and removed new-feature improvement labels Sep 10, 2024

GrigoriyPA force-pushed the YQ-kqprun-fix-actors-pools branch from 7159784 to a3702b7 Compare September 11, 2024 07:08

GrigoriyPA added 4 commits September 12, 2024 21:29

Fixed AS pools in kqprun and added validations

12f1bc0

Added *.old in gitignore

966dc91

Fixed timeline printing

233e1b1

Fixed inprogress stats for -C query on multi node tenant

b5726c5

GrigoriyPA force-pushed the YQ-kqprun-fix-actors-pools branch from a3702b7 to b5726c5 Compare September 12, 2024 22:12

Removed transaction from script execution

5ec43d7

Fixed grpc pools

49b4ac1

GrigoriyPA added 2 commits September 13, 2024 12:41

Fixed test failures in arcadia

b4906ef

Removed new service

d08e57e

uzhastik approved these changes Sep 13, 2024

View reviewed changes

GrigoriyPA merged commit 96cb4ca into ydb-platform:main Sep 13, 2024
10 of 12 checks passed

GrigoriyPA deleted the YQ-kqprun-fix-actors-pools branch September 13, 2024 14:36

StekPerepolnen mentioned this pull request Sep 17, 2024

doc hc api images source #9376

Merged

This was referenced Sep 18, 2024

YQ kqprun added recipe #9453

Merged

YQ-3684 fix screts not found error handling #9501

Merged

shnikd mentioned this pull request Sep 19, 2024

Fix pgwire auth #9531

Merged

uzhastik added a commit to uzhastik/ydb that referenced this pull request Oct 21, 2024

YQ kqprun fixed AS pools and added validations (ydb-platform#9030)

42929ed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

YQ kqprun fixed AS pools and added validations #9030

YQ kqprun fixed AS pools and added validations #9030

GrigoriyPA commented Sep 10, 2024 •

edited

Loading

github-actions bot commented Sep 10, 2024 •

edited

Loading

github-actions bot commented Sep 10, 2024 •

edited

Loading

github-actions bot commented Sep 10, 2024 •

edited

Loading

github-actions bot commented Sep 11, 2024 •

edited

Loading

github-actions bot commented Sep 11, 2024 •

edited

Loading

github-actions bot commented Sep 11, 2024 •

edited

Loading

github-actions bot commented Sep 12, 2024 •

edited

Loading

github-actions bot commented Sep 12, 2024 •

edited

Loading

github-actions bot commented Sep 12, 2024 •

edited

Loading

github-actions bot commented Sep 13, 2024 •

edited

Loading

github-actions bot commented Sep 13, 2024 •

edited

Loading

github-actions bot commented Sep 13, 2024 •

edited

Loading

github-actions bot commented Sep 13, 2024 •

edited

Loading

github-actions bot commented Sep 13, 2024 •

edited

Loading

github-actions bot commented Sep 13, 2024 •

edited

Loading

github-actions bot commented Sep 13, 2024 •

edited

Loading

github-actions bot commented Sep 13, 2024 •

edited

Loading

github-actions bot commented Sep 13, 2024 •

edited

Loading

YQ kqprun fixed AS pools and added validations #9030

YQ kqprun fixed AS pools and added validations #9030

Conversation

GrigoriyPA commented Sep 10, 2024 • edited Loading

Changelog entry

Changelog category

Additional information

AS fixes

New flags

Other

github-actions bot commented Sep 10, 2024 • edited Loading

github-actions bot commented Sep 10, 2024 • edited Loading

github-actions bot commented Sep 10, 2024 • edited Loading

github-actions bot commented Sep 11, 2024 • edited Loading

github-actions bot commented Sep 11, 2024 • edited Loading

github-actions bot commented Sep 11, 2024 • edited Loading

github-actions bot commented Sep 12, 2024 • edited Loading

github-actions bot commented Sep 12, 2024 • edited Loading

github-actions bot commented Sep 12, 2024 • edited Loading

github-actions bot commented Sep 13, 2024 • edited Loading

github-actions bot commented Sep 13, 2024 • edited Loading

github-actions bot commented Sep 13, 2024 • edited Loading

github-actions bot commented Sep 13, 2024 • edited Loading

github-actions bot commented Sep 13, 2024 • edited Loading

github-actions bot commented Sep 13, 2024 • edited Loading

github-actions bot commented Sep 13, 2024 • edited Loading

github-actions bot commented Sep 13, 2024 • edited Loading

github-actions bot commented Sep 13, 2024 • edited Loading

GrigoriyPA commented Sep 10, 2024 •

edited

Loading

github-actions bot commented Sep 10, 2024 •

edited

Loading

github-actions bot commented Sep 10, 2024 •

edited

Loading

github-actions bot commented Sep 10, 2024 •

edited

Loading

github-actions bot commented Sep 11, 2024 •

edited

Loading

github-actions bot commented Sep 11, 2024 •

edited

Loading

github-actions bot commented Sep 11, 2024 •

edited

Loading

github-actions bot commented Sep 12, 2024 •

edited

Loading

github-actions bot commented Sep 12, 2024 •

edited

Loading

github-actions bot commented Sep 12, 2024 •

edited

Loading

github-actions bot commented Sep 13, 2024 •

edited

Loading

github-actions bot commented Sep 13, 2024 •

edited

Loading

github-actions bot commented Sep 13, 2024 •

edited

Loading

github-actions bot commented Sep 13, 2024 •

edited

Loading

github-actions bot commented Sep 13, 2024 •

edited

Loading

github-actions bot commented Sep 13, 2024 •

edited

Loading

github-actions bot commented Sep 13, 2024 •

edited

Loading

github-actions bot commented Sep 13, 2024 •

edited

Loading

github-actions bot commented Sep 13, 2024 •

edited

Loading