Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Jepsen][YSQL] Inconsistency in append test under partition #7857

Closed
frozenspider opened this issue Mar 30, 2021 · 5 comments
Closed

[Jepsen][YSQL] Inconsistency in append test under partition #7857

frozenspider opened this issue Mar 30, 2021 · 5 comments
Assignees
@spolitov @frozenspider
Labels
area/ysql Yugabyte SQL (YSQL) kind/bug This issue is a bug kind/failing-test Tests and testing infra

Comments

@frozenspider
Copy link
Contributor

frozenspider commented Mar 30, 2021 •
edited
Loading

During our Jepsen on Jenkins runs, we found an issue for yb yugabyte-2.7.1.0-b66-centos-x86_64.tar.gz append nemesis partition, which corresponds to YB @ acc0b7e using yugabyte/jepsen@29471e9.

Complete log archive is too large to be attached in one go, so I've split it into relevant parts:

Possibly this is another symptom of #7729
@frozenspider frozenspider added kind/bug This issue is a bug area/ysql Yugabyte SQL (YSQL) kind/failing-test Tests and testing infra labels Mar 30, 2021
@frozenspider frozenspider self-assigned this Mar 30, 2021
@frozenspider
Copy link
Contributor Author

This is likely to be unrelated to #7729 as this does reproduce when #7729 wasn't introduced (or exposed) yet.

@frozenspider
Copy link
Contributor Author

Unlike #7729 , I was able to repro this on v2.0 and even v1.3.1.0!
E.g. using Jepsen's commit yugabyte/jepsen@c6d3a65 or yugabyte/jepsen@d9e6a09:

lein run test --os debian --version 1.3.1.0 -w ysql/append --nemesis partition --time-limit 200 --test-count 1 --concurrency 4n

This was referenced Apr 27, 2021
Closed
Closed
@frozenspider
Copy link
Contributor Author

frozenspider commented Apr 29, 2021 •
edited
Loading

Still reproducible after #7729 fix (YB @ c9e64df) with about 5% rate:
lein run test --os debian --url <url> -w ysql/append --nemesis partition --time-limit 300 --test-count 1 --concurrency 4n

spolitov added a commit that referenced this issue Jul 13, 2021
@spolitov
[#7857] Add analyzer for ysql/append jepsen test
a90ab43 
Summary:
This diffs adds transaction dump analyzer for ysql/append jepsen test.

Also added tablet id to apply intents, read and remove transaction events.
Moved shared code from BankAccountAnalyzer to AnalyzerBase.

Test Plan: Jenkins

Reviewers: rsami

Reviewed By: rsami

Subscribers: ybase

Differential Revision: https://phabricator.dev.yugabyte.com/D12246
@frozenspider
Copy link
Contributor Author

Newest log from 2.4.6.0-b3 (d1d2ab9) and yugabyte/jepsen@5949901:
2021-07-20_2.4_ysql_append_partition.zip

@frozenspider frozenspider mentioned this issue Sep 20, 2021
Open
@frozenspider
Copy link
Contributor Author

This was fixed in c9e64df (#7729) and is no longer reproducible

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@spolitov spolitov

@frozenspider frozenspider

Labels
area/ysql Yugabyte SQL (YSQL) kind/bug This issue is a bug kind/failing-test Tests and testing infra
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@spolitov @frozenspider