Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Jepsen][YSQL] No successful operations during test with kill, partition,pause nemesis #7787

Open
frozenspider opened this issue Mar 24, 2021 · 8 comments
Assignees
Labels
area/ysql Yugabyte SQL (YSQL) kind/bug This issue is a bug priority/medium Medium priority issue

Comments

@frozenspider
Copy link
Contributor

frozenspider commented Mar 24, 2021

Jira Link: [DB-321](https://yugabyte.atlassian.net/browse/DB-321)
During our Jepsen on Jenkins runs, we found an issue for yb yugabyte-2.7.1.0-b34-centos-x86_64.tar.gz default-value nemesis kill,partition,pause, which corresponds to YB @ 67dac20 using yugabyte/jepsen@29471e9.
Logs are here: 20210324T102847.000Z.zip
Possibly this is another symptom of #7729

UPDATE:
kill nemesis alone is enough.

@frozenspider frozenspider added kind/bug This issue is a bug kind/failing-test Tests and testing infra labels Mar 24, 2021
@frozenspider frozenspider self-assigned this Mar 24, 2021
@frozenspider frozenspider added the area/ysql Yugabyte SQL (YSQL) label Mar 24, 2021
@frozenspider
Copy link
Contributor Author

frozenspider commented Apr 29, 2021

Still reproducible after #7729 fix (YB @ c9e64df):
2021-04-29_ysql_default-value.zip

@frozenspider
Copy link
Contributor Author

Simplified that to just kill:
2021-04-29_ysql_default-value_kill.zip

@frozenspider frozenspider changed the title [Jepsen][YSQL] Inconsistency in default-value test under kill,partition,pause [Jepsen][YSQL] Inconsistency in default-value test under kill Apr 30, 2021
@frozenspider
Copy link
Contributor Author

...or even just kill-master (but seems like killing both increases reproduction rate). Killing just tserver doesn't work though.
2021-05-01_ysql_default-value_kill-master.zip

@frozenspider frozenspider changed the title [Jepsen][YSQL] Inconsistency in default-value test under kill [Jepsen][YSQL] Inconsistency in default-value test under kill-master Jun 30, 2021
@spolitov
Copy link
Contributor

@frozenspider Is it actual inconsistency or some other kind of bug?

@frozenspider
Copy link
Contributor Author

After looking into the logs, none of the "analysis invalid"s are caused by an actual detected inconsistency, but instead by an absence of a confirmed-successful operations, mostly CREATE TABLEs and INSERTs.
This is not okay, but it's not a consistency violation.

@frozenspider frozenspider changed the title [Jepsen][YSQL] Inconsistency in default-value test under kill-master [Jepsen][YSQL] Operations constaintly fail in default-value test under kill-master Jul 19, 2021
@m-iancu m-iancu added this to YQL-beta Dec 7, 2021
@qvad
Copy link
Contributor

qvad commented Dec 20, 2021

Looks like it's similar problem #10911

@qvad qvad changed the title [Jepsen][YSQL] Operations constaintly fail in default-value test under kill-master [Jepsen][YSQL] No successful operations during test with any nemesis May 12, 2022
@yugabyte-ci yugabyte-ci added the priority/medium Medium priority issue label May 12, 2022
@qvad qvad changed the title [Jepsen][YSQL] No successful operations during test with any nemesis [Jepsen][YSQL] No successful operations during test with kill, partition,pause nemesis Jun 17, 2022
@yugabyte-ci yugabyte-ci removed the kind/failing-test Tests and testing infra label Oct 12, 2022
@rthallamko3
Copy link
Contributor

@qvad , Does this issue repro?

@rthallamko3
Copy link
Contributor

@qvad , Is this issue still relevant? If not, can we close it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/ysql Yugabyte SQL (YSQL) kind/bug This issue is a bug priority/medium Medium priority issue
Projects
Status: No status
Development

No branches or pull requests

5 participants