Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CDCSDK] Data loss issue observed in explicit transaction case #24058

Open
1 task done
ShikharSahay opened this issue Sep 20, 2024 · 0 comments
Open
1 task done

[CDCSDK] Data loss issue observed in explicit transaction case #24058

ShikharSahay opened this issue Sep 20, 2024 · 0 comments
Assignees
Labels
2024.1.3_blocker area/cdcsdk CDC SDK kind/bug This issue is a bug priority/high High Priority status/awaiting-triage Issue awaiting triage

Comments

@ShikharSahay
Copy link
Contributor

ShikharSahay commented Sep 20, 2024

Jira Link: DB-12950

Description

Data loss issue -
https://yugabyte.slack.com/archives/C03H4D4EVC6/p1726830498915699?thread_ts=1726552870.277439&cid=C03H4D4EVC6

Stress run - http://stress.dev.yugabyte.com/stress_test/0ee5eaf2-c733-4f6f-b690-963b12da72b7

Yb Version - 2024.1.3.0-b70

Source connector version

quay.io/yugabyte/debezium-connector:dz.1.9.5.yb.grpc.2024.1

Connector configuration

add connector connector_name='ybconnector_cdc_5a7e2c_table_1' stream_id='d8b8f517c7ccc786c44aefafc3b61b04' db_name='cdc_5a7e2c' connector_host='172.151.27.12' table_list=['table_1'] {'name': 'ybconnector_cdc_5a7e2c_table_1', 'config': {'database.master.addresses': '172.151.26.210:7100,172.151.21.192:7100,172.151.18.131:7100', 'database.hostname': '172.151.26.210:5433,172.151.21.192:5433,172.151.18.131:5433', 'database.port': 5433, 'database.masterhost': '172.151.21.192', 'database.masterport': '7100', 'database.user': 'yugabyte', 'database.password': 'yugabyte', 'database.dbname': 'cdc_5a7e2c', 'snapshot.mode': 'never', 'admin.operation.timeout.ms': 600000, 'socket.read.timeout.ms': 300000, 'max.connector.retries': '10', 'operation.timeout.ms': 600000, 'topic.creation.default.compression.type': 'lz4', 'topic.creation.default.cleanup.policy': 'delete', 'topic.creation.default.partitions': 2, 'topic.creation.default.replication.factor': '1', 'tasks.max': '1', 'connector.class': 'io.debezium.connector.yugabytedb.YugabyteDBgRPCConnector', 'database.server.name': 'db_cdc', 'database.streamid': 'd8b8f517c7ccc786c44aefafc3b61b04', 'table.include.list': 'public.table_1'}}

YugabyteDB version

2024.1.3.0-b70

Issue Type

kind/bug

Warning: Please confirm that this issue does not contain any sensitive information

  • I confirm this issue does not contain any sensitive information.
@ShikharSahay ShikharSahay added area/cdcsdk CDC SDK status/awaiting-triage Issue awaiting triage labels Sep 20, 2024
@yugabyte-ci yugabyte-ci added kind/bug This issue is a bug priority/medium Medium priority issue priority/high High Priority 2024.1.3_blocker and removed priority/medium Medium priority issue labels Sep 20, 2024
@shamanthchandra-yb shamanthchandra-yb changed the title [CDCSDK] Data loss issue observed for test_cdc_tx_colocation_nemesis [CDCSDK] Data loss issue observed for explicit transaction case Sep 20, 2024
@shamanthchandra-yb shamanthchandra-yb changed the title [CDCSDK] Data loss issue observed for explicit transaction case [CDCSDK] Data loss issue observed in explicit transaction case Sep 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
2024.1.3_blocker area/cdcsdk CDC SDK kind/bug This issue is a bug priority/high High Priority status/awaiting-triage Issue awaiting triage
Projects
None yet
Development

No branches or pull requests

5 participants