add index job rollback after inject one of tidb failure for 1mins or tidb rolling restart

[Lily2025]

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

test-plan id : 2730169
1、tidb_enable_dist_task='on'
2、add index
3、inject one of tidb failure last for 1mins

[2023/09/19 19:15:21.708 +08:00] [INFO] [util.go:73] ["alter table sbtest1 add index index_test_1695122121693 (c)"]
[2023/09/19 19:15:50.842 +08:00] [INFO] [chaos.go:203] ["fault will last for"] [duration=1m0s]
[2023/09/19 19:15:50.842 +08:00] [INFO] [chaos.go:64] ["Run chaos"] [name=failure] [selectors="[endless-ha-test-add-index-tps-2730169-1-569/tc-tidb-0,endless-ha-test-add-index-tps-2730169-1-569/tc-tidb-1]"] [selectorsRetainPolicy(selectors)="[endless-ha-test-add-index-tps-2730169-1-569/tc-tidb-1]"] [targetSelectors="[nil]"] [targetSelectorsRetainPolicy(targetSelectors)="[nil]"] [experimentSpec="FailureExperimentSpec{Duration: "", Scheduler: }"]

2. What did you expect to see? (Required)

add index can succeed.

3. What did you see instead (Required)

add index job rollback after inject one of tidb failure for 1mins

[2023/09/19 19:16:21.710 +08:00] [INFO] [db.go:103] ["select job_id, job_type, state from information_schema.ddl_jobs where query = 'alter table sbtest1 add index index_test_1695122121693 (c)'"]
[2023/09/19 19:16:21.746 +08:00] [INFO] [add_index.go:312] ["jobId: 422, job type: add index /* ingest */, state: rollback done"]

4. What is your TiDB version? (Required)

./tidb-server -V
Release Version: v7.4.0-alpha
Edition: Community
Git Commit Hash: 4cc6c65
Git Branch: heads/refs/tags/v7.4.0-alpha
UTC Build Time: 2023-09-18 11:45:50
GoVersion: go1.21.1
Race Enabled: false
Check Table Before Drop: false
Store: unistore
2023-09-19T15:58:55.622+0800

[Lily2025]

/assign ywqzzy

[jebter]

/component ddl
/severity major

[ywqzzy]

/close

[ti-chi-bot]

@ywqzzy: Closing this issue.

In response to this:

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[ywqzzy]

close as #47313 fix it