-
Notifications
You must be signed in to change notification settings - Fork 9.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Some unit tests failed after adding three last commits #17232
Comments
I ran |
Thank you for your answer. I was curious whether my device is the problem, so ran
and every time it gives one of these two errors on go.etcd.io/etcd/server/v3/storage/mvcc test:
or this one
I don't do any additional work neither do I change anything in the repo |
Could you execute It seems that it's similar to #17223, somehow the backend has already been closed during the test. |
|
I also noticed that sometimes during the execution of unit tests |
@KosovGrigorii |
Yes, the issue appears in release-3.5 Logs: panic
When I run just this test all goes well:
```
=== RUN TestHashKVWhenCompacting
{"level":"info","msg":"kvstore restored","current-rev":1}
{"level":"info","msg":"compact tree index","revision":9900}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9900,"took":"531.117894ms","hash":2982592828}
{"level":"info","msg":"storing new hash","hash":2982592828,"revision":9900,"compact-revision":-1}
{"level":"info","msg":"compact tree index","revision":9901}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9901,"took":"37.033445ms","hash":4092902393}
{"level":"info","msg":"storing new hash","hash":4092902393,"revision":9901,"compact-revision":9900}
{"level":"info","msg":"compact tree index","revision":9902}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9902,"took":"38.986793ms","hash":3442946395}
{"level":"info","msg":"storing new hash","hash":3442946395,"revision":9902,"compact-revision":9901}
{"level":"info","msg":"compact tree index","revision":9903}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9903,"took":"39.098304ms","hash":3934476647}
{"level":"info","msg":"storing new hash","hash":3934476647,"revision":9903,"compact-revision":9902}
{"level":"info","msg":"compact tree index","revision":9904}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9904,"took":"39.604967ms","hash":1979317650}
{"level":"info","msg":"storing new hash","hash":1979317650,"revision":9904,"compact-revision":9903}
{"level":"info","msg":"compact tree index","revision":9905}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9905,"took":"39.474176ms","hash":4126965741}
{"level":"info","msg":"storing new hash","hash":4126965741,"revision":9905,"compact-revision":9904}
{"level":"info","msg":"compact tree index","revision":9906}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9906,"took":"39.967073ms","hash":3409966415}
{"level":"info","msg":"storing new hash","hash":3409966415,"revision":9906,"compact-revision":9905}
{"level":"info","msg":"compact tree index","revision":9907}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9907,"took":"38.439449ms","hash":3968572787}
{"level":"info","msg":"storing new hash","hash":3968572787,"revision":9907,"compact-revision":9906}
{"level":"info","msg":"compact tree index","revision":9908}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9908,"took":"57.393176ms","hash":1013037252}
{"level":"info","msg":"storing new hash","hash":1013037252,"revision":9908,"compact-revision":9907}
{"level":"info","msg":"compact tree index","revision":9909}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9909,"took":"39.863965ms","hash":1305141790}
{"level":"info","msg":"storing new hash","hash":1305141790,"revision":9909,"compact-revision":9908}
{"level":"info","msg":"compact tree index","revision":9910}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9910,"took":"38.088003ms","hash":189389043}
{"level":"info","msg":"storing new hash","hash":189389043,"revision":9910,"compact-revision":9909}
{"level":"info","msg":"compact tree index","revision":9911}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9911,"took":"38.941662ms","hash":754823375}
{"level":"info","msg":"storing new hash","hash":754823375,"revision":9911,"compact-revision":9910}
{"level":"info","msg":"compact tree index","revision":9912}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9912,"took":"39.274764ms","hash":4067225043}
{"level":"info","msg":"storing new hash","hash":4067225043,"revision":9912,"compact-revision":9911}
{"level":"info","msg":"compact tree index","revision":9913}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9913,"took":"39.844201ms","hash":804901573}
{"level":"info","msg":"storing new hash","hash":804901573,"revision":9913,"compact-revision":9912}
{"level":"info","msg":"compact tree index","revision":9914}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9914,"took":"41.744758ms","hash":3600863096}
{"level":"info","msg":"storing new hash","hash":3600863096,"revision":9914,"compact-revision":9913}
{"level":"info","msg":"compact tree index","revision":9915}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9915,"took":"38.780256ms","hash":4044662596}
{"level":"info","msg":"storing new hash","hash":4044662596,"revision":9915,"compact-revision":9914}
{"level":"info","msg":"compact tree index","revision":9916}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9916,"took":"38.495205ms","hash":1824345379}
{"level":"info","msg":"storing new hash","hash":1824345379,"revision":9916,"compact-revision":9915}
{"level":"info","msg":"compact tree index","revision":9917}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9917,"took":"37.077781ms","hash":487987193}
{"level":"info","msg":"storing new hash","hash":487987193,"revision":9917,"compact-revision":9916}
{"level":"info","msg":"compact tree index","revision":9918}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9918,"took":"37.465793ms","hash":1855345291}
{"level":"info","msg":"storing new hash","hash":1855345291,"revision":9918,"compact-revision":9917}
{"level":"info","msg":"compact tree index","revision":9919}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9919,"took":"39.528318ms","hash":1226980023}
{"level":"info","msg":"storing new hash","hash":1226980023,"revision":9919,"compact-revision":9918}
{"level":"info","msg":"compact tree index","revision":9920}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9920,"took":"38.043078ms","hash":1439986907}
{"level":"info","msg":"storing new hash","hash":1439986907,"revision":9920,"compact-revision":9919}
{"level":"info","msg":"compact tree index","revision":9921}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9921,"took":"37.108918ms","hash":492703523}
{"level":"info","msg":"storing new hash","hash":492703523,"revision":9921,"compact-revision":9920}
{"level":"info","msg":"compact tree index","revision":9922}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9922,"took":"38.038564ms","hash":597525889}
{"level":"info","msg":"storing new hash","hash":597525889,"revision":9922,"compact-revision":9921}
{"level":"info","msg":"compact tree index","revision":9923}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9923,"took":"37.480654ms","hash":69856701}
{"level":"info","msg":"storing new hash","hash":69856701,"revision":9923,"compact-revision":9922}
{"level":"info","msg":"compact tree index","revision":9924}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9924,"took":"37.161385ms","hash":1578799301}
{"level":"info","msg":"storing new hash","hash":1578799301,"revision":9924,"compact-revision":9923}
{"level":"info","msg":"compact tree index","revision":9925}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9925,"took":"37.993913ms","hash":800180767}
{"level":"info","msg":"storing new hash","hash":800180767,"revision":9925,"compact-revision":9924}
{"level":"info","msg":"compact tree index","revision":9926}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9926,"took":"37.489503ms","hash":292700349}
{"level":"info","msg":"storing new hash","hash":292700349,"revision":9926,"compact-revision":9925}
{"level":"info","msg":"compact tree index","revision":9927}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9927,"took":"37.596499ms","hash":918956161}
{"level":"info","msg":"storing new hash","hash":918956161,"revision":9927,"compact-revision":9926}
{"level":"info","msg":"compact tree index","revision":9928}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9928,"took":"37.824566ms","hash":2769599053}
{"level":"info","msg":"storing new hash","hash":2769599053,"revision":9928,"compact-revision":9927}
{"level":"info","msg":"compact tree index","revision":9929}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9929,"took":"39.38965ms","hash":2021754203}
{"level":"info","msg":"storing new hash","hash":2021754203,"revision":9929,"compact-revision":9928}
{"level":"info","msg":"compact tree index","revision":9930}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9930,"took":"40.007752ms","hash":1040367542}
{"level":"info","msg":"storing new hash","hash":1040367542,"revision":9930,"compact-revision":9929}
{"level":"info","msg":"compact tree index","revision":9931}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9931,"took":"39.483494ms","hash":431413130}
{"level":"info","msg":"storing new hash","hash":431413130,"revision":9931,"compact-revision":9930}
{"level":"info","msg":"compact tree index","revision":9932}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9932,"took":"38.606602ms","hash":2216639981}
{"level":"info","msg":"storing new hash","hash":2216639981,"revision":9932,"compact-revision":9931}
{"level":"info","msg":"compact tree index","revision":9933}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9933,"took":"38.808989ms","hash":4122240823}
{"level":"info","msg":"storing new hash","hash":4122240823,"revision":9933,"compact-revision":9932}
{"level":"info","msg":"compact tree index","revision":9934}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9934,"took":"38.559068ms","hash":216889994}
{"level":"info","msg":"storing new hash","hash":216889994,"revision":9934,"compact-revision":9933}
{"level":"info","msg":"compact tree index","revision":9935}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9935,"took":"39.931832ms","hash":727257782}
{"level":"info","msg":"storing new hash","hash":727257782,"revision":9935,"compact-revision":9934}
{"level":"info","msg":"compact tree index","revision":9936}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9936,"took":"38.992033ms","hash":1941512540}
{"level":"info","msg":"storing new hash","hash":1941512540,"revision":9936,"compact-revision":9935}
{"level":"info","msg":"compact tree index","revision":9937}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9937,"took":"40.052351ms","hash":4089226019}
{"level":"info","msg":"storing new hash","hash":4089226019,"revision":9937,"compact-revision":9936}
{"level":"info","msg":"compact tree index","revision":9938}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9938,"took":"39.876929ms","hash":2151474769}
{"level":"info","msg":"storing new hash","hash":2151474769,"revision":9938,"compact-revision":9937}
{"level":"info","msg":"compact tree index","revision":9939}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9939,"took":"38.000922ms","hash":2810744429}
{"level":"info","msg":"storing new hash","hash":2810744429,"revision":9939,"compact-revision":9938}
{"level":"info","msg":"compact tree index","revision":9940}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9940,"took":"40.154967ms","hash":732857719}
{"level":"info","msg":"storing new hash","hash":732857719,"revision":9940,"compact-revision":9939}
{"level":"info","msg":"compact tree index","revision":9941}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9941,"took":"39.449725ms","hash":1510334381}
{"level":"info","msg":"storing new hash","hash":1510334381,"revision":9941,"compact-revision":9940}
{"level":"info","msg":"compact tree index","revision":9942}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9942,"took":"39.209631ms","hash":1690719503}
{"level":"info","msg":"storing new hash","hash":1690719503,"revision":9942,"compact-revision":9941}
{"level":"info","msg":"compact tree index","revision":9943}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9943,"took":"24.591389ms","hash":1131560243}
{"level":"info","msg":"storing new hash","hash":1131560243,"revision":9943,"compact-revision":9942}
{"level":"info","msg":"compact tree index","revision":9944}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9944,"took":"55.477173ms","hash":1517942576}
{"level":"info","msg":"storing new hash","hash":1517942576,"revision":9944,"compact-revision":9943}
{"level":"info","msg":"compact tree index","revision":9945}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9945,"took":"38.211667ms","hash":2280441894}
{"level":"info","msg":"storing new hash","hash":2280441894,"revision":9945,"compact-revision":9944}
{"level":"info","msg":"compact tree index","revision":9946}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9946,"took":"39.594767ms","hash":3106882180}
{"level":"info","msg":"storing new hash","hash":3106882180,"revision":9946,"compact-revision":9945}
{"level":"info","msg":"compact tree index","revision":9947}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9947,"took":"37.51918ms","hash":2660969144}
{"level":"info","msg":"storing new hash","hash":2660969144,"revision":9947,"compact-revision":9946}
{"level":"info","msg":"compact tree index","revision":9948}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9948,"took":"23.447729ms","hash":1316032271}
{"level":"info","msg":"storing new hash","hash":1316032271,"revision":9948,"compact-revision":9947}
{"level":"info","msg":"compact tree index","revision":9949}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9949,"took":"37.430554ms","hash":1071273429}
{"level":"info","msg":"storing new hash","hash":1071273429,"revision":9949,"compact-revision":9948}
{"level":"info","msg":"compact tree index","revision":9950}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9950,"took":"40.04844ms","hash":2035904312}
{"level":"info","msg":"storing new hash","hash":2035904312,"revision":9950,"compact-revision":9949}
{"level":"info","msg":"compact tree index","revision":9951}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9951,"took":"38.970112ms","hash":1592592132}
{"level":"info","msg":"storing new hash","hash":1592592132,"revision":9951,"compact-revision":9950}
{"level":"info","msg":"compact tree index","revision":9952}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9952,"took":"40.220537ms","hash":251895795}
{"level":"info","msg":"storing new hash","hash":251895795,"revision":9952,"compact-revision":9951}
{"level":"info","msg":"compact tree index","revision":9953}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9953,"took":"39.441269ms","hash":874997598}
{"level":"info","msg":"storing new hash","hash":874997598,"revision":9953,"compact-revision":9952}
{"level":"info","msg":"compact tree index","revision":9954}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9954,"took":"37.44552ms","hash":3447618275}
{"level":"info","msg":"storing new hash","hash":3447618275,"revision":9954,"compact-revision":9953}
{"level":"info","msg":"compact tree index","revision":9955}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9955,"took":"38.924624ms","hash":3939111647}
{"level":"info","msg":"storing new hash","hash":3939111647,"revision":9955,"compact-revision":9954}
{"level":"info","msg":"compact tree index","revision":9956}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9956,"took":"39.186731ms","hash":2003040440}
{"level":"info","msg":"storing new hash","hash":2003040440,"revision":9956,"compact-revision":9955}
{"level":"info","msg":"compact tree index","revision":9957}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9957,"took":"37.946538ms","hash":113812066}
{"level":"info","msg":"storing new hash","hash":113812066,"revision":9957,"compact-revision":9956}
{"level":"info","msg":"compact tree index","revision":9958}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9958,"took":"38.518906ms","hash":1967712016}
{"level":"info","msg":"storing new hash","hash":1967712016,"revision":9958,"compact-revision":9957}
{"level":"info","msg":"compact tree index","revision":9959}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9959,"took":"39.858969ms","hash":1392283436}
{"level":"info","msg":"storing new hash","hash":1392283436,"revision":9959,"compact-revision":9958}
{"level":"info","msg":"compact tree index","revision":9960}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9960,"took":"39.178273ms","hash":3546829457}
{"level":"info","msg":"storing new hash","hash":3546829457,"revision":9960,"compact-revision":9959}
{"level":"info","msg":"compact tree index","revision":9961}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9961,"took":"37.6502ms","hash":251489671}
{"level":"info","msg":"storing new hash","hash":251489671,"revision":9961,"compact-revision":9960}
{"level":"info","msg":"compact tree index","revision":9962}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9962,"took":"39.551539ms","hash":809428773}
{"level":"info","msg":"storing new hash","hash":809428773,"revision":9962,"compact-revision":9961}
{"level":"info","msg":"compact tree index","revision":9963}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9963,"took":"37.710255ms","hash":394956569}
{"level":"info","msg":"storing new hash","hash":394956569,"revision":9963,"compact-revision":9962}
{"level":"info","msg":"compact tree index","revision":9964}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9964,"took":"39.803146ms","hash":1304031841}
{"level":"info","msg":"storing new hash","hash":1304031841,"revision":9964,"compact-revision":9963}
{"level":"info","msg":"compact tree index","revision":9965}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9965,"took":"38.816169ms","hash":1007855803}
{"level":"info","msg":"storing new hash","hash":1007855803,"revision":9965,"compact-revision":9964}
{"level":"info","msg":"compact tree index","revision":9966}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9966,"took":"39.686713ms","hash":47260185}
{"level":"info","msg":"storing new hash","hash":47260185,"revision":9966,"compact-revision":9965}
{"level":"info","msg":"compact tree index","revision":9967}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9967,"took":"38.509201ms","hash":627395109}
{"level":"info","msg":"storing new hash","hash":627395109,"revision":9967,"compact-revision":9966}
{"level":"info","msg":"compact tree index","revision":9968}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9968,"took":"39.902588ms","hash":818329119}
{"level":"info","msg":"storing new hash","hash":818329119,"revision":9968,"compact-revision":9967}
{"level":"info","msg":"compact tree index","revision":9969}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9969,"took":"37.931787ms","hash":2965582944}
{"level":"info","msg":"storing new hash","hash":2965582944,"revision":9969,"compact-revision":9968}
{"level":"info","msg":"compact tree index","revision":9970}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9970,"took":"39.124404ms","hash":4131393165}
{"level":"info","msg":"storing new hash","hash":4131393165,"revision":9970,"compact-revision":9969}
{"level":"info","msg":"compact tree index","revision":9971}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9971,"took":"39.378283ms","hash":3522455217}
{"level":"info","msg":"storing new hash","hash":3522455217,"revision":9971,"compact-revision":9970}
{"level":"info","msg":"compact tree index","revision":9972}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9972,"took":"38.292064ms","hash":1281199318}
{"level":"info","msg":"storing new hash","hash":1281199318,"revision":9972,"compact-revision":9971}
{"level":"info","msg":"compact tree index","revision":9973}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9973,"took":"24.604337ms","hash":1039586828}
{"level":"info","msg":"storing new hash","hash":1039586828,"revision":9973,"compact-revision":9972}
{"level":"info","msg":"compact tree index","revision":9974}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9974,"took":"38.473345ms","hash":3299855281}
{"level":"info","msg":"storing new hash","hash":3299855281,"revision":9974,"compact-revision":9973}
{"level":"info","msg":"compact tree index","revision":9975}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9975,"took":"38.241949ms","hash":3810239373}
{"level":"info","msg":"storing new hash","hash":3810239373,"revision":9975,"compact-revision":9974}
{"level":"info","msg":"compact tree index","revision":9976}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9976,"took":"39.40521ms","hash":1032519313}
{"level":"info","msg":"storing new hash","hash":1032519313,"revision":9976,"compact-revision":9975}
{"level":"info","msg":"compact tree index","revision":9977}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9977,"took":"39.980974ms","hash":3760177543}
{"level":"info","msg":"storing new hash","hash":3760177543,"revision":9977,"compact-revision":9976}
{"level":"info","msg":"compact tree index","revision":9978}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9978,"took":"38.796998ms","hash":2476705013}
{"level":"info","msg":"storing new hash","hash":2476705013,"revision":9978,"compact-revision":9977}
{"level":"info","msg":"compact tree index","revision":9979}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9979,"took":"56.449979ms","hash":3022777545}
{"level":"info","msg":"storing new hash","hash":3022777545,"revision":9979,"compact-revision":9978}
{"level":"info","msg":"compact tree index","revision":9980}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9980,"took":"43.590793ms","hash":2769888363}
{"level":"info","msg":"storing new hash","hash":2769888363,"revision":9980,"compact-revision":9979}
{"level":"info","msg":"compact tree index","revision":9981}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9981,"took":"40.39439ms","hash":3568467633}
{"level":"info","msg":"storing new hash","hash":3568467633,"revision":9981,"compact-revision":9980}
{"level":"info","msg":"compact tree index","revision":9982}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9982,"took":"39.958299ms","hash":3933336595}
{"level":"info","msg":"storing new hash","hash":3933336595,"revision":9982,"compact-revision":9981}
{"level":"info","msg":"compact tree index","revision":9983}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9983,"took":"24.134317ms","hash":3452279855}
{"level":"info","msg":"storing new hash","hash":3452279855,"revision":9983,"compact-revision":9982}
{"level":"info","msg":"compact tree index","revision":9984}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9984,"took":"38.06843ms","hash":4232457539}
{"level":"info","msg":"storing new hash","hash":4232457539,"revision":9984,"compact-revision":9983}
{"level":"info","msg":"compact tree index","revision":9985}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9985,"took":"39.131664ms","hash":3973754021}
{"level":"info","msg":"storing new hash","hash":3973754021,"revision":9985,"compact-revision":9984}
{"level":"info","msg":"compact tree index","revision":9986}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9986,"took":"40.618892ms","hash":3524863495}
{"level":"info","msg":"storing new hash","hash":3524863495,"revision":9986,"compact-revision":9985}
{"level":"info","msg":"compact tree index","revision":9987}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9987,"took":"39.11281ms","hash":4121775675}
{"level":"info","msg":"storing new hash","hash":4121775675,"revision":9987,"compact-revision":9986}
{"level":"info","msg":"compact tree index","revision":9988}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9988,"took":"39.766703ms","hash":625437580}
{"level":"info","msg":"storing new hash","hash":625437580,"revision":9988,"compact-revision":9987}
{"level":"info","msg":"compact tree index","revision":9989}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9989,"took":"38.581062ms","hash":1424765270}
{"level":"info","msg":"storing new hash","hash":1424765270,"revision":9989,"compact-revision":9988}
{"level":"info","msg":"compact tree index","revision":9990}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9990,"took":"39.832066ms","hash":309267387}
{"level":"info","msg":"storing new hash","hash":309267387,"revision":9990,"compact-revision":9989}
{"level":"info","msg":"compact tree index","revision":9991}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9991,"took":"39.830583ms","hash":903570311}
{"level":"info","msg":"storing new hash","hash":903570311,"revision":9991,"compact-revision":9990}
{"level":"info","msg":"compact tree index","revision":9992}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9992,"took":"38.373346ms","hash":3947511451}
{"level":"info","msg":"storing new hash","hash":3947511451,"revision":9992,"compact-revision":9991}
{"level":"info","msg":"compact tree index","revision":9993}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9993,"took":"56.062534ms","hash":920584589}
{"level":"info","msg":"storing new hash","hash":920584589,"revision":9993,"compact-revision":9992}
{"level":"info","msg":"compact tree index","revision":9994}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9994,"took":"37.849921ms","hash":3481672752}
{"level":"info","msg":"storing new hash","hash":3481672752,"revision":9994,"compact-revision":9993}
{"level":"info","msg":"compact tree index","revision":9995}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9995,"took":"38.681113ms","hash":3895620620}
{"level":"info","msg":"storing new hash","hash":3895620620,"revision":9995,"compact-revision":9994}
{"level":"info","msg":"compact tree index","revision":9996}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9996,"took":"38.95543ms","hash":1973132907}
{"level":"info","msg":"storing new hash","hash":1973132907,"revision":9996,"compact-revision":9995}
{"level":"info","msg":"compact tree index","revision":9997}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9997,"took":"39.036076ms","hash":70304945}
{"level":"info","msg":"storing new hash","hash":70304945,"revision":9997,"compact-revision":9996}
{"level":"info","msg":"compact tree index","revision":9998}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9998,"took":"39.463179ms","hash":2008056259}
{"level":"info","msg":"storing new hash","hash":2008056259,"revision":9998,"compact-revision":9997}
{"level":"info","msg":"compact tree index","revision":9999}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9999,"took":"38.159897ms","hash":1342499327}
{"level":"info","msg":"storing new hash","hash":1342499327,"revision":9999,"compact-revision":9998}
{"level":"info","msg":"compact tree index","revision":10000}
{"level":"info","msg":"finished scheduled compaction","compact-revision":10000,"took":"38.984869ms","hash":4044197094}
{"level":"info","msg":"storing new hash","hash":4044197094,"revision":10000,"compact-revision":9999}
--- PASS: TestHashKVWhenCompacting (9.56s)
PASS
```
|
Thanks for the response. Could you also verify whether you can see this issue on v3.5.9 and v3.5.7?
|
on 3.5.9 mvcc passes
yet other test fails(dk if this is relevant, gonna leave logs here anyway)
The result on 3.5.7 is exactly the same |
It seems that configurePeerListeners failed, but unfortunately the error log wasn't printed out. Could you run the test on branch https://github.com/etcd-io/etcd/tree/test_3.5.9? |
do you mean mvcc test or embed? If you meant TestEnableAuth then here its logs:
```
=== RUN TestEnableAuth
{"level":"warn","ts":"2024-01-22T17:20:43.771558+0500","caller":"embed/config.go:673","msg":"Running http and grpc server on single port. This is not recommended for production."}
{"level":"info","ts":"2024-01-22T17:20:43.771704+0500","caller":"embed/etcd.go:127","msg":"configuring peer listeners","listen-peer-urls":["http://localhost:2380"]}
{"level":"info","ts":"2024-01-22T17:20:43.773683+0500","caller":"embed/etcd.go:135","msg":"configuring client listeners","listen-client-urls":["http://localhost:2379"]}
{"level":"info","ts":"2024-01-22T17:20:43.774113+0500","caller":"embed/etcd.go:309","msg":"starting an etcd server","etcd-version":"3.5.9","git-sha":"Not provided (use ./build instead of go build)","go-version":"go1.21.3","go-os":"darwin","go-arch":"amd64","max-cpu-set":12,"max-cpu-available":12,"member-initialized":false,"name":"default","data-dir":"/var/folders/82/0hky4sf567l1n8vzb310vftj0822br/T/auth-test1987866872","wal-dir":"","wal-dir-dedicated":"","member-dir":"/var/folders/82/0hky4sf567l1n8vzb310vftj0822br/T/auth-test1987866872/member","force-new-cluster":false,"heartbeat-interval":"100ms","election-timeout":"1s","initial-election-tick-advance":true,"snapshot-count":100000,"max-wals":5,"max-snapshots":5,"snapshot-catchup-entries":5000,"initial-advertise-peer-urls":["http://localhost:2380"],"listen-peer-urls":["http://localhost:2380"],"advertise-client-urls":["http://localhost:2379"],"listen-client-urls":["http://localhost:2379"],"listen-metrics-urls":[],"cors":["*"],"host-whitelist":["*"],"initial-cluster":"default=http://localhost:2380","initial-cluster-state":"new","initial-cluster-token":"etcd-cluster","quota-backend-bytes":2147483648,"max-request-bytes":1572864,"max-concurrent-streams":4294967295,"pre-vote":true,"initial-corrupt-check":false,"corrupt-check-time-interval":"0s","compact-check-time-enabled":false,"compact-check-time-interval":"1m0s","auto-compaction-mode":"","auto-compaction-retention":"0s","auto-compaction-interval":"0s","discovery-url":"","discovery-proxy":"","downgrade-check-interval":"5s"}
{"level":"info","ts":"2024-01-22T17:20:43.796911+0500","caller":"etcdserver/backend.go:81","msg":"opened backend db","path":"/var/folders/82/0hky4sf567l1n8vzb310vftj0822br/T/auth-test1987866872/member/snap/db","took":"22.27332ms"}
{"level":"info","ts":"2024-01-22T17:20:43.86723+0500","caller":"etcdserver/raft.go:495","msg":"starting local member","local-member-id":"8e9e05c52164694d","cluster-id":"cdf818194e3a8c32"}
{"level":"info","ts":"2024-01-22T17:20:43.867431+0500","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d switched to configuration voters=()"}
{"level":"info","ts":"2024-01-22T17:20:43.867518+0500","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became follower at term 0"}
{"level":"info","ts":"2024-01-22T17:20:43.867549+0500","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"newRaft 8e9e05c52164694d [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]"}
{"level":"info","ts":"2024-01-22T17:20:43.867574+0500","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became follower at term 1"}
{"level":"info","ts":"2024-01-22T17:20:43.86768+0500","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d switched to configuration voters=(10276657743932975437)"}
{"level":"warn","ts":"2024-01-22T17:20:43.934394+0500","caller":"auth/store.go:1238","msg":"simple token is not cryptographically signed"}
{"level":"info","ts":"2024-01-22T17:20:43.974676+0500","caller":"mvcc/kvstore.go:393","msg":"kvstore restored","current-rev":1}
{"level":"info","ts":"2024-01-22T17:20:44.013173+0500","caller":"etcdserver/quota.go:94","msg":"enabled backend quota with default value","quota-name":"v3-applier","quota-size-bytes":2147483648,"quota-size":"2.1 GB"}
{"level":"info","ts":"2024-01-22T17:20:44.05117+0500","caller":"etcdserver/server.go:854","msg":"starting etcd server","local-member-id":"8e9e05c52164694d","local-server-version":"3.5.9","cluster-version":"to_be_decided"}
{"level":"warn","ts":"2024-01-22T17:20:44.051296+0500","caller":"etcdserver/metrics.go:224","msg":"failed to get file descriptor usage","error":"cannot get FDUsage on darwin"}
{"level":"info","ts":"2024-01-22T17:20:44.051298+0500","caller":"etcdserver/server.go:738","msg":"started as single-node; fast-forwarding election ticks","local-member-id":"8e9e05c52164694d","forward-ticks":9,"forward-duration":"900ms","election-ticks":10,"election-timeout":"1s"}
{"level":"info","ts":"2024-01-22T17:20:44.051389+0500","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/folders/82/0hky4sf567l1n8vzb310vftj0822br/T/auth-test1987866872/member/snap","suffix":"snap.db","max":5,"interval":"30s"}
{"level":"info","ts":"2024-01-22T17:20:44.051451+0500","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/folders/82/0hky4sf567l1n8vzb310vftj0822br/T/auth-test1987866872/member/snap","suffix":"snap","max":5,"interval":"30s"}
{"level":"info","ts":"2024-01-22T17:20:44.051469+0500","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/folders/82/0hky4sf567l1n8vzb310vftj0822br/T/auth-test1987866872/member/wal","suffix":"wal","max":5,"interval":"30s"}
{"level":"info","ts":"2024-01-22T17:20:44.053673+0500","caller":"embed/etcd.go:278","msg":"now serving peer/client/metrics","local-member-id":"8e9e05c52164694d","initial-advertise-peer-urls":["http://localhost:2380"],"listen-peer-urls":["http://localhost:2380"],"advertise-client-urls":["http://localhost:2379"],"listen-client-urls":["http://localhost:2379"],"listen-metrics-urls":[]}
{"level":"info","ts":"2024-01-22T17:20:44.05372+0500","caller":"embed/etcd.go:598","msg":"serving peer traffic","address":"127.0.0.1:2380"}
{"level":"info","ts":"2024-01-22T17:20:44.053745+0500","caller":"embed/etcd.go:570","msg":"cmux::serve","address":"127.0.0.1:2380"}
{"level":"info","ts":"2024-01-22T17:20:44.070517+0500","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d switched to configuration voters=(10276657743932975437)"}
{"level":"info","ts":"2024-01-22T17:20:44.070675+0500","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"cdf818194e3a8c32","local-member-id":"8e9e05c52164694d","added-peer-id":"8e9e05c52164694d","added-peer-peer-urls":["http://localhost:2380"]}
{"level":"info","ts":"2024-01-22T17:20:44.669392+0500","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d is starting a new election at term 1"}
{"level":"info","ts":"2024-01-22T17:20:44.669483+0500","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became pre-candidate at term 1"}
{"level":"info","ts":"2024-01-22T17:20:44.669531+0500","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d received MsgPreVoteResp from 8e9e05c52164694d at term 1"}
{"level":"info","ts":"2024-01-22T17:20:44.669611+0500","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became candidate at term 2"}
{"level":"info","ts":"2024-01-22T17:20:44.66963+0500","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d received MsgVoteResp from 8e9e05c52164694d at term 2"}
{"level":"info","ts":"2024-01-22T17:20:44.66965+0500","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became leader at term 2"}
{"level":"info","ts":"2024-01-22T17:20:44.669675+0500","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: 8e9e05c52164694d elected leader 8e9e05c52164694d at term 2"}
{"level":"info","ts":"2024-01-22T17:20:44.690901+0500","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-01-22T17:20:44.690998+0500","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"8e9e05c52164694d","local-member-attributes":"{Name:default ClientURLs:[http://localhost:2379]}","request-path":"/0/members/8e9e05c52164694d/attributes","cluster-id":"cdf818194e3a8c32","publish-timeout":"7s"}
{"level":"info","ts":"2024-01-22T17:20:44.691015+0500","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-01-22T17:20:44.691772+0500","caller":"embed/serve.go:187","msg":"serving client traffic insecurely; this is strongly discouraged!","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-01-22T17:20:44.709374+0500","caller":"auth/store.go:769","msg":"created a role","role-name":"root"}
{"level":"info","ts":"2024-01-22T17:20:44.727184+0500","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"cdf818194e3a8c32","local-member-id":"8e9e05c52164694d","cluster-version":"3.5"}
{"level":"info","ts":"2024-01-22T17:20:44.727268+0500","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-01-22T17:20:44.727297+0500","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-01-22T17:20:44.790475+0500","caller":"auth/store.go:435","msg":"added a user","user-name":"root"}
{"level":"info","ts":"2024-01-22T17:20:44.850474+0500","caller":"auth/store.go:548","msg":"granted a role to a user","user-name":"root","user-roles":["root"],"added-role-name":"root"}
{"level":"info","ts":"2024-01-22T17:20:44.870692+0500","caller":"auth/store.go:257","msg":"enabled authentication"}
{"level":"info","ts":"2024-01-22T17:20:44.909353+0500","caller":"embed/etcd.go:376","msg":"closing etcd server","name":"default","data-dir":"/var/folders/82/0hky4sf567l1n8vzb310vftj0822br/T/auth-test1987866872","advertise-peer-urls":["http://localhost:2380"],"advertise-client-urls":["http://localhost:2379"]}
{"level":"warn","ts":"2024-01-22T17:20:44.909442+0500","caller":"embed/serve.go:160","msg":"stopping insecure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}
{"level":"warn","ts":"2024-01-22T17:20:44.909515+0500","caller":"embed/serve.go:162","msg":"stopped insecure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}
{"level":"info","ts":"2024-01-22T17:20:44.909543+0500","caller":"etcdserver/server.go:1465","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"8e9e05c52164694d","current-leader-member-id":"8e9e05c52164694d"}
{"level":"info","ts":"2024-01-22T17:20:44.979785+0500","caller":"embed/etcd.go:580","msg":"stopping serving peer traffic","address":"127.0.0.1:2380"}
{"level":"info","ts":"2024-01-22T17:20:44.979874+0500","caller":"embed/etcd.go:585","msg":"stopped serving peer traffic","address":"127.0.0.1:2380"}
{"level":"info","ts":"2024-01-22T17:20:44.979895+0500","caller":"embed/etcd.go:378","msg":"closed etcd server","name":"default","data-dir":"/var/folders/82/0hky4sf567l1n8vzb310vftj0822br/T/auth-test1987866872","advertise-peer-urls":["http://localhost:2380"],"advertise-client-urls":["http://localhost:2379"]}
--- PASS: TestEnableAuth (1.21s)
PASS
```
If you meant TestHashKVWhenCompacting:
```
=== RUN TestHashKVWhenCompacting
{"level":"info","msg":"kvstore restored","current-rev":1}
{"level":"info","msg":"compact tree index","revision":9899}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9899,"took":"767.404567ms","hash":2463323419}
{"level":"info","msg":"storing new hash","hash":2463323419,"revision":9899,"compact-revision":-1}
{"level":"info","msg":"compact tree index","revision":9900}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9900,"took":"552.393µs","hash":2187321635}
{"level":"info","msg":"storing new hash","hash":2187321635,"revision":9900,"compact-revision":9899}
{"level":"info","msg":"compact tree index","revision":9901}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9901,"took":"39.626187ms","hash":4092902393}
{"level":"info","msg":"storing new hash","hash":4092902393,"revision":9901,"compact-revision":9900}
{"level":"info","msg":"compact tree index","revision":9902}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9902,"took":"22.322µs","hash":3442946395}
{"level":"info","msg":"storing new hash","hash":3442946395,"revision":9902,"compact-revision":9901}
{"level":"info","msg":"compact tree index","revision":9903}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9903,"took":"39.049402ms","hash":3934476647}
{"level":"info","msg":"storing new hash","hash":3934476647,"revision":9903,"compact-revision":9902}
{"level":"info","msg":"compact tree index","revision":9904}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9904,"took":"323.328µs","hash":1979317650}
{"level":"info","msg":"storing new hash","hash":1979317650,"revision":9904,"compact-revision":9903}
{"level":"info","msg":"compact tree index","revision":9905}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9905,"took":"252.654µs","hash":4126965741}
{"level":"info","msg":"storing new hash","hash":4126965741,"revision":9905,"compact-revision":9904}
{"level":"info","msg":"compact tree index","revision":9906}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9906,"took":"208.412µs","hash":3409966415}
{"level":"info","msg":"storing new hash","hash":3409966415,"revision":9906,"compact-revision":9905}
{"level":"info","msg":"compact tree index","revision":9907}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9907,"took":"195.204µs","hash":3968572787}
{"level":"info","msg":"storing new hash","hash":3968572787,"revision":9907,"compact-revision":9906}
{"level":"info","msg":"compact tree index","revision":9908}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9908,"took":"179.669µs","hash":1013037252}
{"level":"info","msg":"storing new hash","hash":1013037252,"revision":9908,"compact-revision":9907}
{"level":"info","msg":"compact tree index","revision":9909}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9909,"took":"177.709µs","hash":1305141790}
{"level":"info","msg":"storing new hash","hash":1305141790,"revision":9909,"compact-revision":9908}
{"level":"info","msg":"compact tree index","revision":9910}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9910,"took":"36.682µs","hash":189389043}
{"level":"info","msg":"storing new hash","hash":189389043,"revision":9910,"compact-revision":9909}
{"level":"info","msg":"compact tree index","revision":9911}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9911,"took":"24.595µs","hash":754823375}
{"level":"info","msg":"storing new hash","hash":754823375,"revision":9911,"compact-revision":9910}
{"level":"info","msg":"compact tree index","revision":9912}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9912,"took":"25.864µs","hash":4067225043}
{"level":"info","msg":"storing new hash","hash":4067225043,"revision":9912,"compact-revision":9911}
{"level":"info","msg":"compact tree index","revision":9913}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9913,"took":"24.663µs","hash":804901573}
{"level":"info","msg":"storing new hash","hash":804901573,"revision":9913,"compact-revision":9912}
{"level":"info","msg":"compact tree index","revision":9914}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9914,"took":"29.164µs","hash":3600863096}
{"level":"info","msg":"storing new hash","hash":3600863096,"revision":9914,"compact-revision":9913}
{"level":"info","msg":"compact tree index","revision":9915}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9915,"took":"42.504µs","hash":4044662596}
{"level":"info","msg":"storing new hash","hash":4044662596,"revision":9915,"compact-revision":9914}
{"level":"info","msg":"compact tree index","revision":9916}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9916,"took":"69.147µs","hash":1824345379}
{"level":"info","msg":"storing new hash","hash":1824345379,"revision":9916,"compact-revision":9915}
{"level":"info","msg":"compact tree index","revision":9917}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9917,"took":"28.639µs","hash":487987193}
{"level":"info","msg":"storing new hash","hash":487987193,"revision":9917,"compact-revision":9916}
{"level":"info","msg":"compact tree index","revision":9918}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9918,"took":"26.397µs","hash":1855345291}
{"level":"info","msg":"storing new hash","hash":1855345291,"revision":9918,"compact-revision":9917}
{"level":"info","msg":"compact tree index","revision":9919}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9919,"took":"146.887µs","hash":1226980023}
{"level":"info","msg":"storing new hash","hash":1226980023,"revision":9919,"compact-revision":9918}
{"level":"info","msg":"compact tree index","revision":9920}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9920,"took":"35.512µs","hash":1439986907}
{"level":"info","msg":"storing new hash","hash":1439986907,"revision":9920,"compact-revision":9919}
{"level":"info","msg":"compact tree index","revision":9921}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9921,"took":"42.014µs","hash":492703523}
{"level":"info","msg":"storing new hash","hash":492703523,"revision":9921,"compact-revision":9920}
{"level":"info","msg":"compact tree index","revision":9922}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9922,"took":"46.973µs","hash":597525889}
{"level":"info","msg":"storing new hash","hash":597525889,"revision":9922,"compact-revision":9921}
{"level":"info","msg":"compact tree index","revision":9923}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9923,"took":"22.493µs","hash":69856701}
{"level":"info","msg":"storing new hash","hash":69856701,"revision":9923,"compact-revision":9922}
{"level":"info","msg":"compact tree index","revision":9924}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9924,"took":"25.666µs","hash":1578799301}
{"level":"info","msg":"storing new hash","hash":1578799301,"revision":9924,"compact-revision":9923}
{"level":"info","msg":"compact tree index","revision":9925}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9925,"took":"22.856µs","hash":800180767}
{"level":"info","msg":"storing new hash","hash":800180767,"revision":9925,"compact-revision":9924}
{"level":"info","msg":"compact tree index","revision":9926}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9926,"took":"65.212µs","hash":292700349}
{"level":"info","msg":"storing new hash","hash":292700349,"revision":9926,"compact-revision":9925}
{"level":"info","msg":"compact tree index","revision":9927}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9927,"took":"76.464µs","hash":918956161}
{"level":"info","msg":"storing new hash","hash":918956161,"revision":9927,"compact-revision":9926}
{"level":"info","msg":"compact tree index","revision":9928}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9928,"took":"72.386µs","hash":2769599053}
{"level":"info","msg":"storing new hash","hash":2769599053,"revision":9928,"compact-revision":9927}
{"level":"info","msg":"compact tree index","revision":9929}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9929,"took":"23.596µs","hash":2021754203}
{"level":"info","msg":"storing new hash","hash":2021754203,"revision":9929,"compact-revision":9928}
{"level":"info","msg":"compact tree index","revision":9930}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9930,"took":"75.085µs","hash":1040367542}
{"level":"info","msg":"storing new hash","hash":1040367542,"revision":9930,"compact-revision":9929}
{"level":"info","msg":"compact tree index","revision":9931}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9931,"took":"26.373µs","hash":431413130}
{"level":"info","msg":"storing new hash","hash":431413130,"revision":9931,"compact-revision":9930}
{"level":"info","msg":"compact tree index","revision":9932}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9932,"took":"30.062µs","hash":2216639981}
{"level":"info","msg":"storing new hash","hash":2216639981,"revision":9932,"compact-revision":9931}
{"level":"info","msg":"compact tree index","revision":9933}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9933,"took":"65.148µs","hash":4122240823}
{"level":"info","msg":"storing new hash","hash":4122240823,"revision":9933,"compact-revision":9932}
{"level":"info","msg":"compact tree index","revision":9934}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9934,"took":"37.8µs","hash":216889994}
{"level":"info","msg":"storing new hash","hash":216889994,"revision":9934,"compact-revision":9933}
{"level":"info","msg":"compact tree index","revision":9935}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9935,"took":"29.307µs","hash":727257782}
{"level":"info","msg":"storing new hash","hash":727257782,"revision":9935,"compact-revision":9934}
{"level":"info","msg":"compact tree index","revision":9936}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9936,"took":"26.764µs","hash":1941512540}
{"level":"info","msg":"storing new hash","hash":1941512540,"revision":9936,"compact-revision":9935}
{"level":"info","msg":"compact tree index","revision":9937}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9937,"took":"27.903µs","hash":4089226019}
{"level":"info","msg":"storing new hash","hash":4089226019,"revision":9937,"compact-revision":9936}
{"level":"info","msg":"compact tree index","revision":9938}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9938,"took":"32.557µs","hash":2151474769}
{"level":"info","msg":"storing new hash","hash":2151474769,"revision":9938,"compact-revision":9937}
{"level":"info","msg":"compact tree index","revision":9939}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9939,"took":"48.246µs","hash":2810744429}
{"level":"info","msg":"storing new hash","hash":2810744429,"revision":9939,"compact-revision":9938}
{"level":"info","msg":"compact tree index","revision":9940}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9940,"took":"26.572µs","hash":732857719}
{"level":"info","msg":"storing new hash","hash":732857719,"revision":9940,"compact-revision":9939}
{"level":"info","msg":"compact tree index","revision":9941}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9941,"took":"19.579µs","hash":1510334381}
{"level":"info","msg":"storing new hash","hash":1510334381,"revision":9941,"compact-revision":9940}
{"level":"info","msg":"compact tree index","revision":9942}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9942,"took":"19.391µs","hash":1690719503}
{"level":"info","msg":"storing new hash","hash":1690719503,"revision":9942,"compact-revision":9941}
{"level":"info","msg":"compact tree index","revision":9943}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9943,"took":"27.395µs","hash":1131560243}
{"level":"info","msg":"storing new hash","hash":1131560243,"revision":9943,"compact-revision":9942}
{"level":"info","msg":"compact tree index","revision":9944}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9944,"took":"47.095µs","hash":1517942576}
{"level":"info","msg":"storing new hash","hash":1517942576,"revision":9944,"compact-revision":9943}
{"level":"info","msg":"compact tree index","revision":9945}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9945,"took":"40.192µs","hash":2280441894}
{"level":"info","msg":"storing new hash","hash":2280441894,"revision":9945,"compact-revision":9944}
{"level":"info","msg":"compact tree index","revision":9946}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9946,"took":"41.015µs","hash":3106882180}
{"level":"info","msg":"storing new hash","hash":3106882180,"revision":9946,"compact-revision":9945}
{"level":"info","msg":"compact tree index","revision":9947}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9947,"took":"26.637µs","hash":2660969144}
{"level":"info","msg":"storing new hash","hash":2660969144,"revision":9947,"compact-revision":9946}
{"level":"info","msg":"compact tree index","revision":9948}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9948,"took":"31.553µs","hash":1316032271}
{"level":"info","msg":"storing new hash","hash":1316032271,"revision":9948,"compact-revision":9947}
{"level":"info","msg":"compact tree index","revision":9949}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9949,"took":"19.857µs","hash":1071273429}
{"level":"info","msg":"storing new hash","hash":1071273429,"revision":9949,"compact-revision":9948}
{"level":"info","msg":"compact tree index","revision":9950}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9950,"took":"24.496µs","hash":2035904312}
{"level":"info","msg":"storing new hash","hash":2035904312,"revision":9950,"compact-revision":9949}
{"level":"info","msg":"compact tree index","revision":9951}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9951,"took":"28.578µs","hash":1592592132}
{"level":"info","msg":"storing new hash","hash":1592592132,"revision":9951,"compact-revision":9950}
{"level":"info","msg":"compact tree index","revision":9952}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9952,"took":"30.78µs","hash":251895795}
{"level":"info","msg":"storing new hash","hash":251895795,"revision":9952,"compact-revision":9951}
{"level":"info","msg":"compact tree index","revision":9953}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9953,"took":"235.466µs","hash":874997598}
{"level":"info","msg":"storing new hash","hash":874997598,"revision":9953,"compact-revision":9952}
{"level":"info","msg":"compact tree index","revision":9954}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9954,"took":"18.607µs","hash":3447618275}
{"level":"info","msg":"storing new hash","hash":3447618275,"revision":9954,"compact-revision":9953}
{"level":"info","msg":"compact tree index","revision":9955}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9955,"took":"19.46µs","hash":3939111647}
{"level":"info","msg":"storing new hash","hash":3939111647,"revision":9955,"compact-revision":9954}
{"level":"info","msg":"compact tree index","revision":9956}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9956,"took":"20.202µs","hash":2003040440}
{"level":"info","msg":"storing new hash","hash":2003040440,"revision":9956,"compact-revision":9955}
{"level":"info","msg":"compact tree index","revision":9957}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9957,"took":"19.222µs","hash":113812066}
{"level":"info","msg":"storing new hash","hash":113812066,"revision":9957,"compact-revision":9956}
{"level":"info","msg":"compact tree index","revision":9958}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9958,"took":"40.753µs","hash":1967712016}
{"level":"info","msg":"storing new hash","hash":1967712016,"revision":9958,"compact-revision":9957}
{"level":"info","msg":"compact tree index","revision":9959}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9959,"took":"72.169µs","hash":1392283436}
{"level":"info","msg":"storing new hash","hash":1392283436,"revision":9959,"compact-revision":9958}
{"level":"info","msg":"compact tree index","revision":9960}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9960,"took":"29.04µs","hash":3546829457}
{"level":"info","msg":"storing new hash","hash":3546829457,"revision":9960,"compact-revision":9959}
{"level":"info","msg":"compact tree index","revision":9961}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9961,"took":"32.254µs","hash":251489671}
{"level":"info","msg":"storing new hash","hash":251489671,"revision":9961,"compact-revision":9960}
{"level":"info","msg":"compact tree index","revision":9962}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9962,"took":"18.655µs","hash":809428773}
{"level":"info","msg":"storing new hash","hash":809428773,"revision":9962,"compact-revision":9961}
{"level":"info","msg":"compact tree index","revision":9963}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9963,"took":"20.374µs","hash":394956569}
{"level":"info","msg":"storing new hash","hash":394956569,"revision":9963,"compact-revision":9962}
{"level":"info","msg":"compact tree index","revision":9964}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9964,"took":"41.621µs","hash":1304031841}
{"level":"info","msg":"storing new hash","hash":1304031841,"revision":9964,"compact-revision":9963}
{"level":"info","msg":"compact tree index","revision":9965}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9965,"took":"25.378µs","hash":1007855803}
{"level":"info","msg":"storing new hash","hash":1007855803,"revision":9965,"compact-revision":9964}
{"level":"info","msg":"compact tree index","revision":9966}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9966,"took":"44.72µs","hash":47260185}
{"level":"info","msg":"storing new hash","hash":47260185,"revision":9966,"compact-revision":9965}
{"level":"info","msg":"compact tree index","revision":9967}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9967,"took":"76.281µs","hash":627395109}
{"level":"info","msg":"storing new hash","hash":627395109,"revision":9967,"compact-revision":9966}
{"level":"info","msg":"compact tree index","revision":9968}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9968,"took":"28.019µs","hash":818329119}
{"level":"info","msg":"storing new hash","hash":818329119,"revision":9968,"compact-revision":9967}
{"level":"info","msg":"compact tree index","revision":9969}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9969,"took":"46.605µs","hash":2965582944}
{"level":"info","msg":"storing new hash","hash":2965582944,"revision":9969,"compact-revision":9968}
{"level":"info","msg":"compact tree index","revision":9970}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9970,"took":"30.333µs","hash":4131393165}
{"level":"info","msg":"storing new hash","hash":4131393165,"revision":9970,"compact-revision":9969}
{"level":"info","msg":"compact tree index","revision":9971}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9971,"took":"28.535µs","hash":3522455217}
{"level":"info","msg":"storing new hash","hash":3522455217,"revision":9971,"compact-revision":9970}
{"level":"info","msg":"compact tree index","revision":9972}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9972,"took":"28.588µs","hash":1281199318}
{"level":"info","msg":"storing new hash","hash":1281199318,"revision":9972,"compact-revision":9971}
{"level":"info","msg":"compact tree index","revision":9973}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9973,"took":"23.901µs","hash":1039586828}
{"level":"info","msg":"storing new hash","hash":1039586828,"revision":9973,"compact-revision":9972}
{"level":"info","msg":"compact tree index","revision":9974}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9974,"took":"20.51µs","hash":3299855281}
{"level":"info","msg":"storing new hash","hash":3299855281,"revision":9974,"compact-revision":9973}
{"level":"info","msg":"compact tree index","revision":9975}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9975,"took":"70.638µs","hash":3810239373}
{"level":"info","msg":"storing new hash","hash":3810239373,"revision":9975,"compact-revision":9974}
{"level":"info","msg":"compact tree index","revision":9976}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9976,"took":"56.244µs","hash":1032519313}
{"level":"info","msg":"storing new hash","hash":1032519313,"revision":9976,"compact-revision":9975}
{"level":"info","msg":"compact tree index","revision":9977}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9977,"took":"41.898µs","hash":3760177543}
{"level":"info","msg":"storing new hash","hash":3760177543,"revision":9977,"compact-revision":9976}
{"level":"info","msg":"compact tree index","revision":9978}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9978,"took":"25.664µs","hash":2476705013}
{"level":"info","msg":"storing new hash","hash":2476705013,"revision":9978,"compact-revision":9977}
{"level":"info","msg":"compact tree index","revision":9979}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9979,"took":"41.915µs","hash":3022777545}
{"level":"info","msg":"storing new hash","hash":3022777545,"revision":9979,"compact-revision":9978}
{"level":"info","msg":"compact tree index","revision":9980}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9980,"took":"36.512µs","hash":2769888363}
{"level":"info","msg":"storing new hash","hash":2769888363,"revision":9980,"compact-revision":9979}
{"level":"info","msg":"compact tree index","revision":9981}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9981,"took":"22.605µs","hash":3568467633}
{"level":"info","msg":"storing new hash","hash":3568467633,"revision":9981,"compact-revision":9980}
{"level":"info","msg":"compact tree index","revision":9982}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9982,"took":"25.066µs","hash":3933336595}
{"level":"info","msg":"storing new hash","hash":3933336595,"revision":9982,"compact-revision":9981}
{"level":"info","msg":"compact tree index","revision":9983}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9983,"took":"55.061µs","hash":3452279855}
{"level":"info","msg":"storing new hash","hash":3452279855,"revision":9983,"compact-revision":9982}
{"level":"info","msg":"compact tree index","revision":9984}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9984,"took":"49.356µs","hash":4232457539}
{"level":"info","msg":"storing new hash","hash":4232457539,"revision":9984,"compact-revision":9983}
{"level":"info","msg":"compact tree index","revision":9985}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9985,"took":"22.695µs","hash":3973754021}
{"level":"info","msg":"storing new hash","hash":3973754021,"revision":9985,"compact-revision":9984}
{"level":"info","msg":"compact tree index","revision":9986}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9986,"took":"46.631µs","hash":3524863495}
{"level":"info","msg":"storing new hash","hash":3524863495,"revision":9986,"compact-revision":9985}
{"level":"info","msg":"compact tree index","revision":9987}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9987,"took":"29.964µs","hash":4121775675}
{"level":"info","msg":"storing new hash","hash":4121775675,"revision":9987,"compact-revision":9986}
{"level":"info","msg":"compact tree index","revision":9988}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9988,"took":"34.301µs","hash":625437580}
{"level":"info","msg":"storing new hash","hash":625437580,"revision":9988,"compact-revision":9987}
{"level":"info","msg":"compact tree index","revision":9989}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9989,"took":"21.713µs","hash":1424765270}
{"level":"info","msg":"storing new hash","hash":1424765270,"revision":9989,"compact-revision":9988}
{"level":"info","msg":"compact tree index","revision":9990}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9990,"took":"22.821µs","hash":309267387}
{"level":"info","msg":"storing new hash","hash":309267387,"revision":9990,"compact-revision":9989}
{"level":"info","msg":"compact tree index","revision":9991}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9991,"took":"32.931µs","hash":903570311}
{"level":"info","msg":"storing new hash","hash":903570311,"revision":9991,"compact-revision":9990}
{"level":"info","msg":"compact tree index","revision":9992}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9992,"took":"17.13µs","hash":3947511451}
{"level":"info","msg":"storing new hash","hash":3947511451,"revision":9992,"compact-revision":9991}
{"level":"info","msg":"compact tree index","revision":9993}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9993,"took":"23.487µs","hash":920584589}
{"level":"info","msg":"storing new hash","hash":920584589,"revision":9993,"compact-revision":9992}
{"level":"info","msg":"compact tree index","revision":9994}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9994,"took":"27.991µs","hash":3481672752}
{"level":"info","msg":"storing new hash","hash":3481672752,"revision":9994,"compact-revision":9993}
{"level":"info","msg":"compact tree index","revision":9995}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9995,"took":"20.165µs","hash":3895620620}
{"level":"info","msg":"storing new hash","hash":3895620620,"revision":9995,"compact-revision":9994}
{"level":"info","msg":"compact tree index","revision":9996}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9996,"took":"38.049µs","hash":1973132907}
{"level":"info","msg":"storing new hash","hash":1973132907,"revision":9996,"compact-revision":9995}
{"level":"info","msg":"compact tree index","revision":9997}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9997,"took":"20.264µs","hash":70304945}
{"level":"info","msg":"storing new hash","hash":70304945,"revision":9997,"compact-revision":9996}
{"level":"info","msg":"compact tree index","revision":9998}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9998,"took":"22.684µs","hash":2008056259}
{"level":"info","msg":"storing new hash","hash":2008056259,"revision":9998,"compact-revision":9997}
{"level":"info","msg":"compact tree index","revision":9999}
{"level":"info","msg":"finished scheduled compaction","compact-revision":9999,"took":"30.598µs","hash":1342499327}
{"level":"info","msg":"storing new hash","hash":1342499327,"revision":9999,"compact-revision":9998}
--- PASS: TestHashKVWhenCompacting (5.99s)
PASS
```
|
I mean |
All tests passed on test_3.5.9 branch
```
TEST_OPTS: PASSES='unit'
log-file: test-MTcwNTkyNjIyNgo.log
PASSES='unit' ./test.sh 2>&1 | tee test-MTcwNTkyNjIyNgo.log
Running with --race
Starting at: Mon Jan 22 17:23:47 +05 2024
'unit' started at Mon Jan 22 17:23:47 +05 2024
|
It's a little strange. I did not change anything, I just added some more debug log in test_3.5.9 branch on top of v3.5.9. How was the error in #17232 (comment) generated? |
I used The problem with mvcc on the main branch stays though. Also tried to rerun unit test and it failed |
Right, test-unit was added since 3.5.10. Sorry for the confusion. In order to avoid misunderstanding, could you run command below on 3.5.7, 3.5.8 and 3.5.9 ?
and run command below on v3.5.10, v3.5.11, release-3.5 and main?
|
results after running on 3.5.7: verification failed
3.5.8: verification failed
3.5.9: verification failed``` {"level":"warn","ts":"2024-01-24T16:37:25.292845+0500","caller":"embed/config.go:673","msg":"Running http and grpc server on single port. This is not recommended for production."} {"level":"info","ts":"2024-01-24T16:37:25.293058+0500","caller":"embed/etcd.go:127","msg":"configuring peer listeners","listen-peer-urls":["http://localhost:2380"]} {"level":"info","ts":"2024-01-24T16:37:25.294901+0500","caller":"embed/etcd.go:376","msg":"closing etcd server","name":"default","data-dir":"/var/folders/82/0hky4sf567l1n8vzb310vftj0822br/T/auth-test1495128825","advertise-peer-urls":["http://localhost:2380"],"advertise-client-urls":["http://localhost:2379"]} {"level":"info","ts":"2024-01-24T16:37:25.294961+0500","caller":"embed/etcd.go:378","msg":"closed etcd server","name":"default","data-dir":"/var/folders/82/0hky4sf567l1n8vzb310vftj0822br/T/auth-test1495128825","advertise-peer-urls":["http://localhost:2380"],"advertise-client-urls":["http://localhost:2379"]} {"level":"info","ts":"2024-01-24T16:37:25.29501+0500","caller":"verify/verify.go:57","msg":"verification of persisted state","data-dir":"/var/folders/82/0hky4sf567l1n8vzb310vftj0822br/T/auth-test1495128825"} {"level":"panic","ts":"2024-01-24T16:37:25.295111+0500","caller":"backend/backend.go:189","msg":"failed to open database","path":"/var/folders/82/0hky4sf567l1n8vzb310vftj0822br/T/auth-test1495128825/member/snap/db","error":"open /var/folders/82/0hky4sf567l1n8vzb310vftj0822br/T/auth-test1495128825/member/snap/db: no such file or directory","stacktrace":"go.etcd.io/etcd/server/v3/mvcc/backend.newBackend\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/mvcc/backend/backend.go:189\ngo.etcd.io/etcd/server/v3/mvcc/backend.New\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/mvcc/backend/backend.go:163\ngo.etcd.io/etcd/server/v3/verify.Verify\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/verify/verify.go:76\ngo.etcd.io/etcd/server/v3/verify.VerifyIfEnabled\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/verify/verify.go:94\ngo.etcd.io/etcd/server/v3/verify.MustVerifyIfEnabled\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/verify/verify.go:103\ngo.etcd.io/etcd/server/v3/embed.(*Etcd).Close.func1\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/embed/etcd.go:379\ngo.etcd.io/etcd/server/v3/embed.(*Etcd).Close\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/embed/etcd.go:439\ngo.etcd.io/etcd/server/v3/embed.StartEtcd.func1\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/embed/etcd.go:116\ngo.etcd.io/etcd/server/v3/embed.StartEtcd\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/embed/etcd.go:132\ngo.etcd.io/etcd/server/v3/embed.TestEnableAuth\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/embed/auth_test.go:34\ntesting.tRunner\n\t/usr/local/opt/go/libexec/src/testing/testing.go:1595"} {"level":"error","ts":"2024-01-24T16:37:25.295279+0500","caller":"verify/verify.go:64","msg":"verification of persisted state failed","data-dir":"/var/folders/82/0hky4sf567l1n8vzb310vftj0822br/T/auth-test1495128825","stacktrace":"go.etcd.io/etcd/server/v3/verify.Verify.func1\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/verify/verify.go:64\nruntime.gopanic\n\t/usr/local/opt/go/libexec/src/runtime/panic.go:920\ngo.uber.org/zap/zapcore.(*CheckedEntry).Write\n\t/Users/kosovgrigorii/go/pkg/mod/go.uber.org/zap@v1.17.0/zapcore/entry.go:234\ngo.uber.org/zap.(*Logger).Panic\n\t/Users/kosovgrigorii/go/pkg/mod/go.uber.org/zap@v1.17.0/logger.go:227\ngo.etcd.io/etcd/server/v3/mvcc/backend.newBackend\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/mvcc/backend/backend.go:189\ngo.etcd.io/etcd/server/v3/mvcc/backend.New\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/mvcc/backend/backend.go:163\ngo.etcd.io/etcd/server/v3/verify.Verify\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/verify/verify.go:76\ngo.etcd.io/etcd/server/v3/verify.VerifyIfEnabled\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/verify/verify.go:94\ngo.etcd.io/etcd/server/v3/verify.MustVerifyIfEnabled\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/verify/verify.go:103\ngo.etcd.io/etcd/server/v3/embed.(*Etcd).Close.func1\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/embed/etcd.go:379\ngo.etcd.io/etcd/server/v3/embed.(*Etcd).Close\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/embed/etcd.go:439\ngo.etcd.io/etcd/server/v3/embed.StartEtcd.func1\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/embed/etcd.go:116\ngo.etcd.io/etcd/server/v3/embed.StartEtcd\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/embed/etcd.go:132\ngo.etcd.io/etcd/server/v3/embed.TestEnableAuth\n\t/Users/kosovgrigorii/Documents/GitHub/etcd/server/embed/auth_test.go:34\ntesting.tRunner\n\t/usr/local/opt/go/libexec/src/testing/testing.go:1595"} --- FAIL: TestEnableAuth (0.00s) panic: failed to open database [recovered] panic: failed to open database [recovered] panic: failed to open databasegoroutine 146 [running]: 3.5.10: Verification failed and bbolt panicking
3.5.11: Verification failed and bbolt panicking
release-3.5: Verification failed & bbolt panicking
main: Panicking
|
tests also failed on test_3.5.9 this time:
|
Thanks @KosovGrigorii for the feedback. There are two issues:
|
Yes, forgot to turn off etcd while running tests, therefore environment issue. Sorry for that On PR everything works great! Thank you |
Thanks for the confirmation. Will close this ticket once #17313 and the backporting PRs get merged. |
Bug report criteria
What happened?
I synced my forked repo with etcd main which added commits b3a5307 db61c96 b3bf59a. After doing this and running unit tests (make test-unit) it fails on go.etcd.io/etcd/server/v3/storage/mvcc (test is called TestHashKVWhenCompacting). However when I run only this specific test everything goes well.
What did you expect to happen?
All unit tests to pass
How can we reproduce it (as minimally and precisely as possible)?
keep repository up to date and run
make test-unit
Anything else we need to know?
before I added these last commits all unit tests passed, I run them in main branch
Etcd version (please run commands below)
Etcd configuration (command line flags or environment variables)
paste your configuration here
Etcd debug information (please run commands below, feel free to obfuscate the IP address or FQDN in the output)
Relevant log output
The text was updated successfully, but these errors were encountered: