Switch from cutechess-cli to fast-chess (II) #2121
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
fixes official-stockfish#2106 This PR switches from cutechess-cli to fast-chess. cutechess-cli has been serving us well in the past years, however, some issues have accumulated, namely the difficulty of compiling cutechess-cli, the observed timeouts at high concurrency and short TC, and e.g. slowness when indexing larger books. fast-chess https://github.com/Disservin/fast-chess has addressed these issues, and has now probably become mature enough to serve as the game manager for fishtest. As an example of its ability to deal with short TC and high concurrency: https://dfts-0.pigazzini.it/tests/view/669249cdbee8253775cede32 with concurrency 25, and TC 1+0.01s no timeouts are observed. fast-chess is built from sources, with the zip download as well as the binary cached as needed. There is fine-grained control over which version of fast-chess is used, so we can easily upgrade for new features. In this PR, fast-chess is built in cutechess compatibility to facilitate integration, and to benefit from the existing fishtest checks. Once validated, we should be able to switch easily to its native mode, which can output trinomial and pentanomial results, and we should be able significantly simplify the worker's book-keeping. Co-Authored-By: Disservin <disservin.social@gmail.com> Co-Authored-By: Gahtan Nahdi <155860115+gahtan-syarif@users.noreply.github.com>
|
@vdbergh you might want to have a careful look at this. |
Fully switch to 'native' fast-chess output, its pentanomial and wld output for every game pair simplies the worker code a lot.
vondele
force-pushed
the
fastchessPRnative
branch
from
74eb211
to
f2e5760
Compare
|
I had a look and everything seems fine. It is more robust that the previous code which - IIRC - relied on the fact that cutechess schedules games in a game pair consecutively to obtain the pentanomial frequencies. The server will reject results with incompatible WLD and pentanomial frequencies (this amounts to checking some equalities and some inequalities). So that is also a good check. |
|
OK, good to know that the server does that check. Yes, in that case, it almost certainly is fine, and I would tend to prefer this PR directly over #2119 ... no need to go in 2 steps. |
|
closing this PR, integrating it directly in #2119 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Alternative to (or continuation on top of) #2119
This takes the transition a step further and uses the capability of fast-chess to output the pentanomials. As a result some of the worker code can be simplified.