From a8a1dc70818c1253b6524d761510a6ec6df39c07 Mon Sep 17 00:00:00 2001 From: thtrieu Date: Fri, 19 Jan 2024 17:26:19 -0800 Subject: [PATCH] Note on unstable meliad outputs. --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index cc1acef..6ae7289 100644 --- a/README.md +++ b/README.md @@ -307,6 +307,8 @@ please make sure to pass all tests in the prepared test suite: bash run_tests.sh ``` +NOTE: [Issues#14](https://github.com/google-deepmind/alphageometry/issues/14) reports that although the top beam decodes are still the same, the LM is not giving the same score for different users. + Then, pass the corresponding values for `--problem_file` (column) and `--mode` (row), and iterate on all problems to obtain the following results: