Skip to content

Commit

Permalink
Note on unstable meliad outputs.
Browse files Browse the repository at this point in the history
  • Loading branch information
@thtrieu
thtrieu committed Jan 20, 2024
1 parent 82364a7 commit a8a1dc7
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -307,6 +307,8 @@ please make sure to pass all tests in the prepared test suite:
bash run_tests.sh
```

NOTE: [Issues#14](https://github.com/google-deepmind/alphageometry/issues/14) reports that although the top beam decodes are still the same, the LM is not giving the same score for different users.

Then, pass the corresponding values for `--problem_file` (column)
and `--mode` (row), and
iterate on all problems to obtain the following results:
Expand Down

0 comments on commit a8a1dc7

Please sign in to comment.