Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix evaluation issue when latency unit is spm for iterative dataloader #98

Merged
merged 7 commits into from
Nov 30, 2023

Conversation

xutaima
Copy link
Contributor

@xutaima xutaima commented Nov 29, 2023

No description provided.

@xutaima xutaima requested review from ibanesh and annasun28 November 29, 2023 05:07
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 29, 2023
Copy link
Contributor

@ibanesh ibanesh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

self.instances[index].latency_unit = self.args.eval_latency_unit feels a bit hacky.
Suggested a cleaner way in the comments.

simuleval/evaluator/evaluator.py Outdated Show resolved Hide resolved
simuleval/evaluator/evaluator.py Outdated Show resolved Hide resolved
simuleval/evaluator/instance.py Outdated Show resolved Hide resolved
xutaima and others added 3 commits November 28, 2023 22:55
Co-authored-by: Abinesh Ramakrishnan <3632454+ibanesh@users.noreply.github.com>
Co-authored-by: Abinesh Ramakrishnan <3632454+ibanesh@users.noreply.github.com>
Co-authored-by: Abinesh Ramakrishnan <3632454+ibanesh@users.noreply.github.com>
@xutaima
Copy link
Contributor Author

xutaima commented Nov 29, 2023

self.instances[index].latency_unit = self.args.eval_latency_unit feels a bit hacky. Suggested a cleaner way in the comments.

Thanks! It makes sense

@padentomasello padentomasello self-requested a review November 30, 2023 18:37
@xutaima xutaima merged commit a03d03f into main Nov 30, 2023
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants