fix: Resolves HumanEval Inference by replacing task_id with instance_id #4364
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
End-user friendly description of the problem this fixes or functionality that this introduces
This PR resolves an issue in the HumanEval benchmark's
run_infer.py
script where the code incorrectly references a columntask_id
that no longer exists. The correct column isinstance_id
. This fix ensures that the script runs without errors, making it compatible with the latest schema changes.End-user friendly description for the Release Notes:
"Fixes a column reference issue in run_infer.py where task_id was incorrectly used instead of instance_id."
Give a summary of what the PR does, explaining any non-trivial design decisions
This PR refactors the Humaneval benchmark's
run_infer.py
script by replacing all occurrences oftask_id
withinstance_id
to align with the updated column naming convention. No major design changes were made, but the code now references the correct column to avoid attribute errors and ensure smooth execution of the Humaneval benchmark.Link of any specific issues this addresses
This PR addresses issue #4363, where an
AttributeError
occurs because the column name change fromtask_id
toinstance_id
was not consistently applied throughout the file, leading to the error.