Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reward problem in Crawler? #6124

Closed
lyy0095 opened this issue Jun 24, 2024 · 1 comment
Closed

Reward problem in Crawler? #6124

lyy0095 opened this issue Jun 24, 2024 · 1 comment
Labels
bug Issue describes a potential bug in ml-agents.

Comments

@lyy0095
Copy link

lyy0095 commented Jun 24, 2024

I have download the training metrics of Crawler scene from https://huggingface.co/infinitejoy/MLAgents-Crawler/tensorboard .
infinitejoy-MLAgents-Crawler
The Cumulative Reward nearly to 2500 when Episode Length come to 1000, but in the script of Project/Assets/ML-Agents/Examples/Crawler/Scripts/CrawlerAgent.cs,the only AddReward() function was limited to [0, 1] (TouchedTarget() is never used in the whole script), so the biggest reward will be 1000, how can we got 2500?
Is there any other secret AddReward() function I do not recognized?

@lyy0095 lyy0095 added the bug Issue describes a potential bug in ml-agents. label Jun 24, 2024
@lyy0095
Copy link
Author

lyy0095 commented Jul 24, 2024

For any researchers, the reward problem answer is HernandezEduin/Trained-ML-Agents-Actors#1

If you are interested in examples of ML-Agent, I strongly recommend you to read Trained-ML-Agents-Actors.

@lyy0095 lyy0095 closed this as completed Jul 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Issue describes a potential bug in ml-agents.
Projects
None yet
Development

No branches or pull requests

1 participant