Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Check for presence of files at startup #7780

Closed
cduk opened this issue Aug 22, 2024 · 1 comment · Fixed by #9151
Closed

[Feature]: Check for presence of files at startup #7780

cduk opened this issue Aug 22, 2024 · 1 comment · Fixed by #9151

Comments

@cduk
Copy link
Contributor

cduk commented Aug 22, 2024

🚀 The feature, motivation and pitch

Checks for files such as templates etc. should be done right at the start of vLLM loading. Not right at the end after 30 minutes of loading the model.

[rank0]: ValueError: The supplied chat template (./chat_template/llama3.jinja) looks like a file path, but it failed to be opened. Reason: [Errno 2] No such file or directory:

Alternatives

No response

Additional context

No response

@simon-mo
Copy link
Collaborator

Good point. PR welcomed here!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants