Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix Elixir install #147

Merged
merged 1 commit into from
Jul 12, 2024
Merged

Fix Elixir install #147

merged 1 commit into from
Jul 12, 2024

Conversation

mvkvc
Copy link
Contributor

@mvkvc mvkvc commented Jul 8, 2024

Update evaluation/Dockerfile to fix Elixir install errors with solution from #117.

@arjunguha arjunguha mentioned this pull request Jul 8, 2024
13 tasks
@arjunguha
Copy link
Member

I see this is a draft PR. Should I just test it, or does it have a known problem?

@mvkvc mvkvc marked this pull request as ready for review July 9, 2024 12:22
@mvkvc
Copy link
Contributor Author

mvkvc commented Jul 9, 2024

It was because haven't been able to test it yet, spinning up a machine to do it now. If you can do it easily that would be great.

@mvkvc
Copy link
Contributor Author

mvkvc commented Jul 9, 2024

Tested that it works with make all in the evaluations/ folder.

I had to fix errors for the Julia install to get it to work which I replaced with:

RUN curl -fsSL https://install.julialang.org | sh -s -- -y --default-channel 1.8.2 -p /julia-1.8.2
ENV PATH="/julia-1.8.2/bin:${PATH}"

If you run into the same error I can submit a PR for that otherwise this should be good as is.

@arjunguha arjunguha merged commit da68b8a into nuprl:main Jul 12, 2024
@arjunguha
Copy link
Member

Works perfectly, thanks!

I'm going to try to keep benchmark results up to date with newer models. Looks like DeepSeekV2 shows significant improvement on Elixir compared to older models: https://huggingface.co/spaces/nuprl/MultiPL-E

@mvkvc mvkvc deleted the fix_elixir_install branch July 13, 2024 05:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants