Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mixtral crash fix and python bindings v2.2.0 #1931

Merged
merged 6 commits into from
Feb 6, 2024
Merged

Conversation

cebtenzzre
Copy link
Member

* backend: update llama.cpp for Mixtral crash fix

From nomic-ai/llama.cpp@315102f:

We haven't implemented the necessary GPU kernels yet.

Fixes this crash:

ggml_vk_graph_compute: error: unsupported op 'ARGSORT'
GGML_ASSERT: /home/jared/src/forks/gpt4all/gpt4all-backend/llama.cpp-mainline/ggml-kompute.cpp:1508: !"unsupported op"

* python: release bindings version 2.2.0

Among other improvements, we have added support for many new models on CPU because we were able to update our llama.cpp dependency, so it is time to make a new release of the bindings.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
Among other improvements, we have added support for many new models on
CPU because we were able to update our llama.cpp dependency, so it is
time to make a new release of the bindings.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
@cebtenzzre
Copy link
Member Author

cebtenzzre commented Feb 5, 2024

I am currently trying to understand why the Python bindings are not using my GPU.
edit: Resolved by the new commits.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
@cebtenzzre cebtenzzre merged commit bf493bb into main Feb 6, 2024
6 of 17 checks passed
@cebtenzzre cebtenzzre deleted the py-bindings-v2.2.0 branch February 6, 2024 16:01
dpsalvatierra pushed a commit to dpsalvatierra/gpt4all that referenced this pull request Feb 16, 2024
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants