Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ONNXRuntimeError] : 6 : RUNTIME_EXCEPTION : Non-zero status code returned while running SkipLayerNormalization node #2

Open
frankyoujian opened this issue Nov 4, 2024 · 0 comments

Comments

@frankyoujian
Copy link

I successfully start web UI, but ONNXRuntimeError occurs when I upload a PDF file.

The full log is below:

RuntimeException: [ONNXRuntimeError] : 6 : RUNTIME_EXCEPTION : Non-zero status code returned while running SkipLayerNormalization node. Name:'SkipLayerNorm_AddBias_0' Status Message: /onnxruntime_src/include/onnxruntime/core/framework/op_kernel_context.h:42 const T* onnxruntime::OpKernelContext::Input(int) const [with T = onnxruntime::Tensor] Missing Input: encoder.layer.0.attention.output.LayerNorm.weight
Traceback:
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/scriptrunner/exec_code.py", line 88, in exec_func_with_error_handling
result = func()
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 541, in code_to_exec
self._session_state.on_script_will_rerun(
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/state/safe_session_state.py", line 66, in on_script_will_rerun
self._state.on_script_will_rerun(latest_widget_states)
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py", line 559, in on_script_will_rerun
self._call_callbacks()
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py", line 572, in _call_callbacks
self._new_widget_state.call_callback(wid)
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py", line 273, in call_callback
callback(*args, **kwargs)
File "/data1/RAG/Repos/local-rag/main.py", line 40, in read_and_save_file
st.session_state["assistant"].ingest(file_path)
File "/data1/RAG/Repos/local-rag/rag.py", line 38, in ingest
vector_store = Chroma.from_documents(documents=chunks, embedding=FastEmbedEmbeddings())
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py", line 881, in from_documents
return cls.from_texts(
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py", line 843, in from_texts
chroma_collection.add_texts(texts=texts, metadatas=metadatas, ids=ids)
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py", line 277, in add_texts
embeddings = self._embedding_function.embed_documents(texts)
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/embeddings/fastembed.py", line 120, in embed_documents
return [e.tolist() for e in embeddings]
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/embeddings/fastembed.py", line 120, in
return [e.tolist() for e in embeddings]
File "/data1/RAG/env/lib/python3.10/site-packages/fastembed/text/text_embedding.py", line 107, in embed
yield from self.model.embed(documents, batch_size, parallel, **kwargs)
File "/data1/RAG/env/lib/python3.10/site-packages/fastembed/text/onnx_embedding.py", line 262, in embed
yield from self._embed_documents(
File "/data1/RAG/env/lib/python3.10/site-packages/fastembed/text/onnx_text_model.py", line 118, in _embed_documents
yield from self._post_process_onnx_output(self.onnx_embed(batch))
File "/data1/RAG/env/lib/python3.10/site-packages/fastembed/text/onnx_text_model.py", line 85, in onnx_embed
model_output = self.model.run(self.ONNX_OUTPUT_NAMES, onnx_input)
File "/data1/RAG/env/lib/python3.10/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 266, in run
return self._sess.run(output_names, input_feed, run_options)

Did I miss something? Any help is appreciated, thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant