You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I successfully start web UI, but ONNXRuntimeError occurs when I upload a PDF file.
The full log is below:
RuntimeException: [ONNXRuntimeError] : 6 : RUNTIME_EXCEPTION : Non-zero status code returned while running SkipLayerNormalization node. Name:'SkipLayerNorm_AddBias_0' Status Message: /onnxruntime_src/include/onnxruntime/core/framework/op_kernel_context.h:42 const T* onnxruntime::OpKernelContext::Input(int) const [with T = onnxruntime::Tensor] Missing Input: encoder.layer.0.attention.output.LayerNorm.weight
Traceback:
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/scriptrunner/exec_code.py", line 88, in exec_func_with_error_handling
result = func()
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 541, in code_to_exec
self._session_state.on_script_will_rerun(
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/state/safe_session_state.py", line 66, in on_script_will_rerun
self._state.on_script_will_rerun(latest_widget_states)
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py", line 559, in on_script_will_rerun
self._call_callbacks()
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py", line 572, in _call_callbacks
self._new_widget_state.call_callback(wid)
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py", line 273, in call_callback
callback(*args, **kwargs)
File "/data1/RAG/Repos/local-rag/main.py", line 40, in read_and_save_file
st.session_state["assistant"].ingest(file_path)
File "/data1/RAG/Repos/local-rag/rag.py", line 38, in ingest
vector_store = Chroma.from_documents(documents=chunks, embedding=FastEmbedEmbeddings())
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py", line 881, in from_documents
return cls.from_texts(
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py", line 843, in from_texts
chroma_collection.add_texts(texts=texts, metadatas=metadatas, ids=ids)
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py", line 277, in add_texts
embeddings = self._embedding_function.embed_documents(texts)
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/embeddings/fastembed.py", line 120, in embed_documents
return [e.tolist() for e in embeddings]
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/embeddings/fastembed.py", line 120, in
return [e.tolist() for e in embeddings]
File "/data1/RAG/env/lib/python3.10/site-packages/fastembed/text/text_embedding.py", line 107, in embed
yield from self.model.embed(documents, batch_size, parallel, **kwargs)
File "/data1/RAG/env/lib/python3.10/site-packages/fastembed/text/onnx_embedding.py", line 262, in embed
yield from self._embed_documents(
File "/data1/RAG/env/lib/python3.10/site-packages/fastembed/text/onnx_text_model.py", line 118, in _embed_documents
yield from self._post_process_onnx_output(self.onnx_embed(batch))
File "/data1/RAG/env/lib/python3.10/site-packages/fastembed/text/onnx_text_model.py", line 85, in onnx_embed
model_output = self.model.run(self.ONNX_OUTPUT_NAMES, onnx_input)
File "/data1/RAG/env/lib/python3.10/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 266, in run
return self._sess.run(output_names, input_feed, run_options)
Did I miss something? Any help is appreciated, thanks.
The text was updated successfully, but these errors were encountered:
I successfully start web UI, but ONNXRuntimeError occurs when I upload a PDF file.
The full log is below:
RuntimeException: [ONNXRuntimeError] : 6 : RUNTIME_EXCEPTION : Non-zero status code returned while running SkipLayerNormalization node. Name:'SkipLayerNorm_AddBias_0' Status Message: /onnxruntime_src/include/onnxruntime/core/framework/op_kernel_context.h:42 const T* onnxruntime::OpKernelContext::Input(int) const [with T = onnxruntime::Tensor] Missing Input: encoder.layer.0.attention.output.LayerNorm.weight
Traceback:
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/scriptrunner/exec_code.py", line 88, in exec_func_with_error_handling
result = func()
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 541, in code_to_exec
self._session_state.on_script_will_rerun(
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/state/safe_session_state.py", line 66, in on_script_will_rerun
self._state.on_script_will_rerun(latest_widget_states)
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py", line 559, in on_script_will_rerun
self._call_callbacks()
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py", line 572, in _call_callbacks
self._new_widget_state.call_callback(wid)
File "/data1/RAG/env/lib/python3.10/site-packages/streamlit/runtime/state/session_state.py", line 273, in call_callback
callback(*args, **kwargs)
File "/data1/RAG/Repos/local-rag/main.py", line 40, in read_and_save_file
st.session_state["assistant"].ingest(file_path)
File "/data1/RAG/Repos/local-rag/rag.py", line 38, in ingest
vector_store = Chroma.from_documents(documents=chunks, embedding=FastEmbedEmbeddings())
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py", line 881, in from_documents
return cls.from_texts(
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py", line 843, in from_texts
chroma_collection.add_texts(texts=texts, metadatas=metadatas, ids=ids)
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py", line 277, in add_texts
embeddings = self._embedding_function.embed_documents(texts)
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/embeddings/fastembed.py", line 120, in embed_documents
return [e.tolist() for e in embeddings]
File "/data1/RAG/env/lib/python3.10/site-packages/langchain_community/embeddings/fastembed.py", line 120, in
return [e.tolist() for e in embeddings]
File "/data1/RAG/env/lib/python3.10/site-packages/fastembed/text/text_embedding.py", line 107, in embed
yield from self.model.embed(documents, batch_size, parallel, **kwargs)
File "/data1/RAG/env/lib/python3.10/site-packages/fastembed/text/onnx_embedding.py", line 262, in embed
yield from self._embed_documents(
File "/data1/RAG/env/lib/python3.10/site-packages/fastembed/text/onnx_text_model.py", line 118, in _embed_documents
yield from self._post_process_onnx_output(self.onnx_embed(batch))
File "/data1/RAG/env/lib/python3.10/site-packages/fastembed/text/onnx_text_model.py", line 85, in onnx_embed
model_output = self.model.run(self.ONNX_OUTPUT_NAMES, onnx_input)
File "/data1/RAG/env/lib/python3.10/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 266, in run
return self._sess.run(output_names, input_feed, run_options)
Did I miss something? Any help is appreciated, thanks.
The text was updated successfully, but these errors were encountered: