Discussions

• 8 You must be logged in to vote

  📣

  repo : upcoming transfer to ggml-org (ETA: Feb 8-9)

  ggerganov announced Feb 4, 2025 in Announcements · Closed

  

  

  1
• 1 You must be logged in to vote

  💬

  Question about unsupported operation by Backend

  akapoor3518 started Feb 4, 2025 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  Can we prepend some header(example: memref) on Tensor data which custom hardware can use to execute Tensor Data

  akapoor3518 asked Jan 31, 2025 in Q&A · Closed · Unanswered

  

  

  7
• 1 You must be logged in to vote

  🙏

  Kronecker product of two ggml_tensor: How to?

  stduhpf asked Jan 26, 2025 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  What is the best way to support 5d tensor (or even higher dimension)?

  randxie asked Jun 1, 2024 in Q&A · Answered

  

  

  

  

  8
• 1 You must be logged in to vote

  🙏

  Would it be a bad idea to move the static inline functions used in internal asserts to the header file?

  stduhpf asked Jan 20, 2025 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Logits largely different from PyTorch

  lancelotblanchard asked Jan 5, 2025 in Q&A · Unanswered

  

  

  9
• 2 You must be logged in to vote

  🙏

  How does GGML syncing work across ggml / llama.cpp / whisper.cpp repos?

  peter277 asked Jan 11, 2025 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Need help porting PyTorch code to GGML

  tbtlr asked Jan 5, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How can I get a subset of a ggml tensor?

  mecccaaa asked Dec 26, 2024 in Q&A · Unanswered

  

  

  2
• 2 You must be logged in to vote

  🙏

  How to convert PyTorch model to gguf and how to write gguf?

  tuna2134 asked Dec 30, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💡

  Limit build to certain quants only

  vladfaust started Dec 6, 2024 in Ideas

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to implement Infinite Context and Attention?

  calebnwokocha asked Nov 18, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to use ggml_mul_mat?

  Ucag asked Oct 30, 2024 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  I try to use ggml matmul together with pytorch. But I fail to use pytorch cudagraph to capture the matmul

  Eutenacity asked Oct 7, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Is there an easy way to port any PyTorch model into GGML?

  Connor56 started Sep 30, 2024 in General

  

  

  1
• 5 You must be logged in to vote

  💬

  When would you use ggml vs llama.cpp?

  lefnire started May 10, 2023 in General

  

  

  

  

  2
• 7 You must be logged in to vote

  🙌

  Huggingface GGUF Editor

  CISC started Sep 1, 2024 in Show and tell

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  low performance of a simple ggml_mul_mat between GGML_TYPE_F16 and GGML_TYPE_Q4_0

  Eutenacity asked Sep 19, 2024 in Q&A · Closed · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Can it be generated into a computational graph, and the corresponding data can be loaded when the node is traversed during the calculation?

  coolling asked Sep 18, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  a dumb question about safety

  teathinker started Sep 8, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  ggml_init() return nullptr error

  walker-ai asked Sep 7, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  View with dynamic parameters

  matscalia asked Sep 3, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to implement this chunk op using ggml_view

  bssrdf asked Aug 20, 2024 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Should permutation by updating ne/nb in-place work?

  awgr asked Aug 2, 2024 in Q&A · Answered

  

  

  3