Skip to content

Issues: kvcache-ai/ktransformers

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

372 Open 172 Closed
372 Open 172 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Feature] SystemError: PY_SSIZE_T_CLEAN macro must be defined for '#' formats
#749 opened Mar 1, 2025 by Binyun-Z
2 tasks
[Feature] Increase Character Limitation in Web UI 增加网页客户端的上下文长度
#744 opened Feb 28, 2025 by 3wweiweiwu
2 tasks done
[Feature] can you guys provide more detailed and accurate installation guide & hardware requirements?
#742 opened Feb 28, 2025 by Fjallraven-hc
2 tasks
@Azure-Tang
3
open-webui链接ktransformers使用deepseek R1，服务端已经在生成数据，但open-webui完全没反应，等很久才有信息
#741 opened Feb 28, 2025 by yizhao1978
1
请教为什么配置512G内存，1张L40s因内存不足运行不了DeepSeek-R1-Q4_K_M
#740 opened Feb 28, 2025 by Longleaves
1 of 5 tasks
1
bash install.sh 报错， [43/54]这里开始出问题
#738 opened Feb 28, 2025 by chrisxxy
1
Speed of weights loading
#736 opened Feb 28, 2025 by VincentXWD
1
AttributeError: 'Linear' object has no attribute 'weight'
#734 opened Feb 28, 2025 by 3keyallen3
[BUG]Ktransformer Docker镜像0.2.1/0.2.2部署Deepseek-r1671B Q4_K_M，OpenAI SDK访问出现 shape mismatch bug Something isn't working
#729 opened Feb 28, 2025 by XMoyas
1
本地部署deepseek 671B后，local chat能正常跑，但是网页版本打开响应出问题，有没有大佬遇到过的？ linux+docker部署
#728 opened Feb 28, 2025 by tenyee
2
./instal安装l错误
#727 opened Feb 28, 2025 by scholar-ye
1*3090 + 256G RAM(8通道 DDR4 2666),E5 2630v4 + decode 速度 0.1 tokens/s都不到
#726 opened Feb 28, 2025 by xiaoxi91
1
[BUG] 部署deepseek r1 q4km 运行不起来 self.gguf_loader.load_gguf_tensor bug Something isn't working
#725 opened Feb 28, 2025 by V-yw
再问如何完整编译
#724 opened Feb 28, 2025 by cnsdzbhm
[BUG]DeepSeek-R1-Distill-Qwen-32B is not supported bug Something isn't working
#723 opened Feb 27, 2025 by yeungtuzi
2
测试mmlu期间，发现即便加了个prompt，deepseek r1的回答依然不是按照要求的回复，请问哪位大佬遇到过？
#720 opened Feb 27, 2025 by 4thGardenOfQMH
1
[BUG] Multiple GPUs report errors during conversations bug Something isn't working
#718 opened Feb 27, 2025 by charliboy
Token indices sequence length too long
#716 opened Feb 27, 2025 by bstr9
1
部署deepseekr1报错 ：undefined symbol
#715 opened Feb 27, 2025 by minmie
4
Build with MooreThreads GPU and Hygon CPU
#714 opened Feb 27, 2025 by yeungtuzi
运行bash install.sh时报错，询问一下该如何解决？
#713 opened Feb 27, 2025 by Cookie-ovo
1
Does the official plan support Turing Nvidia GPU ？
#712 opened Feb 27, 2025 by jason-ji-227
1
如何查看当前使用的ktransformers版本号？
#711 opened Feb 27, 2025 by yizhao1978
3
RuntimeError: shape '[21, 64]' is invalid for input of size 21
#710 opened Feb 27, 2025 by alkalimc
1
运行报错 KeyError: 'Key output.weight not found in Safetensor files'
#709 opened Feb 27, 2025 by ryys1122
1
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.