llama.cpp如何使用多卡进行推理？

[xjDUAN184]

我看llama-13B+lora-chinese权重推理只能在一张卡上，没有那种多卡的参数或者选项。想问下这里有没有方法？

[ymcui]

等官方实现，近期应该会合并到main。
PR： ggerganov/llama.cpp#1607

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your consideration.