Code

Proof of concept TCP server mode#278

Code

Closed

tarruda wants to merge 5 commits intomasterggml-org/llama.cpp:masterfrom tcp_serverggml-org/llama.cpp:tcp_serverCopy head branch name to clipboard

+710-353

Commits

Commits on Mar 22, 2023

• Move main.cpp to run.cpp

  Show description for 90175ee
  tarruda

  committed
  90175ee

  Copy full SHA for 90175ee

• Add main.cpp back and invoke "run" from it

  Show description for d7d53b8
  tarruda

  committed
  d7d53b8

  Copy full SHA for d7d53b8

• Move llama_context setup + perplexity back to main.cpp

  Show description for b7f1fa6
  tarruda

  committed
  b7f1fa6

  Copy full SHA for b7f1fa6

• Remove direct access to std streams from "run"

  Show description for bf44faa
  tarruda

  committed
  bf44faa

  Copy full SHA for bf44faa

• Implement server mode.

  Show description for 3a0dcb3
  tarruda

  committed
  3a0dcb3

  Copy full SHA for 3a0dcb3