Code

Add mistral backend#5

Code

Merged

mfournioux merged 11 commits intomainFrance-Travail/benchmark_llm_serving:mainfrom add_mistral_backendFrance-Travail/benchmark_llm_serving:add_mistral_backendCopy head branch name to clipboardAug 1, 2024

+770-198

Commits

Commits on Jul 26, 2024

• Fix some mypy errors

  gsolard

  committed
  e7543f7

  Copy full SHA for e7543f7

• Delete a useless line

  gsolard

  committed
  6923e8a

  Copy full SHA for 6923e8a

• Change the query function to reflect changes in vLLM

  gsolard

  committed
  7be07d0

  Copy full SHA for 7be07d0

Commits on Jul 29, 2024

• Add mistral backend

  gsolard

  committed
  8561d89

  Copy full SHA for 8561d89

Commits on Jul 30, 2024

• Added docstrings and fixed the existing tests

  gsolard

  committed
  45d8330

  Copy full SHA for 45d8330

• Added new unit tests

  gsolard

  committed
  e5080fa

  Copy full SHA for e5080fa

• Fix a mypy error

  gsolard

  committed
  c2747b7

  Copy full SHA for c2747b7

• Refactor to have BackEnd classes

  gsolard

  committed
  3aff1e8

  Copy full SHA for 3aff1e8

• Fix mypy errors

  gsolard

  committed
  2a7d233

  Copy full SHA for 2a7d233

• Update readme

  gsolard

  committed
  a477301

  Copy full SHA for a477301

Commits on Jul 31, 2024

• Refactor to take into account /metrics endpoint which can be implemented

  gsolard

  committed
  a37c375

  Copy full SHA for a37c375