Skip to content

Commit

Permalink
Fixed docs compilation
Browse files Browse the repository at this point in the history
  • Loading branch information
ilya-lavrenov committed Jun 27, 2024
1 parent eed3db6 commit 295e494
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions docs/source/getting_started/openvino-installation.rst
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
.. _installation_openvino:

Installation with OpenVINO
========================
==========================

vLLM powered by OpenVINO supports all LLM models from :ref:`vLLM supported models list <_supported_models>` and can perform optimal model serving on all x86-64 CPUs with, at least, AVX2 support. OpenVINO vLLM backend supports the following advanced vLLM features:

Expand Down Expand Up @@ -37,7 +37,7 @@ Quick start using Dockerfile
.. _install_openvino_backend_from_source:

Install from source
-----------------
-------------------

- First, install Python. For example, on Ubuntu 22.04, you can run:

Expand All @@ -62,7 +62,7 @@ Install from source
.. _openvino_backend_performance_tips:

Performance tips
-----------------
----------------

vLLM OpenVINO backend uses the following environment variables to control behavior:

Expand All @@ -84,7 +84,7 @@ OpenVINO best known configuration is:
.. _openvino_backend_limitations:

Limitations
-----------------
-----------

- LoRA serving is not supported.

Expand Down

0 comments on commit 295e494

Please sign in to comment.