Skip to content

Commit

Permalink
[DOCS] tiny NPU adjustment-mstr (#27034)
Browse files Browse the repository at this point in the history
  • Loading branch information
kblaszczak-intel authored Oct 15, 2024
1 parent 0e2ee86 commit 2b01d5c
Showing 1 changed file with 2 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -102,15 +102,15 @@ Use the following code snippet to change the default settings:

.. code-block:: python
pipeline_config = { "MAX_PROMPT_LEN": 1500, "MIN_RESPONSE_LEN": 500 }
pipeline_config = { "MAX_PROMPT_LEN": 1024, "MIN_RESPONSE_LEN": 512 }
pipe = ov_genai.LLMPipeline(model_path, "NPU", pipeline_config)
.. tab-item:: C++
:sync: cpp

.. code-block:: cpp
ov::AnyMap pipeline_config = { { "MAX_PROMPT_LEN", 1500 }, { "MIN_RESPONSE_LEN", 500 } };
ov::AnyMap pipeline_config = { { "MAX_PROMPT_LEN", 1024 }, { "MIN_RESPONSE_LEN", 512 } };
ov::genai::LLMPipeline pipe(model_path, "NPU", pipeline_config);
Expand Down

0 comments on commit 2b01d5c

Please sign in to comment.