Skip to content

Commit

Permalink
Dropped VLLM_OPENVINO_OPTIMUM_FORCE_CONVERSION env var
Browse files Browse the repository at this point in the history
  • Loading branch information
ilya-lavrenov committed Jun 25, 2024
1 parent a29ed93 commit 9e6ed8d
Showing 1 changed file with 0 additions and 5 deletions.
5 changes: 0 additions & 5 deletions vllm/model_executor/model_loader/openvino.py
Original file line number Diff line number Diff line change
Expand Up @@ -81,11 +81,6 @@ def _modify_cache_parameters(model: ov.Model, kv_cache_dtype: ov.Type,


def _require_model_export(model_id, revision=None, subfolder=None):
# Stored IR may not be suitable for vLLM purposes (too old,
# not stateful, not compressed etc.). This is an option to override
# IR usage logic and always do model conversion.
if os.environ.get("VLLM_OPENVINO_OPTIMUM_FORCE_CONVERSION", "0") == "1":
return True
model_dir = Path(model_id)
if subfolder is not None:
model_dir = model_dir / subfolder
Expand Down

0 comments on commit 9e6ed8d

Please sign in to comment.