Skip to content

Commit

Permalink
Use unrestricted tokenizer
Browse files Browse the repository at this point in the history
  • Loading branch information
gabrielmbmb committed Aug 6, 2024
1 parent 3f40170 commit f317128
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions tests/unit/llms/test_vllm.py
Original file line number Diff line number Diff line change
Expand Up @@ -183,7 +183,7 @@ def test_clientvllm_model_name(
) -> None:
llm = ClientvLLM(
base_url="http://localhost:8000/v1",
tokenizer="meta-llama/Meta-Llama-3.1-8B-Instruct",
tokenizer="google-bert/bert-base-uncased",
)

llm.load()
Expand All @@ -201,7 +201,7 @@ async def test_agenerate(
) -> None:
llm = ClientvLLM(
base_url="http://localhost:8000/v1",
tokenizer="meta-llama/Meta-Llama-3.1-8B-Instruct",
tokenizer="google-bert/bert-base-uncased",
)

llm.load()
Expand Down

0 comments on commit f317128

Please sign in to comment.