Skip to content

Commit

Permalink
Add mapping for ewiz specific model
Browse files Browse the repository at this point in the history
  • Loading branch information
spodgorny9 committed Jul 19, 2024
1 parent 1c9cf0d commit 09a2bee
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions elm/base.py
Original file line number Diff line number Diff line change
Expand Up @@ -357,8 +357,8 @@ def count_tokens(text, model):

# Optional mappings for weird azure names to tiktoken/openai names
tokenizer_aliases = {'gpt-35-turbo': 'gpt-3.5-turbo',
'gpt-4-32k': 'gpt-4-32k-0314'
}
'gpt-4-32k': 'gpt-4-32k-0314',
'ewiz-gpt-4': 'gpt-4'}

token_model = tokenizer_aliases.get(model, model)
encoding = tiktoken.encoding_for_model(token_model)
Expand Down

0 comments on commit 09a2bee

Please sign in to comment.