[BUG] Fail to import is_torch_greater_or_equal_than_1_13 since transformers v4.48.0 for all deepseek models

[yuxianq]

Describe the bug
Fail to import is_torch_greater_or_equal_than_1_13 since transformers v4.48.0 for all deepseek models

To Reproduce
Install transformers v4.48.0 and run any deepseek model.

Expected behavior
Can run deepseek models with transformers v4.48.0.

Additional context
is_torch_greater_or_equal_than_1_13 has been removed since transformers v4.48.0, it is necessary to remove all usage of is_torch_greater_or_equal_than_1_13 from all deepseek models, not only this one. Can the maintainers help to fix all the models? It is important for us to provide deepseek model support in TensorRT-LLM. Thanks~

[enochkan]

@yuxianq hi can you provide your python version please?

[cmiqueo]

@enochkan I have the same problem:

An error occurred: cannot import name 'is_torch_greater_or_equal_than_1_13' from 'transformers.pytorch_utils' (/Users/username/.pyenv/versions/myenv/lib/python3.9/site-packages/transformers/pytorch_utils.py)

Python 3.9.20

[mowentian]

Linux with Python 3.10 only. Mac and Windows are not supported.

[Jiadalee]

Only python 3.10 working? I have python 3.12 and tried transformers 4.37.2 and 4.48.0, but still pops with the same error.

[yuxianq]

Sorry that I am still on vocation.
@mowentian I use Python 3.12.3. Please noting that this issue is not about Python version but HF version instead. HF removes is_torch_greater_or_equal_than_1_13 in https://github.com/huggingface/transformers/pull/35358/files#diff-dba11d4c8294d6ccc1f120918ba0921738444244db666e0bbde15dc9eb212128L38 since v4.48.0, which breaks deepseek's modeling files.

One way to fix it is removing the usage of is_torch_greater_or_equal_than_1_13 from your model checkpoints. Another way is to integrate deepseek models into HF. There is an ongoing effort: huggingface/transformers#35425 , it would help a lot if you can provide official support for them.

[dinithaw]

@yuxianq hi can you provide your python version please?

3.10 as far i can remember