Break point in Transformers V4.48.0 and python 3.9

[prajeet26]

System Info

• transformers version: 4.48.0
• Platform: Linux-5.15.0-25-generic-x86_64-with-glibc2.35
• Python version: 3.9.0
• Huggingface_hub version: 0.27.1
• Safetensors version: 0.5.2
• Accelerate version: 1.2.1

Who can help?

@gante @Rocketknight1

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction

Install Python 3.9
Install Transformers >= v4.48.0
install fastchat accelerate
I was trying to attach delta weights of Vicuna-13B to existing Llama 13B weights in local , for this the advised was below:

python3 -m fastchat.model.apply_delta \
    --base-model-path /path/to/llama-13b \
    --target-model-path /path/to/output/vicuna-13b \
    --delta-path lmsys/vicuna-13b-delta-v1.1

doing this raised the following error:

RuntimeError: Failed to import transformers.generation.streamers because of the following error (look up to see its traceback):
unsupported operand type(s) for |: 'type' and 'NoneType'

Expected behavior

Work in Python 3.9

[jianbohuang]

watch this

[gante]

#35725 fixes it :)