Unable to use MimiModel with DeepSpeed ZeRO-3 (huggingface#34735)

use torch.tensor(), not torch.Tensor() Co-authored-by: eustlb <94853470+eustlb@users.noreply.github.com>
elvircrn · Feb 13, 2025 · 9066252 · 9066252
1 parent 8c2cb95
commit 9066252
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/src/transformers/models/mimi/modeling_mimi.py b/src/transformers/models/mimi/modeling_mimi.py
@@ -1254,7 +1254,7 @@ def __init__(self, config: MimiConfig, epsilon: float = 1e-5):
 
         self.codebook_size = config.codebook_size
 
-        self.register_buffer("initialized", torch.Tensor([True]))
+        self.register_buffer("initialized", torch.tensor([True]))
         self.register_buffer("cluster_usage", torch.ones(config.codebook_size))
         self.register_buffer("embed_sum", embed)
         self._embed = None