You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
class CoherePreTrainedModel docstring says that "This model inherits from [PreTrainedModel]. Check the superclass documentation for the generic methods the library implements for all its model (such as downloading or saving, resizing the input embeddings, pruning heads etc.)". However, it doesn't have prune_heads() methods, even though it explicitly mentions that it has in the docstring.
Thanks for your issue @mnauf ! The documentation should be updated, as indeed prune heads is only supported for older models as newer models haven't received this exploration from a research perspective.
System Info
class
CoherePreTrainedModel
docstring says that "This model inherits from [PreTrainedModel
]. Check the superclass documentation for the generic methods the library implements for all its model (such as downloading or saving, resizing the input embeddings, pruning heads etc.)". However, it doesn't haveprune_heads()
methods, even though it explicitly mentions that it has in the docstring.@ArthurZucker
Who can help?
No response
Information
Tasks
examples
folder (such as GLUE/SQuAD, ...)Reproduction
Expected behavior
I expect the method to prune heads of the cohere model.
The text was updated successfully, but these errors were encountered: