Skip to content

Commit

Permalink
Fix dialogue tutorial bug (NVIDIA#5297) (NVIDIA#5303)
Browse files Browse the repository at this point in the history
* set add_pooling_layer=False for huggingface bert model

* remove add_pooling_layer=False and set find_unused_parameters=True

* set num_prompt_tokens to 0 for huggingface

Co-authored-by: Zhilin Wang <wangzhilin12061996@hotmail.com>
Co-authored-by: Eric Harper <complex451@gmail.com>
  • Loading branch information
3 people authored and Jimmy Zhang committed Dec 14, 2022
1 parent 7e08f2b commit 90ff74d
Showing 1 changed file with 1 addition and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -539,6 +539,7 @@ def generate_candidates(self, labels, template_length, input_ids, attn_masks):
for i in generated_tokens
]
generated_tokens = torch.cat(generated_tokens, axis=0)
num_prompt_tokens = 0

elif self.cfg.library == "megatron":

Expand Down

0 comments on commit 90ff74d

Please sign in to comment.