Skip to content

wa008/DeBERTa-with-Paddle

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 

Repository files navigation

DeBERTa-with-Paddle

bert_from_paddle_lib: 用 paddle 的 transformer 库做预训练

DeBERTa_mlm: 自己写的 transformer 做预训练

raw_bert_mlm: 复现 DeBERTa 预训练,但只跑通代码,未验证准确性(预训练成本太高),仅供以后参考

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages