ConvBERT Pretraining For ConvBERT we can use the same generated TFRecords as used for pretraining the ELECTRA model.