How to evaluate the accuracy of pre-training model

[Pang-b0]

Hello author, thank you for this great article. I didn't find the index to evaluate the accuracy in the process of running the code. Did I miss it? And my cos_loss and local_loss are both negative numbers. Is this normal? How can I evaluate the results of my model training and check the indicators in my paper?

[liaochuanlin]

@Pang-b0 你实现了吗？