34B SFT微调时，启始loss很大。
#426
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
{{ message }}
-
按照官网文档微调时，2p 16卡 a100 run_sft_Yi_34b.sh 数据集Yi/finetune/yi_example_dataset 的时候启始loss为9点多，这个是否正常？
Beta Was this translation helpful? Give feedback.
All reactions