rwkv-7 代码和模型不一致

[qxde01]

rwkv_v7_demo.py : args.vocab_size = 50304
01.b 实际：65536

raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format( RuntimeError: Error(s) in loading state_dict for RWKV: Missing key(s) in state_dict: "blocks.0.att.v0", "blocks.0.att.v1", "blocks.0.att.v2". size mismatch for emb.weight: copying a param with shape torch.Size([65536, 768]) from checkpoint, the shape in current model is torch.Size([50304, 768]). size mismatch for head.weight: copying a param with shape torch.Size([65536, 768]) from checkpoint, the shape in current model is torch.Size([50304, 768]).

[BlinkDL]

pile系列模型，和world系列模型，使用的tokenizer不同，所以vocab_size不同