Inference Performance Issue

[meaningful96]

Hello!! Firstly, thank you for sharing your work. I greatly appreciate it. While running your code, I encountered some issues during the inference stage. Specifically, when I ran the following command:

The result was as follows:

Namespace(data_file_name='Reading/LLaMA2-7b/WebQSP_Freebase_NQ_lora_epoch100/evaluation_beam/generated_predictions.jsonl')
Loading data from: Reading/LLaMA2-7b/WebQSP_Freebase_NQ_lora_epoch100/evaluation_beam/generated_predictions.jsonl
Dataset len: 1639

Start predicting 
total:1639, 
                    ex_cnt:0, 
                    ex_rate:0.0, 
                    real_ex_rate:0.0, 
                    contains_ex_cnt:0, 
                    contains_ex_rate:0.0
                    real_contains_ex_rate:0.0

As you can see, the evaluation result is all zeros. Furthermore, in the next step, after running the command CUDA_VISIBLE_DEVICES=0 python -u eval_final.py --dataset WebQSP --pred_file Reading/LLaMA2-7b/WebQSP_Freebase_NQ_lora_epoch100/evaluation_beam/beam_test_top_k_predictions.json, the result was as follows:

The problem WebQTest-2025 is not in the prediction set
Continue to evaluate the other entries
The problem WebQTest-2027 is not in the prediction set
Continue to evaluate the other entries
The problem WebQTest-2028 is not in the prediction set
Continue to evaluate the other entries
The problem WebQTest-2029 is not in the prediction set
Continue to evaluate the other entries
The problem WebQTest-2030 is not in the prediction set
Continue to evaluate the other entries
The problem WebQTest-2031 is not in the prediction set
Continue to evaluate the other entries
Number of questions: 1639
Average precision over questions: 0.000
Average recall over questions: 0.002
Average f1 over questions (accuracy): 0.000
0.001830628431970714
F1 of average recall and average precision: 0.000
True accuracy (ratio of questions answered exactly correctly): 0.000
Hits@1 over questions: 0.002

I don't know what the cause is. Could you suggest a solution?