nohup_DARE.out

Namespace(act='relu', beta=0.0, date='13-01-01', device='cuda:1', dim=16, epoch=10, fusion='concat', head_num=4, l2=0.0, lr=0.005, output='full.csv', save=1)
./data/torch_data_13-01-01.pickle
CLS loss:0.0464, REG loss:0.0161, ADV loss:0.0000, Loss:0.0624
CLS loss:0.0670, REG loss:0.0233, ADV loss:0.0000, Loss:0.0903
CLS loss:0.0854, REG loss:0.0112, ADV loss:0.0000, Loss:0.0966
CLS loss:0.0490, REG loss:0.0100, ADV loss:0.0000, Loss:0.0591
CLS loss:0.0243, REG loss:0.0411, ADV loss:0.0000, Loss:0.0654
CLS loss:0.0116, REG loss:0.0133, ADV loss:0.0000, Loss:0.0249
CLS loss:0.0291, REG loss:0.0531, ADV loss:0.0000, Loss:0.0823
CLS loss:0.0391, REG loss:0.0113, ADV loss:0.0000, Loss:0.0504
CLS loss:0.0203, REG loss:0.0027, ADV loss:0.0000, Loss:0.0229
CLS loss:0.0615, REG loss:0.0079, ADV loss:0.0000, Loss:0.0694
CLS loss:0.0452, REG loss:0.0275, ADV loss:0.0000, Loss:0.0727
CLS loss:0.0918, REG loss:0.0509, ADV loss:0.0000, Loss:0.1427
Validate at epoch 1
CLS loss: 0.0346, REG loss: 1088013096832.1930
Over-all F1:0.8096, AUC:0.9719, F1-top:0.5739
Evaluate at epoch 1
CLS loss: 0.0409, REG loss: 238295602353.2111
Over-all F1:0.7603, AUC:0.9635, F1-top:0.5525
CLS loss:0.0054, REG loss:0.0028, ADV loss:0.0000, Loss:0.0082
CLS loss:0.0410, REG loss:0.0379, ADV loss:0.0000, Loss:0.0789
CLS loss:0.0096, REG loss:0.0020, ADV loss:0.0000, Loss:0.0116
CLS loss:0.0538, REG loss:0.0301, ADV loss:0.0000, Loss:0.0839
CLS loss:0.0067, REG loss:0.0011, ADV loss:0.0000, Loss:0.0078
CLS loss:0.0534, REG loss:0.0005, ADV loss:0.0000, Loss:0.0538
CLS loss:0.0452, REG loss:0.0663, ADV loss:0.0000, Loss:0.1115
CLS loss:0.0189, REG loss:0.0128, ADV loss:0.0000, Loss:0.0317
CLS loss:0.0037, REG loss:0.0003, ADV loss:0.0000, Loss:0.0040
CLS loss:0.0262, REG loss:0.0025, ADV loss:0.0000, Loss:0.0288
CLS loss:0.0483, REG loss:0.0014, ADV loss:0.0000, Loss:0.0497
CLS loss:0.0295, REG loss:0.0194, ADV loss:0.0000, Loss:0.0489
Validate at epoch 2
CLS loss: 0.0336, REG loss: 1088013096101.7876
Over-all F1:0.8279, AUC:0.9718, F1-top:0.5839
Evaluate at epoch 2
CLS loss: 0.0413, REG loss: 238295600130.4586
Over-all F1:0.7607, AUC:0.9661, F1-top:0.5485
CLS loss:0.0755, REG loss:0.0026, ADV loss:0.0000, Loss:0.0781
CLS loss:0.0081, REG loss:0.0063, ADV loss:0.0000, Loss:0.0144
CLS loss:0.0258, REG loss:0.0009, ADV loss:0.0000, Loss:0.0267
CLS loss:0.0196, REG loss:0.0127, ADV loss:0.0000, Loss:0.0323
CLS loss:0.0167, REG loss:0.0085, ADV loss:0.0000, Loss:0.0252
CLS loss:0.0707, REG loss:0.0174, ADV loss:0.0000, Loss:0.0881
CLS loss:0.0228, REG loss:0.0017, ADV loss:0.0000, Loss:0.0245
CLS loss:0.0492, REG loss:0.0021, ADV loss:0.0000, Loss:0.0513
CLS loss:0.0087, REG loss:0.0030, ADV loss:0.0000, Loss:0.0117
CLS loss:0.0426, REG loss:0.0442, ADV loss:0.0000, Loss:0.0868
CLS loss:0.0475, REG loss:0.0008, ADV loss:0.0000, Loss:0.0483
CLS loss:0.0757, REG loss:0.0631, ADV loss:0.0000, Loss:0.1388
Validate at epoch 3
CLS loss: 0.0302, REG loss: 1088013095251.5903
Over-all F1:0.8516, AUC:0.9733, F1-top:0.5913
Evaluate at epoch 3
CLS loss: 0.0412, REG loss: 238295599557.9529
Over-all F1:0.7476, AUC:0.9669, F1-top:0.5475
CLS loss:0.0180, REG loss:0.0222, ADV loss:0.0000, Loss:0.0402
CLS loss:0.0084, REG loss:0.0015, ADV loss:0.0000, Loss:0.0100
CLS loss:0.0159, REG loss:0.0011, ADV loss:0.0000, Loss:0.0170
CLS loss:0.0143, REG loss:0.0011, ADV loss:0.0000, Loss:0.0154
CLS loss:0.0310, REG loss:0.0011, ADV loss:0.0000, Loss:0.0321
CLS loss:0.0137, REG loss:0.0187, ADV loss:0.0000, Loss:0.0324
CLS loss:0.0047, REG loss:0.0008, ADV loss:0.0000, Loss:0.0055
CLS loss:0.0370, REG loss:0.0200, ADV loss:0.0000, Loss:0.0571
CLS loss:0.0103, REG loss:0.0033, ADV loss:0.0000, Loss:0.0136
CLS loss:0.0664, REG loss:0.0005, ADV loss:0.0000, Loss:0.0669
CLS loss:0.0083, REG loss:0.0003, ADV loss:0.0000, Loss:0.0086
CLS loss:0.0572, REG loss:0.0265, ADV loss:0.0000, Loss:0.0837
Validate at epoch 4
CLS loss: 0.0327, REG loss: 1088013096081.6711
Over-all F1:0.8155, AUC:0.9734, F1-top:0.5823
Evaluate at epoch 4
CLS loss: 0.0433, REG loss: 238295599533.2947
Over-all F1:0.7398, AUC:0.9698, F1-top:0.5497
CLS loss:0.0035, REG loss:0.0002, ADV loss:0.0000, Loss:0.0037
CLS loss:0.0064, REG loss:0.0012, ADV loss:0.0000, Loss:0.0076
CLS loss:0.1079, REG loss:0.0114, ADV loss:0.0000, Loss:0.1193
CLS loss:0.0468, REG loss:0.0193, ADV loss:0.0000, Loss:0.0661
CLS loss:0.0307, REG loss:0.0034, ADV loss:0.0000, Loss:0.0342
CLS loss:0.0490, REG loss:0.0237, ADV loss:0.0000, Loss:0.0727
CLS loss:0.0095, REG loss:0.0064, ADV loss:0.0000, Loss:0.0160
CLS loss:0.0047, REG loss:0.0006, ADV loss:0.0000, Loss:0.0053
CLS loss:0.0078, REG loss:0.0012, ADV loss:0.0000, Loss:0.0090
CLS loss:0.0646, REG loss:0.0044, ADV loss:0.0000, Loss:0.0690
CLS loss:0.0019, REG loss:0.0007, ADV loss:0.0000, Loss:0.0026
CLS loss:0.0253, REG loss:0.0201, ADV loss:0.0000, Loss:0.0455
Validate at epoch 5
CLS loss: 0.0323, REG loss: 1088013092951.3774
Over-all F1:0.8340, AUC:0.9747, F1-top:0.5876
Evaluate at epoch 5
CLS loss: 0.0564, REG loss: 238295598215.6356
Over-all F1:0.7425, AUC:0.9680, F1-top:0.5312
CLS loss:0.0300, REG loss:0.0272, ADV loss:0.0000, Loss:0.0572
CLS loss:0.0134, REG loss:0.0050, ADV loss:0.0000, Loss:0.0184
CLS loss:0.0104, REG loss:0.0014, ADV loss:0.0000, Loss:0.0118
CLS loss:0.0309, REG loss:0.0335, ADV loss:0.0000, Loss:0.0645
CLS loss:0.0045, REG loss:0.0008, ADV loss:0.0000, Loss:0.0053
CLS loss:0.0072, REG loss:0.0239, ADV loss:0.0000, Loss:0.0311
CLS loss:0.0154, REG loss:0.0237, ADV loss:0.0000, Loss:0.0391
CLS loss:0.0156, REG loss:0.0359, ADV loss:0.0000, Loss:0.0516
CLS loss:0.0028, REG loss:0.0023, ADV loss:0.0000, Loss:0.0051
CLS loss:0.0351, REG loss:0.0019, ADV loss:0.0000, Loss:0.0370
CLS loss:0.0174, REG loss:0.0144, ADV loss:0.0000, Loss:0.0318
CLS loss:0.0052, REG loss:0.0003, ADV loss:0.0000, Loss:0.0055
Validate at epoch 6
CLS loss: 0.0309, REG loss: 1088013093056.4379
Over-all F1:0.8311, AUC:0.9746, F1-top:0.5902
Evaluate at epoch 6
CLS loss: 0.0493, REG loss: 238295599312.1409
Over-all F1:0.7258, AUC:0.9689, F1-top:0.5320
CLS loss:0.0085, REG loss:0.0092, ADV loss:0.0000, Loss:0.0176
CLS loss:0.0064, REG loss:0.0046, ADV loss:0.0000, Loss:0.0109
CLS loss:0.0019, REG loss:0.0002, ADV loss:0.0000, Loss:0.0021
CLS loss:0.0313, REG loss:0.0042, ADV loss:0.0000, Loss:0.0355
CLS loss:0.0315, REG loss:0.0003, ADV loss:0.0000, Loss:0.0318
CLS loss:0.0070, REG loss:0.0012, ADV loss:0.0000, Loss:0.0082
CLS loss:0.0598, REG loss:0.0006, ADV loss:0.0000, Loss:0.0604
CLS loss:0.0042, REG loss:0.0007, ADV loss:0.0000, Loss:0.0049
CLS loss:0.0817, REG loss:0.0371, ADV loss:0.0000, Loss:0.1188
CLS loss:0.0369, REG loss:0.0036, ADV loss:0.0000, Loss:0.0405
CLS loss:0.0084, REG loss:0.0005, ADV loss:0.0000, Loss:0.0090
CLS loss:0.0454, REG loss:0.0253, ADV loss:0.0000, Loss:0.0708
Validate at epoch 7
CLS loss: 0.0314, REG loss: 1088013094454.4523
Over-all F1:0.8395, AUC:0.9729, F1-top:0.5911
Evaluate at epoch 7
CLS loss: 0.0510, REG loss: 238295599467.7841
Over-all F1:0.7503, AUC:0.9696, F1-top:0.5485
CLS loss:0.0018, REG loss:0.0003, ADV loss:0.0000, Loss:0.0021
CLS loss:0.0027, REG loss:0.0017, ADV loss:0.0000, Loss:0.0045
CLS loss:0.0304, REG loss:0.0275, ADV loss:0.0000, Loss:0.0579
CLS loss:0.0038, REG loss:0.0018, ADV loss:0.0000, Loss:0.0056
CLS loss:0.0164, REG loss:0.0019, ADV loss:0.0000, Loss:0.0183
CLS loss:0.0079, REG loss:0.0025, ADV loss:0.0000, Loss:0.0104
CLS loss:0.0325, REG loss:0.0004, ADV loss:0.0000, Loss:0.0330
CLS loss:0.0440, REG loss:0.0007, ADV loss:0.0000, Loss:0.0447
CLS loss:0.0190, REG loss:0.0022, ADV loss:0.0000, Loss:0.0212
CLS loss:0.0161, REG loss:0.0102, ADV loss:0.0000, Loss:0.0263
CLS loss:0.0162, REG loss:0.0037, ADV loss:0.0000, Loss:0.0199
CLS loss:0.0352, REG loss:0.0040, ADV loss:0.0000, Loss:0.0392
Validate at epoch 8
CLS loss: 0.0300, REG loss: 1088013092764.6254
Over-all F1:0.8492, AUC:0.9755, F1-top:0.5922
Evaluate at epoch 8
CLS loss: 0.0605, REG loss: 238295598405.7201
Over-all F1:0.7401, AUC:0.9674, F1-top:0.5328
CLS loss:0.0172, REG loss:0.0015, ADV loss:0.0000, Loss:0.0187
CLS loss:0.0146, REG loss:0.0013, ADV loss:0.0000, Loss:0.0159
CLS loss:0.0023, REG loss:0.0006, ADV loss:0.0000, Loss:0.0029
CLS loss:0.0141, REG loss:0.0054, ADV loss:0.0000, Loss:0.0195
CLS loss:0.0037, REG loss:0.0005, ADV loss:0.0000, Loss:0.0042
CLS loss:0.0434, REG loss:0.0006, ADV loss:0.0000, Loss:0.0440
CLS loss:0.0222, REG loss:0.0093, ADV loss:0.0000, Loss:0.0315
CLS loss:0.0055, REG loss:0.0004, ADV loss:0.0000, Loss:0.0058
CLS loss:0.0098, REG loss:0.0019, ADV loss:0.0000, Loss:0.0117
CLS loss:0.0241, REG loss:0.0292, ADV loss:0.0000, Loss:0.0533
CLS loss:0.0214, REG loss:0.0088, ADV loss:0.0000, Loss:0.0301
CLS loss:0.0057, REG loss:0.0009, ADV loss:0.0000, Loss:0.0066
Validate at epoch 9
CLS loss: 0.0332, REG loss: 1088013090109.9304
Over-all F1:0.8461, AUC:0.9706, F1-top:0.5897
Evaluate at epoch 9
CLS loss: 0.0646, REG loss: 238295598359.8341
Over-all F1:0.7260, AUC:0.9685, F1-top:0.5318
CLS loss:0.0032, REG loss:0.0002, ADV loss:0.0000, Loss:0.0035
CLS loss:0.0112, REG loss:0.0014, ADV loss:0.0000, Loss:0.0126
CLS loss:0.0217, REG loss:0.0306, ADV loss:0.0000, Loss:0.0523
CLS loss:0.0288, REG loss:0.0004, ADV loss:0.0000, Loss:0.0292
CLS loss:0.0319, REG loss:0.0013, ADV loss:0.0000, Loss:0.0332
CLS loss:0.0090, REG loss:0.0054, ADV loss:0.0000, Loss:0.0144
CLS loss:0.0056, REG loss:0.0008, ADV loss:0.0000, Loss:0.0064
CLS loss:0.0137, REG loss:0.0005, ADV loss:0.0000, Loss:0.0141
CLS loss:0.0077, REG loss:0.0018, ADV loss:0.0000, Loss:0.0095
CLS loss:0.0589, REG loss:0.0308, ADV loss:0.0000, Loss:0.0896
CLS loss:0.0056, REG loss:0.0048, ADV loss:0.0000, Loss:0.0104
CLS loss:0.0025, REG loss:0.0011, ADV loss:0.0000, Loss:0.0036
Validate at epoch 10
CLS loss: 0.0359, REG loss: 1088013094493.8179
Over-all F1:0.8123, AUC:0.9729, F1-top:0.5789
Evaluate at epoch 10
CLS loss: 0.0703, REG loss: 238295599085.6596
Over-all F1:0.6961, AUC:0.9658, F1-top:0.5061

--------Evaluating DATE model---------
CLS loss: 0.0300, REG loss: 1088013092764.6254
CLS loss: 0.0605, REG loss: 238295598405.7201
Saving result... ./results/full.csv

Starting_date:13-01-01
 Metrics:
f1:0.7401 auc:0.9674
Pr@1:0.8969 Pr@2:0.7543 Pr@5:0.3889 Pr@10:0.2033
Re@1:0.3972 Re@2:0.6730 Re@5:0.8677 Re@10:0.9072
Rev@1:0.4482 Rev@2:0.6689 Rev@5:0.8574 Rev@10:0.9024
Namespace(act='relu', beta=0.0, date='13-06-01', device='cuda:1', dim=16, epoch=10, fusion='concat', head_num=4, l2=0.0, lr=0.005, output='full.csv', save=1)
./data/torch_data_13-06-01.pickle
CLS loss:0.0717, REG loss:0.0367, ADV loss:0.0000, Loss:0.1084
CLS loss:0.0503, REG loss:0.0451, ADV loss:0.0000, Loss:0.0953
CLS loss:0.0496, REG loss:0.0096, ADV loss:0.0000, Loss:0.0591
CLS loss:0.0143, REG loss:0.0046, ADV loss:0.0000, Loss:0.0189
CLS loss:0.0967, REG loss:0.0662, ADV loss:0.0000, Loss:0.1629
CLS loss:0.0462, REG loss:0.0268, ADV loss:0.0000, Loss:0.0729
CLS loss:0.0325, REG loss:0.0062, ADV loss:0.0000, Loss:0.0388
CLS loss:0.0416, REG loss:0.0080, ADV loss:0.0000, Loss:0.0496
CLS loss:0.0261, REG loss:0.0139, ADV loss:0.0000, Loss:0.0400
CLS loss:0.0129, REG loss:0.0036, ADV loss:0.0000, Loss:0.0164
CLS loss:0.0129, REG loss:0.0167, ADV loss:0.0000, Loss:0.0296
Validate at epoch 1
CLS loss: 0.0373, REG loss: 1088013094185.4606
Over-all F1:0.7986, AUC:0.9701, F1-top:0.5717
Evaluate at epoch 1
CLS loss: 0.0453, REG loss: 238295600285.4618
Over-all F1:0.7581, AUC:0.9650, F1-top:0.5504
CLS loss:0.0062, REG loss:0.0042, ADV loss:0.0000, Loss:0.0105
CLS loss:0.0345, REG loss:0.0037, ADV loss:0.0000, Loss:0.0382
CLS loss:0.0081, REG loss:0.0014, ADV loss:0.0000, Loss:0.0095
CLS loss:0.0539, REG loss:0.0216, ADV loss:0.0000, Loss:0.0755
CLS loss:0.0552, REG loss:0.0254, ADV loss:0.0000, Loss:0.0806
CLS loss:0.0185, REG loss:0.0368, ADV loss:0.0000, Loss:0.0553
CLS loss:0.0356, REG loss:0.0002, ADV loss:0.0000, Loss:0.0359
CLS loss:0.0097, REG loss:0.0043, ADV loss:0.0000, Loss:0.0140
CLS loss:0.0327, REG loss:0.0086, ADV loss:0.0000, Loss:0.0413
CLS loss:0.0603, REG loss:0.0126, ADV loss:0.0000, Loss:0.0729
CLS loss:0.1384, REG loss:0.0732, ADV loss:0.0000, Loss:0.2116
Validate at epoch 2
CLS loss: 0.0360, REG loss: 1088013099874.5123
Over-all F1:0.7959, AUC:0.9692, F1-top:0.5723
Evaluate at epoch 2
CLS loss: 0.0404, REG loss: 238295601359.2590
Over-all F1:0.7434, AUC:0.9654, F1-top:0.5463
CLS loss:0.0184, REG loss:0.0018, ADV loss:0.0000, Loss:0.0202
CLS loss:0.0291, REG loss:0.0296, ADV loss:0.0000, Loss:0.0587
CLS loss:0.0377, REG loss:0.0324, ADV loss:0.0000, Loss:0.0700
CLS loss:0.0321, REG loss:0.0026, ADV loss:0.0000, Loss:0.0347
CLS loss:0.0255, REG loss:0.0229, ADV loss:0.0000, Loss:0.0484
CLS loss:0.0377, REG loss:0.0180, ADV loss:0.0000, Loss:0.0557
CLS loss:0.0078, REG loss:0.0028, ADV loss:0.0000, Loss:0.0107
CLS loss:0.0414, REG loss:0.0018, ADV loss:0.0000, Loss:0.0432
CLS loss:0.0172, REG loss:0.0007, ADV loss:0.0000, Loss:0.0178
CLS loss:0.0356, REG loss:0.0005, ADV loss:0.0000, Loss:0.0362
CLS loss:0.0052, REG loss:0.0027, ADV loss:0.0000, Loss:0.0079
Validate at epoch 3
CLS loss: 0.0311, REG loss: 1088013094057.1859
Over-all F1:0.8290, AUC:0.9766, F1-top:0.5863
Evaluate at epoch 3
CLS loss: 0.0430, REG loss: 238295599239.4484
Over-all F1:0.7572, AUC:0.9682, F1-top:0.5500
CLS loss:0.0969, REG loss:0.0705, ADV loss:0.0000, Loss:0.1674
CLS loss:0.0563, REG loss:0.0018, ADV loss:0.0000, Loss:0.0581
CLS loss:0.0258, REG loss:0.0320, ADV loss:0.0000, Loss:0.0578
CLS loss:0.0393, REG loss:0.0038, ADV loss:0.0000, Loss:0.0432
CLS loss:0.0464, REG loss:0.0009, ADV loss:0.0000, Loss:0.0473
CLS loss:0.0107, REG loss:0.0024, ADV loss:0.0000, Loss:0.0130
CLS loss:0.0065, REG loss:0.0055, ADV loss:0.0000, Loss:0.0121
CLS loss:0.0050, REG loss:0.0005, ADV loss:0.0000, Loss:0.0055
CLS loss:0.0273, REG loss:0.0479, ADV loss:0.0000, Loss:0.0752
CLS loss:0.0037, REG loss:0.0007, ADV loss:0.0000, Loss:0.0044
CLS loss:0.0192, REG loss:0.0061, ADV loss:0.0000, Loss:0.0254
Validate at epoch 4
CLS loss: 0.0335, REG loss: 1088013097825.7877
Over-all F1:0.8148, AUC:0.9750, F1-top:0.5818
Evaluate at epoch 4
CLS loss: 0.0462, REG loss: 238295599347.5876
Over-all F1:0.7513, AUC:0.9675, F1-top:0.5403
CLS loss:0.0077, REG loss:0.0013, ADV loss:0.0000, Loss:0.0090
CLS loss:0.0044, REG loss:0.0015, ADV loss:0.0000, Loss:0.0060
CLS loss:0.0657, REG loss:0.0097, ADV loss:0.0000, Loss:0.0754
CLS loss:0.0196, REG loss:0.0179, ADV loss:0.0000, Loss:0.0375
CLS loss:0.0046, REG loss:0.0007, ADV loss:0.0000, Loss:0.0053
CLS loss:0.0309, REG loss:0.0004, ADV loss:0.0000, Loss:0.0313
CLS loss:0.0173, REG loss:0.0057, ADV loss:0.0000, Loss:0.0230
CLS loss:0.0188, REG loss:0.0009, ADV loss:0.0000, Loss:0.0197
CLS loss:0.0172, REG loss:0.0110, ADV loss:0.0000, Loss:0.0281
CLS loss:0.0045, REG loss:0.0002, ADV loss:0.0000, Loss:0.0048
CLS loss:0.0604, REG loss:0.0018, ADV loss:0.0000, Loss:0.0622
Validate at epoch 5
CLS loss: 0.0323, REG loss: 1088013092640.6145
Over-all F1:0.8259, AUC:0.9755, F1-top:0.5845
Evaluate at epoch 5
CLS loss: 0.0451, REG loss: 238295599141.9254
Over-all F1:0.7475, AUC:0.9688, F1-top:0.5415
CLS loss:0.0061, REG loss:0.0009, ADV loss:0.0000, Loss:0.0069
CLS loss:0.0067, REG loss:0.0004, ADV loss:0.0000, Loss:0.0070
CLS loss:0.0285, REG loss:0.0064, ADV loss:0.0000, Loss:0.0349
CLS loss:0.0274, REG loss:0.0006, ADV loss:0.0000, Loss:0.0279
CLS loss:0.0029, REG loss:0.0004, ADV loss:0.0000, Loss:0.0033
CLS loss:0.0283, REG loss:0.0033, ADV loss:0.0000, Loss:0.0316
CLS loss:0.0062, REG loss:0.0091, ADV loss:0.0000, Loss:0.0153
CLS loss:0.0486, REG loss:0.0484, ADV loss:0.0000, Loss:0.0970
CLS loss:0.0774, REG loss:0.0048, ADV loss:0.0000, Loss:0.0821
CLS loss:0.0546, REG loss:0.0030, ADV loss:0.0000, Loss:0.0575
CLS loss:0.0398, REG loss:0.0254, ADV loss:0.0000, Loss:0.0652
Validate at epoch 6
CLS loss: 0.0323, REG loss: 1088013092037.0117
Over-all F1:0.8315, AUC:0.9788, F1-top:0.5849
Evaluate at epoch 6
CLS loss: 0.0509, REG loss: 238295598423.4706
Over-all F1:0.7593, AUC:0.9682, F1-top:0.5544
CLS loss:0.0130, REG loss:0.0064, ADV loss:0.0000, Loss:0.0194
CLS loss:0.0417, REG loss:0.0010, ADV loss:0.0000, Loss:0.0427
CLS loss:0.0054, REG loss:0.0010, ADV loss:0.0000, Loss:0.0063
CLS loss:0.0746, REG loss:0.0987, ADV loss:0.0000, Loss:0.1733
CLS loss:0.0032, REG loss:0.0015, ADV loss:0.0000, Loss:0.0047
CLS loss:0.0039, REG loss:0.0031, ADV loss:0.0000, Loss:0.0070
CLS loss:0.0051, REG loss:0.0003, ADV loss:0.0000, Loss:0.0054
CLS loss:0.0025, REG loss:0.0009, ADV loss:0.0000, Loss:0.0034
CLS loss:0.0070, REG loss:0.0032, ADV loss:0.0000, Loss:0.0102
CLS loss:0.0101, REG loss:0.0064, ADV loss:0.0000, Loss:0.0164
CLS loss:0.0533, REG loss:0.0319, ADV loss:0.0000, Loss:0.0852
Validate at epoch 7
CLS loss: 0.0325, REG loss: 1088013096855.5228
Over-all F1:0.8316, AUC:0.9758, F1-top:0.5898
Evaluate at epoch 7
CLS loss: 0.0619, REG loss: 238295599143.0865
Over-all F1:0.7461, AUC:0.9686, F1-top:0.5232
CLS loss:0.0774, REG loss:0.0509, ADV loss:0.0000, Loss:0.1283
CLS loss:0.0605, REG loss:0.0468, ADV loss:0.0000, Loss:0.1072
CLS loss:0.0807, REG loss:0.0085, ADV loss:0.0000, Loss:0.0892
CLS loss:0.0083, REG loss:0.0156, ADV loss:0.0000, Loss:0.0239
CLS loss:0.0020, REG loss:0.0008, ADV loss:0.0000, Loss:0.0028
CLS loss:0.0143, REG loss:0.0034, ADV loss:0.0000, Loss:0.0177
CLS loss:0.0467, REG loss:0.0011, ADV loss:0.0000, Loss:0.0478
CLS loss:0.0153, REG loss:0.0043, ADV loss:0.0000, Loss:0.0196
CLS loss:0.0263, REG loss:0.0012, ADV loss:0.0000, Loss:0.0275
CLS loss:0.0206, REG loss:0.0041, ADV loss:0.0000, Loss:0.0247
CLS loss:0.0061, REG loss:0.0004, ADV loss:0.0000, Loss:0.0065
Validate at epoch 8
CLS loss: 0.0350, REG loss: 1088013097561.5712
Over-all F1:0.8090, AUC:0.9755, F1-top:0.5806
Evaluate at epoch 8
CLS loss: 0.0527, REG loss: 238295598727.9197
Over-all F1:0.7391, AUC:0.9677, F1-top:0.5486
CLS loss:0.0134, REG loss:0.0028, ADV loss:0.0000, Loss:0.0162
CLS loss:0.0018, REG loss:0.0021, ADV loss:0.0000, Loss:0.0039
CLS loss:0.0676, REG loss:0.0154, ADV loss:0.0000, Loss:0.0830
CLS loss:0.0071, REG loss:0.0014, ADV loss:0.0000, Loss:0.0085
CLS loss:0.0144, REG loss:0.0227, ADV loss:0.0000, Loss:0.0371
CLS loss:0.0071, REG loss:0.0066, ADV loss:0.0000, Loss:0.0137
CLS loss:0.0058, REG loss:0.0011, ADV loss:0.0000, Loss:0.0069
CLS loss:0.0044, REG loss:0.0005, ADV loss:0.0000, Loss:0.0049
CLS loss:0.0047, REG loss:0.0028, ADV loss:0.0000, Loss:0.0075
CLS loss:0.0107, REG loss:0.0066, ADV loss:0.0000, Loss:0.0173
CLS loss:0.0651, REG loss:0.0257, ADV loss:0.0000, Loss:0.0908
Validate at epoch 9
CLS loss: 0.0339, REG loss: 1088013090067.2407
Over-all F1:0.8292, AUC:0.9737, F1-top:0.5861
Evaluate at epoch 9
CLS loss: 0.0679, REG loss: 238295598206.8725
Over-all F1:0.7418, AUC:0.9665, F1-top:0.5317
CLS loss:0.0086, REG loss:0.0126, ADV loss:0.0000, Loss:0.0212
CLS loss:0.0438, REG loss:0.0006, ADV loss:0.0000, Loss:0.0445
CLS loss:0.0060, REG loss:0.0002, ADV loss:0.0000, Loss:0.0063
CLS loss:0.0031, REG loss:0.0019, ADV loss:0.0000, Loss:0.0051
CLS loss:0.0054, REG loss:0.0048, ADV loss:0.0000, Loss:0.0102
CLS loss:0.0030, REG loss:0.0002, ADV loss:0.0000, Loss:0.0032
CLS loss:0.0042, REG loss:0.0035, ADV loss:0.0000, Loss:0.0077
CLS loss:0.0036, REG loss:0.0039, ADV loss:0.0000, Loss:0.0074
CLS loss:0.0237, REG loss:0.0014, ADV loss:0.0000, Loss:0.0251
CLS loss:0.0069, REG loss:0.0019, ADV loss:0.0000, Loss:0.0089
CLS loss:0.0221, REG loss:0.0004, ADV loss:0.0000, Loss:0.0225
Validate at epoch 10
CLS loss: 0.0338, REG loss: 1088013094571.0293
Over-all F1:0.8196, AUC:0.9751, F1-top:0.5834
Evaluate at epoch 10
CLS loss: 0.0603, REG loss: 238295598342.1409
Over-all F1:0.7376, AUC:0.9675, F1-top:0.5295

--------Evaluating DATE model---------
CLS loss: 0.0325, REG loss: 1088013096855.5228
CLS loss: 0.0619, REG loss: 238295599143.0865
Saving result... ./results/full.csv

Starting_date:13-06-01
 Metrics:
f1:0.7461 auc:0.9686
Pr@1:0.7787 Pr@2:0.7833 Pr@5:0.3910 Pr@10:0.2042
Re@1:0.3475 Re@2:0.6990 Re@5:0.8722 Re@10:0.9111
Rev@1:0.4872 Rev@2:0.7278 Rev@5:0.8616 Rev@10:0.9027
Namespace(act='relu', beta=0.0, date='13-12-01', device='cuda:1', dim=16, epoch=10, fusion='concat', head_num=4, l2=0.0, lr=0.005, output='full.csv', save=1)
./data/torch_data_13-12-01.pickle
CLS loss:0.1588, REG loss:0.0239, ADV loss:0.0000, Loss:0.1827
CLS loss:0.0544, REG loss:0.0777, ADV loss:0.0000, Loss:0.1321
CLS loss:0.0769, REG loss:0.0379, ADV loss:0.0000, Loss:0.1148
CLS loss:0.0454, REG loss:0.0088, ADV loss:0.0000, Loss:0.0542
CLS loss:0.0595, REG loss:0.0253, ADV loss:0.0000, Loss:0.0849
CLS loss:0.0486, REG loss:0.0379, ADV loss:0.0000, Loss:0.0866
CLS loss:0.0613, REG loss:0.0681, ADV loss:0.0000, Loss:0.1294
CLS loss:0.0138, REG loss:0.0116, ADV loss:0.0000, Loss:0.0254
CLS loss:0.0551, REG loss:0.0700, ADV loss:0.0000, Loss:0.1251
Validate at epoch 1
CLS loss: 0.0391, REG loss: 1088013096865.6940
Over-all F1:0.7898, AUC:0.9653, F1-top:0.5606
Evaluate at epoch 1
CLS loss: 0.0387, REG loss: 238295602613.2075
Over-all F1:0.7602, AUC:0.9624, F1-top:0.5452
CLS loss:0.0260, REG loss:0.0018, ADV loss:0.0000, Loss:0.0277
CLS loss:0.0346, REG loss:0.0199, ADV loss:0.0000, Loss:0.0545
CLS loss:0.0236, REG loss:0.0183, ADV loss:0.0000, Loss:0.0419
CLS loss:0.0812, REG loss:0.0074, ADV loss:0.0000, Loss:0.0886
CLS loss:0.0137, REG loss:0.0075, ADV loss:0.0000, Loss:0.0212
CLS loss:0.0176, REG loss:0.0161, ADV loss:0.0000, Loss:0.0337
CLS loss:0.0180, REG loss:0.0263, ADV loss:0.0000, Loss:0.0443
CLS loss:0.0644, REG loss:0.0086, ADV loss:0.0000, Loss:0.0731
CLS loss:0.0383, REG loss:0.0009, ADV loss:0.0000, Loss:0.0391
Validate at epoch 2
CLS loss: 0.0373, REG loss: 1088013094279.5425
Over-all F1:0.8036, AUC:0.9656, F1-top:0.5698
Evaluate at epoch 2
CLS loss: 0.0378, REG loss: 238295600578.0634
Over-all F1:0.7799, AUC:0.9670, F1-top:0.5501
CLS loss:0.0642, REG loss:0.0207, ADV loss:0.0000, Loss:0.0849
CLS loss:0.0065, REG loss:0.0026, ADV loss:0.0000, Loss:0.0092
CLS loss:0.0474, REG loss:0.0017, ADV loss:0.0000, Loss:0.0491
CLS loss:0.0395, REG loss:0.0527, ADV loss:0.0000, Loss:0.0922
CLS loss:0.0523, REG loss:0.0125, ADV loss:0.0000, Loss:0.0648
CLS loss:0.0098, REG loss:0.0021, ADV loss:0.0000, Loss:0.0119
CLS loss:0.0526, REG loss:0.0234, ADV loss:0.0000, Loss:0.0760
CLS loss:0.0581, REG loss:0.0707, ADV loss:0.0000, Loss:0.1288
CLS loss:0.0307, REG loss:0.0294, ADV loss:0.0000, Loss:0.0601
Validate at epoch 3
CLS loss: 0.0320, REG loss: 1088013090009.1133
Over-all F1:0.8359, AUC:0.9735, F1-top:0.5849
Evaluate at epoch 3
CLS loss: 0.0374, REG loss: 238295597757.2133
Over-all F1:0.7964, AUC:0.9705, F1-top:0.5645
CLS loss:0.0073, REG loss:0.0013, ADV loss:0.0000, Loss:0.0086
CLS loss:0.0305, REG loss:0.0098, ADV loss:0.0000, Loss:0.0403
CLS loss:0.0588, REG loss:0.0358, ADV loss:0.0000, Loss:0.0946
CLS loss:0.0165, REG loss:0.0016, ADV loss:0.0000, Loss:0.0180
CLS loss:0.0501, REG loss:0.0027, ADV loss:0.0000, Loss:0.0528
CLS loss:0.0916, REG loss:0.0457, ADV loss:0.0000, Loss:0.1373
CLS loss:0.0180, REG loss:0.0096, ADV loss:0.0000, Loss:0.0276
CLS loss:0.0108, REG loss:0.0049, ADV loss:0.0000, Loss:0.0157
CLS loss:0.0157, REG loss:0.0047, ADV loss:0.0000, Loss:0.0203
Validate at epoch 4
CLS loss: 0.0323, REG loss: 1088013090093.9572
Over-all F1:0.8387, AUC:0.9718, F1-top:0.5839
Evaluate at epoch 4
CLS loss: 0.0434, REG loss: 238295598542.1451
Over-all F1:0.7735, AUC:0.9689, F1-top:0.5531
CLS loss:0.0063, REG loss:0.0040, ADV loss:0.0000, Loss:0.0102
CLS loss:0.0123, REG loss:0.0009, ADV loss:0.0000, Loss:0.0131
CLS loss:0.0079, REG loss:0.0004, ADV loss:0.0000, Loss:0.0084
CLS loss:0.0067, REG loss:0.0002, ADV loss:0.0000, Loss:0.0069
CLS loss:0.0483, REG loss:0.0404, ADV loss:0.0000, Loss:0.0888
CLS loss:0.0122, REG loss:0.0039, ADV loss:0.0000, Loss:0.0161
CLS loss:0.0168, REG loss:0.0011, ADV loss:0.0000, Loss:0.0179
CLS loss:0.0050, REG loss:0.0010, ADV loss:0.0000, Loss:0.0060
CLS loss:0.0316, REG loss:0.0248, ADV loss:0.0000, Loss:0.0564
Validate at epoch 5
CLS loss: 0.0328, REG loss: 1088013092964.0985
Over-all F1:0.8314, AUC:0.9714, F1-top:0.5864
Evaluate at epoch 5
CLS loss: 0.0410, REG loss: 238295598716.4065
Over-all F1:0.7890, AUC:0.9703, F1-top:0.5626
CLS loss:0.0346, REG loss:0.0410, ADV loss:0.0000, Loss:0.0756
CLS loss:0.0105, REG loss:0.0035, ADV loss:0.0000, Loss:0.0139
CLS loss:0.0207, REG loss:0.0008, ADV loss:0.0000, Loss:0.0214
CLS loss:0.0047, REG loss:0.0031, ADV loss:0.0000, Loss:0.0078
CLS loss:0.0128, REG loss:0.0019, ADV loss:0.0000, Loss:0.0146
CLS loss:0.0430, REG loss:0.0019, ADV loss:0.0000, Loss:0.0449
CLS loss:0.0411, REG loss:0.0053, ADV loss:0.0000, Loss:0.0464
CLS loss:0.0123, REG loss:0.0022, ADV loss:0.0000, Loss:0.0145
CLS loss:0.0035, REG loss:0.0035, ADV loss:0.0000, Loss:0.0070
Validate at epoch 6
CLS loss: 0.0315, REG loss: 1088013090064.7760
Over-all F1:0.8275, AUC:0.9747, F1-top:0.5889
Evaluate at epoch 6
CLS loss: 0.0419, REG loss: 238295598177.7724
Over-all F1:0.7494, AUC:0.9719, F1-top:0.5530
CLS loss:0.0066, REG loss:0.0028, ADV loss:0.0000, Loss:0.0094
CLS loss:0.0048, REG loss:0.0028, ADV loss:0.0000, Loss:0.0076
CLS loss:0.0101, REG loss:0.0020, ADV loss:0.0000, Loss:0.0121
CLS loss:0.0135, REG loss:0.0175, ADV loss:0.0000, Loss:0.0310
CLS loss:0.0297, REG loss:0.0000, ADV loss:0.0000, Loss:0.0297
CLS loss:0.0563, REG loss:0.0006, ADV loss:0.0000, Loss:0.0570
CLS loss:0.0413, REG loss:0.0043, ADV loss:0.0000, Loss:0.0456
CLS loss:0.0441, REG loss:0.0033, ADV loss:0.0000, Loss:0.0474
CLS loss:0.0473, REG loss:0.0297, ADV loss:0.0000, Loss:0.0770
Validate at epoch 7
CLS loss: 0.0333, REG loss: 1088013090662.4960
Over-all F1:0.8406, AUC:0.9744, F1-top:0.5889
Evaluate at epoch 7
CLS loss: 0.0502, REG loss: 238295598694.6235
Over-all F1:0.7624, AUC:0.9736, F1-top:0.5550
CLS loss:0.0654, REG loss:0.0004, ADV loss:0.0000, Loss:0.0657
CLS loss:0.0087, REG loss:0.0056, ADV loss:0.0000, Loss:0.0144
CLS loss:0.0617, REG loss:0.0020, ADV loss:0.0000, Loss:0.0637
CLS loss:0.0725, REG loss:0.0076, ADV loss:0.0000, Loss:0.0801
CLS loss:0.0167, REG loss:0.0309, ADV loss:0.0000, Loss:0.0476
CLS loss:0.0023, REG loss:0.0021, ADV loss:0.0000, Loss:0.0044
CLS loss:0.0687, REG loss:0.0528, ADV loss:0.0000, Loss:0.1215
CLS loss:0.0475, REG loss:0.0243, ADV loss:0.0000, Loss:0.0718
CLS loss:0.0038, REG loss:0.0051, ADV loss:0.0000, Loss:0.0089
Validate at epoch 8
CLS loss: 0.0346, REG loss: 1088013092216.3593
Over-all F1:0.8340, AUC:0.9718, F1-top:0.5861
Evaluate at epoch 8
CLS loss: 0.0466, REG loss: 238295598208.8193
Over-all F1:0.7575, AUC:0.9716, F1-top:0.5583
CLS loss:0.0867, REG loss:0.0024, ADV loss:0.0000, Loss:0.0891
CLS loss:0.0169, REG loss:0.0227, ADV loss:0.0000, Loss:0.0396
CLS loss:0.0378, REG loss:0.0111, ADV loss:0.0000, Loss:0.0489
CLS loss:0.0423, REG loss:0.0023, ADV loss:0.0000, Loss:0.0446
CLS loss:0.0498, REG loss:0.0003, ADV loss:0.0000, Loss:0.0501
CLS loss:0.0038, REG loss:0.0048, ADV loss:0.0000, Loss:0.0086
CLS loss:0.0068, REG loss:0.0094, ADV loss:0.0000, Loss:0.0162
CLS loss:0.0033, REG loss:0.0009, ADV loss:0.0000, Loss:0.0042
CLS loss:0.0362, REG loss:0.0012, ADV loss:0.0000, Loss:0.0375
Validate at epoch 9
CLS loss: 0.0322, REG loss: 1088013088908.4482
Over-all F1:0.8364, AUC:0.9751, F1-top:0.5885
Evaluate at epoch 9
CLS loss: 0.0458, REG loss: 238295598238.5529
Over-all F1:0.7634, AUC:0.9734, F1-top:0.5574
CLS loss:0.0246, REG loss:0.0009, ADV loss:0.0000, Loss:0.0255
CLS loss:0.0181, REG loss:0.0111, ADV loss:0.0000, Loss:0.0292
CLS loss:0.0034, REG loss:0.0005, ADV loss:0.0000, Loss:0.0039
CLS loss:0.0045, REG loss:0.0005, ADV loss:0.0000, Loss:0.0051
CLS loss:0.0155, REG loss:0.0332, ADV loss:0.0000, Loss:0.0487
CLS loss:0.0107, REG loss:0.0013, ADV loss:0.0000, Loss:0.0121
CLS loss:0.0186, REG loss:0.0074, ADV loss:0.0000, Loss:0.0260
CLS loss:0.0138, REG loss:0.0016, ADV loss:0.0000, Loss:0.0154
CLS loss:0.0121, REG loss:0.0079, ADV loss:0.0000, Loss:0.0200
Validate at epoch 10
CLS loss: 0.0337, REG loss: 1088013087572.8624
Over-all F1:0.8400, AUC:0.9726, F1-top:0.5914
Evaluate at epoch 10
CLS loss: 0.0571, REG loss: 238295596258.2896
Over-all F1:0.7577, AUC:0.9721, F1-top:0.5562

--------Evaluating DATE model---------
CLS loss: 0.0337, REG loss: 1088013087572.8624
CLS loss: 0.0571, REG loss: 238295596258.2896
Saving result... ./results/full.csv

Starting_date:13-12-01
 Metrics:
f1:0.7577 auc:0.9721
Pr@1:0.9432 Pr@2:0.8106 Pr@5:0.3934 Pr@10:0.2050
Re@1:0.4209 Re@2:0.7234 Re@5:0.8775 Re@10:0.9145
Rev@1:0.4881 Rev@2:0.7112 Rev@5:0.8535 Rev@10:0.8947
Namespace(act='relu', beta=0.0, date='14-06-01', device='cuda:1', dim=16, epoch=10, fusion='concat', head_num=4, l2=0.0, lr=0.005, output='full.csv', save=1)
./data/torch_data_14-06-01.pickle
CLS loss:0.0927, REG loss:0.0798, ADV loss:0.0000, Loss:0.1725
CLS loss:0.0310, REG loss:0.0399, ADV loss:0.0000, Loss:0.0708
CLS loss:0.0504, REG loss:0.0259, ADV loss:0.0000, Loss:0.0763
CLS loss:0.0205, REG loss:0.0008, ADV loss:0.0000, Loss:0.0214
CLS loss:0.0342, REG loss:0.0595, ADV loss:0.0000, Loss:0.0938
CLS loss:0.0403, REG loss:0.0394, ADV loss:0.0000, Loss:0.0797
CLS loss:0.0371, REG loss:0.0034, ADV loss:0.0000, Loss:0.0406
Validate at epoch 1
CLS loss: 0.0432, REG loss: 1088013101620.2272
Over-all F1:0.7698, AUC:0.9584, F1-top:0.5529
Evaluate at epoch 1
CLS loss: 0.0421, REG loss: 238295603930.6693
Over-all F1:0.7355, AUC:0.9585, F1-top:0.5334
CLS loss:0.0700, REG loss:0.0606, ADV loss:0.0000, Loss:0.1306
CLS loss:0.0475, REG loss:0.0015, ADV loss:0.0000, Loss:0.0490
CLS loss:0.0113, REG loss:0.0008, ADV loss:0.0000, Loss:0.0121
CLS loss:0.0758, REG loss:0.0273, ADV loss:0.0000, Loss:0.1031
CLS loss:0.0679, REG loss:0.0048, ADV loss:0.0000, Loss:0.0727
CLS loss:0.0030, REG loss:0.0039, ADV loss:0.0000, Loss:0.0070
CLS loss:0.0816, REG loss:0.0274, ADV loss:0.0000, Loss:0.1090
Validate at epoch 2
CLS loss: 0.0385, REG loss: 1088013097582.4818
Over-all F1:0.8047, AUC:0.9624, F1-top:0.5667
Evaluate at epoch 2
CLS loss: 0.0416, REG loss: 238295601194.5233
Over-all F1:0.7430, AUC:0.9647, F1-top:0.5480
CLS loss:0.0056, REG loss:0.0013, ADV loss:0.0000, Loss:0.0068
CLS loss:0.0273, REG loss:0.0237, ADV loss:0.0000, Loss:0.0510
CLS loss:0.1006, REG loss:0.0654, ADV loss:0.0000, Loss:0.1659
CLS loss:0.0405, REG loss:0.0094, ADV loss:0.0000, Loss:0.0499
CLS loss:0.0192, REG loss:0.0058, ADV loss:0.0000, Loss:0.0250
CLS loss:0.0141, REG loss:0.0014, ADV loss:0.0000, Loss:0.0154
CLS loss:0.0089, REG loss:0.0015, ADV loss:0.0000, Loss:0.0104
Validate at epoch 3
CLS loss: 0.0388, REG loss: 1088013095189.4830
Over-all F1:0.7983, AUC:0.9603, F1-top:0.5687
Evaluate at epoch 3
CLS loss: 0.0419, REG loss: 238295600094.3662
Over-all F1:0.7543, AUC:0.9638, F1-top:0.5500
CLS loss:0.0554, REG loss:0.0019, ADV loss:0.0000, Loss:0.0572
CLS loss:0.0131, REG loss:0.0086, ADV loss:0.0000, Loss:0.0217
CLS loss:0.0111, REG loss:0.0163, ADV loss:0.0000, Loss:0.0274
CLS loss:0.0429, REG loss:0.0021, ADV loss:0.0000, Loss:0.0450
CLS loss:0.0024, REG loss:0.0004, ADV loss:0.0000, Loss:0.0028
CLS loss:0.0084, REG loss:0.0049, ADV loss:0.0000, Loss:0.0133
CLS loss:0.0026, REG loss:0.0017, ADV loss:0.0000, Loss:0.0043
Validate at epoch 4
CLS loss: 0.0410, REG loss: 1088013094978.4203
Over-all F1:0.7845, AUC:0.9625, F1-top:0.5634
Evaluate at epoch 4
CLS loss: 0.0414, REG loss: 238295599712.3444
Over-all F1:0.7521, AUC:0.9653, F1-top:0.5474
CLS loss:0.0053, REG loss:0.0062, ADV loss:0.0000, Loss:0.0115
CLS loss:0.0260, REG loss:0.0254, ADV loss:0.0000, Loss:0.0514
CLS loss:0.0045, REG loss:0.0010, ADV loss:0.0000, Loss:0.0055
CLS loss:0.0015, REG loss:0.0003, ADV loss:0.0000, Loss:0.0019
CLS loss:0.0071, REG loss:0.0016, ADV loss:0.0000, Loss:0.0087
CLS loss:0.0427, REG loss:0.0302, ADV loss:0.0000, Loss:0.0729
CLS loss:0.0016, REG loss:0.0008, ADV loss:0.0000, Loss:0.0024
Validate at epoch 5
CLS loss: 0.0429, REG loss: 1088013097093.2209
Over-all F1:0.7694, AUC:0.9613, F1-top:0.5581
Evaluate at epoch 5
CLS loss: 0.0469, REG loss: 238295600863.5125
Over-all F1:0.7034, AUC:0.9651, F1-top:0.5245
CLS loss:0.0110, REG loss:0.0015, ADV loss:0.0000, Loss:0.0125
CLS loss:0.0378, REG loss:0.0002, ADV loss:0.0000, Loss:0.0379
CLS loss:0.0302, REG loss:0.0025, ADV loss:0.0000, Loss:0.0327
CLS loss:0.0086, REG loss:0.0010, ADV loss:0.0000, Loss:0.0095
CLS loss:0.0023, REG loss:0.0011, ADV loss:0.0000, Loss:0.0034
CLS loss:0.0046, REG loss:0.0009, ADV loss:0.0000, Loss:0.0055
CLS loss:0.0143, REG loss:0.0006, ADV loss:0.0000, Loss:0.0149
Validate at epoch 6
CLS loss: 0.0385, REG loss: 1088013097280.8412
Over-all F1:0.7961, AUC:0.9649, F1-top:0.5681
Evaluate at epoch 6
CLS loss: 0.0420, REG loss: 238295599837.4056
Over-all F1:0.7548, AUC:0.9674, F1-top:0.5464
CLS loss:0.0349, REG loss:0.0055, ADV loss:0.0000, Loss:0.0404
CLS loss:0.0031, REG loss:0.0006, ADV loss:0.0000, Loss:0.0037
CLS loss:0.0051, REG loss:0.0011, ADV loss:0.0000, Loss:0.0062
CLS loss:0.0199, REG loss:0.0072, ADV loss:0.0000, Loss:0.0271
CLS loss:0.0058, REG loss:0.0003, ADV loss:0.0000, Loss:0.0061
CLS loss:0.0539, REG loss:0.0251, ADV loss:0.0000, Loss:0.0790
CLS loss:0.0049, REG loss:0.0005, ADV loss:0.0000, Loss:0.0053
Validate at epoch 7
CLS loss: 0.0418, REG loss: 1088013092256.3666
Over-all F1:0.7831, AUC:0.9588, F1-top:0.5631
Evaluate at epoch 7
CLS loss: 0.0475, REG loss: 238295599761.2683
Over-all F1:0.7192, AUC:0.9640, F1-top:0.5349
CLS loss:0.0292, REG loss:0.0005, ADV loss:0.0000, Loss:0.0297
CLS loss:0.0085, REG loss:0.0213, ADV loss:0.0000, Loss:0.0298
CLS loss:0.0626, REG loss:0.0036, ADV loss:0.0000, Loss:0.0662
CLS loss:0.0209, REG loss:0.0027, ADV loss:0.0000, Loss:0.0236
CLS loss:0.0223, REG loss:0.0175, ADV loss:0.0000, Loss:0.0398
CLS loss:0.0214, REG loss:0.0450, ADV loss:0.0000, Loss:0.0664
CLS loss:0.0413, REG loss:0.0011, ADV loss:0.0000, Loss:0.0425
Validate at epoch 8
CLS loss: 0.0434, REG loss: 1088013092041.5853
Over-all F1:0.7855, AUC:0.9611, F1-top:0.5670
Evaluate at epoch 8
CLS loss: 0.0579, REG loss: 238295598684.8223
Over-all F1:0.7349, AUC:0.9661, F1-top:0.5319
CLS loss:0.0202, REG loss:0.0262, ADV loss:0.0000, Loss:0.0464
CLS loss:0.0049, REG loss:0.0006, ADV loss:0.0000, Loss:0.0055
CLS loss:0.0030, REG loss:0.0048, ADV loss:0.0000, Loss:0.0078
CLS loss:0.0033, REG loss:0.0010, ADV loss:0.0000, Loss:0.0043
CLS loss:0.0052, REG loss:0.0033, ADV loss:0.0000, Loss:0.0085
CLS loss:0.0063, REG loss:0.0006, ADV loss:0.0000, Loss:0.0069
CLS loss:0.0136, REG loss:0.0119, ADV loss:0.0000, Loss:0.0255
Validate at epoch 9
CLS loss: 0.0395, REG loss: 1088013095950.8274
Over-all F1:0.8093, AUC:0.9615, F1-top:0.5742
Evaluate at epoch 9
CLS loss: 0.0517, REG loss: 238295599184.4741
Over-all F1:0.7511, AUC:0.9635, F1-top:0.5480
CLS loss:0.0024, REG loss:0.0003, ADV loss:0.0000, Loss:0.0027
CLS loss:0.0017, REG loss:0.0003, ADV loss:0.0000, Loss:0.0020
CLS loss:0.0362, REG loss:0.0199, ADV loss:0.0000, Loss:0.0561
CLS loss:0.0552, REG loss:0.0230, ADV loss:0.0000, Loss:0.0782
CLS loss:0.0201, REG loss:0.0045, ADV loss:0.0000, Loss:0.0246
CLS loss:0.0713, REG loss:0.0054, ADV loss:0.0000, Loss:0.0767
CLS loss:0.0119, REG loss:0.0003, ADV loss:0.0000, Loss:0.0122
Validate at epoch 10
CLS loss: 0.0373, REG loss: 1088013088468.0071
Over-all F1:0.8071, AUC:0.9673, F1-top:0.5771
Evaluate at epoch 10
CLS loss: 0.0591, REG loss: 238295597240.6063
Over-all F1:0.7371, AUC:0.9662, F1-top:0.5285

--------Evaluating DATE model---------
CLS loss: 0.0373, REG loss: 1088013088468.0071
CLS loss: 0.0591, REG loss: 238295597240.6063
Saving result... ./results/full.csv

Starting_date:14-06-01
 Metrics:
f1:0.7371 auc:0.9662
Pr@1:0.8463 Pr@2:0.7859 Pr@5:0.3804 Pr@10:0.2033
Re@1:0.3733 Re@2:0.6966 Re@5:0.8486 Re@10:0.9070
Rev@1:0.5219 Rev@2:0.7035 Rev@5:0.8471 Rev@10:0.9066
Namespace(act='relu', beta=0.0, date='14-12-01', device='cuda:1', dim=16, epoch=10, fusion='concat', head_num=4, l2=0.0, lr=0.005, output='full.csv', save=1)
./data/torch_data_14-12-01.pickle
CLS loss:0.0378, REG loss:0.0408, ADV loss:0.0000, Loss:0.0786
CLS loss:0.0243, REG loss:0.0283, ADV loss:0.0000, Loss:0.0526
CLS loss:0.0104, REG loss:0.0082, ADV loss:0.0000, Loss:0.0187
CLS loss:0.0097, REG loss:0.0133, ADV loss:0.0000, Loss:0.0231
CLS loss:0.0326, REG loss:0.0045, ADV loss:0.0000, Loss:0.0371
Validate at epoch 1
CLS loss: 0.0400, REG loss: 1088013097303.3710
Over-all F1:0.7796, AUC:0.9627, F1-top:0.5594
Evaluate at epoch 1
CLS loss: 0.0523, REG loss: 238295600921.6474
Over-all F1:0.6464, AUC:0.9569, F1-top:0.5224
CLS loss:0.0354, REG loss:0.0211, ADV loss:0.0000, Loss:0.0564
CLS loss:0.0077, REG loss:0.0025, ADV loss:0.0000, Loss:0.0102
CLS loss:0.0188, REG loss:0.0023, ADV loss:0.0000, Loss:0.0211
CLS loss:0.0268, REG loss:0.0137, ADV loss:0.0000, Loss:0.0405
CLS loss:0.0078, REG loss:0.0056, ADV loss:0.0000, Loss:0.0134
Validate at epoch 2
CLS loss: 0.0396, REG loss: 1088013095722.8833
Over-all F1:0.7969, AUC:0.9654, F1-top:0.5665
Evaluate at epoch 2
CLS loss: 0.0936, REG loss: 238295599980.0929
Over-all F1:0.6424, AUC:0.9420, F1-top:0.5264
CLS loss:0.0172, REG loss:0.0119, ADV loss:0.0000, Loss:0.0290
CLS loss:0.0299, REG loss:0.0182, ADV loss:0.0000, Loss:0.0481
CLS loss:0.0268, REG loss:0.0298, ADV loss:0.0000, Loss:0.0566
CLS loss:0.0224, REG loss:0.0003, ADV loss:0.0000, Loss:0.0227
CLS loss:0.0235, REG loss:0.0159, ADV loss:0.0000, Loss:0.0395
Validate at epoch 3
CLS loss: 0.0391, REG loss: 1088013092767.1727
Over-all F1:0.8007, AUC:0.9648, F1-top:0.5690
Evaluate at epoch 3
CLS loss: 0.0846, REG loss: 238295598528.3875
Over-all F1:0.6462, AUC:0.9527, F1-top:0.5137
CLS loss:0.0684, REG loss:0.0018, ADV loss:0.0000, Loss:0.0702
CLS loss:0.0029, REG loss:0.0028, ADV loss:0.0000, Loss:0.0057
CLS loss:0.0043, REG loss:0.0020, ADV loss:0.0000, Loss:0.0064
CLS loss:0.0468, REG loss:0.0006, ADV loss:0.0000, Loss:0.0475
CLS loss:0.0041, REG loss:0.0014, ADV loss:0.0000, Loss:0.0055
Validate at epoch 4
CLS loss: 0.0403, REG loss: 1088013095546.6678
Over-all F1:0.8103, AUC:0.9652, F1-top:0.5739
Evaluate at epoch 4
CLS loss: 0.0942, REG loss: 238295598657.8427
Over-all F1:0.6392, AUC:0.9496, F1-top:0.5161
CLS loss:0.0452, REG loss:0.0018, ADV loss:0.0000, Loss:0.0470
CLS loss:0.0375, REG loss:0.0281, ADV loss:0.0000, Loss:0.0656
CLS loss:0.0064, REG loss:0.0080, ADV loss:0.0000, Loss:0.0144
CLS loss:0.0142, REG loss:0.0183, ADV loss:0.0000, Loss:0.0326
CLS loss:0.0184, REG loss:0.0014, ADV loss:0.0000, Loss:0.0199
Validate at epoch 5
CLS loss: 0.0372, REG loss: 1088013094094.3890
Over-all F1:0.8176, AUC:0.9638, F1-top:0.5750
Evaluate at epoch 5
CLS loss: 0.0661, REG loss: 238295599691.0296
Over-all F1:0.6730, AUC:0.9504, F1-top:0.5234
CLS loss:0.0047, REG loss:0.0021, ADV loss:0.0000, Loss:0.0067
CLS loss:0.0028, REG loss:0.0003, ADV loss:0.0000, Loss:0.0031
CLS loss:0.0079, REG loss:0.0014, ADV loss:0.0000, Loss:0.0093
CLS loss:0.0109, REG loss:0.0002, ADV loss:0.0000, Loss:0.0111
CLS loss:0.0181, REG loss:0.0004, ADV loss:0.0000, Loss:0.0186
Validate at epoch 6
CLS loss: 0.0392, REG loss: 1088013094096.9476
Over-all F1:0.8088, AUC:0.9615, F1-top:0.5727
Evaluate at epoch 6
CLS loss: 0.0692, REG loss: 238295598634.8470
Over-all F1:0.6896, AUC:0.9588, F1-top:0.5275
CLS loss:0.0010, REG loss:0.0011, ADV loss:0.0000, Loss:0.0021
CLS loss:0.0186, REG loss:0.0014, ADV loss:0.0000, Loss:0.0200
CLS loss:0.0595, REG loss:0.0316, ADV loss:0.0000, Loss:0.0911
CLS loss:0.0063, REG loss:0.0008, ADV loss:0.0000, Loss:0.0071
CLS loss:0.0077, REG loss:0.0139, ADV loss:0.0000, Loss:0.0216
Validate at epoch 7
CLS loss: 0.0402, REG loss: 1088013094559.0637
Over-all F1:0.8020, AUC:0.9632, F1-top:0.5696
Evaluate at epoch 7
CLS loss: 0.0773, REG loss: 238295599368.8993
Over-all F1:0.6016, AUC:0.9561, F1-top:0.4950
CLS loss:0.0068, REG loss:0.0029, ADV loss:0.0000, Loss:0.0096
CLS loss:0.0145, REG loss:0.0214, ADV loss:0.0000, Loss:0.0359
CLS loss:0.0037, REG loss:0.0002, ADV loss:0.0000, Loss:0.0039
CLS loss:0.0019, REG loss:0.0003, ADV loss:0.0000, Loss:0.0022
CLS loss:0.0079, REG loss:0.0073, ADV loss:0.0000, Loss:0.0152
Validate at epoch 8
CLS loss: 0.0403, REG loss: 1088013092483.2316
Over-all F1:0.8199, AUC:0.9658, F1-top:0.5779
Evaluate at epoch 8
CLS loss: 0.0829, REG loss: 238295598201.3129
Over-all F1:0.6875, AUC:0.9642, F1-top:0.5241
CLS loss:0.0245, REG loss:0.0145, ADV loss:0.0000, Loss:0.0391
CLS loss:0.0551, REG loss:0.0321, ADV loss:0.0000, Loss:0.0872
CLS loss:0.0305, REG loss:0.0286, ADV loss:0.0000, Loss:0.0591
CLS loss:0.0176, REG loss:0.0006, ADV loss:0.0000, Loss:0.0181
CLS loss:0.0315, REG loss:0.0014, ADV loss:0.0000, Loss:0.0329
Validate at epoch 9
CLS loss: 0.0401, REG loss: 1088013097485.9076
Over-all F1:0.8228, AUC:0.9628, F1-top:0.5792
Evaluate at epoch 9
CLS loss: 0.1312, REG loss: 238295598808.5086
Over-all F1:0.6016, AUC:0.9545, F1-top:0.5024
CLS loss:0.0018, REG loss:0.0004, ADV loss:0.0000, Loss:0.0021
CLS loss:0.0029, REG loss:0.0005, ADV loss:0.0000, Loss:0.0034
CLS loss:0.0005, REG loss:0.0008, ADV loss:0.0000, Loss:0.0013
CLS loss:0.0026, REG loss:0.0001, ADV loss:0.0000, Loss:0.0027
CLS loss:0.0701, REG loss:0.0520, ADV loss:0.0000, Loss:0.1221
Validate at epoch 10
CLS loss: 0.0436, REG loss: 1088013089897.5588
Over-all F1:0.8338, AUC:0.9648, F1-top:0.5809
Evaluate at epoch 10
CLS loss: 0.1011, REG loss: 238295597752.7839
Over-all F1:0.6824, AUC:0.9607, F1-top:0.5140

--------Evaluating DATE model---------
CLS loss: 0.0436, REG loss: 1088013089897.5588
CLS loss: 0.1011, REG loss: 238295597752.7839
Saving result... ./results/full.csv

Starting_date:14-12-01
 Metrics:
f1:0.6824 auc:0.9607
Pr@1:0.8716 Pr@2:0.7253 Pr@5:0.3700 Pr@10:0.1978
Re@1:0.3890 Re@2:0.6472 Re@5:0.8254 Re@10:0.8825
Rev@1:0.5212 Rev@2:0.6773 Rev@5:0.8056 Rev@10:0.8773
Namespace(act='relu', beta=0.0, date='14-06-01', device='cuda:1', dim=16, epoch=10, fusion='concat', head_num=4, l2=0.0, lr=0.005, output='full.csv', save=1)
./data/torch_data_14-06-01.pickle
CLS loss:0.0176, REG loss:0.0199, ADV loss:0.0000, Loss:0.0374
CLS loss:0.0339, REG loss:0.0182, ADV loss:0.0000, Loss:0.0521
CLS loss:0.0149, REG loss:0.0069, ADV loss:0.0000, Loss:0.0218
CLS loss:0.0847, REG loss:0.0816, ADV loss:0.0000, Loss:0.1663
CLS loss:0.0515, REG loss:0.0092, ADV loss:0.0000, Loss:0.0606
CLS loss:0.0566, REG loss:0.0070, ADV loss:0.0000, Loss:0.0636
CLS loss:0.0502, REG loss:0.0288, ADV loss:0.0000, Loss:0.0790
Validate at epoch 1
CLS loss: 0.0409, REG loss: 1088013099452.8618
Over-all F1:0.7798, AUC:0.9576, F1-top:0.5557
Evaluate at epoch 1
CLS loss: 0.0395, REG loss: 238295602563.7271
Over-all F1:0.7611, AUC:0.9601, F1-top:0.5433
CLS loss:0.0501, REG loss:0.0711, ADV loss:0.0000, Loss:0.1212
CLS loss:0.0693, REG loss:0.0038, ADV loss:0.0000, Loss:0.0731
CLS loss:0.0434, REG loss:0.0327, ADV loss:0.0000, Loss:0.0761
CLS loss:0.0254, REG loss:0.0097, ADV loss:0.0000, Loss:0.0352
CLS loss:0.0067, REG loss:0.0011, ADV loss:0.0000, Loss:0.0078
CLS loss:0.0079, REG loss:0.0024, ADV loss:0.0000, Loss:0.0104
CLS loss:0.0196, REG loss:0.0017, ADV loss:0.0000, Loss:0.0213
Validate at epoch 2
CLS loss: 0.0394, REG loss: 1088013097243.3469
Over-all F1:0.7864, AUC:0.9604, F1-top:0.5629
Evaluate at epoch 2
CLS loss: 0.0396, REG loss: 238295601639.9055
Over-all F1:0.7513, AUC:0.9624, F1-top:0.5455
CLS loss:0.0025, REG loss:0.0015, ADV loss:0.0000, Loss:0.0039
CLS loss:0.0436, REG loss:0.0051, ADV loss:0.0000, Loss:0.0487
CLS loss:0.0305, REG loss:0.0080, ADV loss:0.0000, Loss:0.0384
CLS loss:0.0621, REG loss:0.0555, ADV loss:0.0000, Loss:0.1176
CLS loss:0.0043, REG loss:0.0021, ADV loss:0.0000, Loss:0.0064
CLS loss:0.0713, REG loss:0.0237, ADV loss:0.0000, Loss:0.0950
CLS loss:0.0238, REG loss:0.0314, ADV loss:0.0000, Loss:0.0552
Validate at epoch 3
CLS loss: 0.0369, REG loss: 1088013096239.1681
Over-all F1:0.8045, AUC:0.9659, F1-top:0.5717
Evaluate at epoch 3
CLS loss: 0.0422, REG loss: 238295600057.5587
Over-all F1:0.7534, AUC:0.9656, F1-top:0.5489
CLS loss:0.0123, REG loss:0.0121, ADV loss:0.0000, Loss:0.0244
CLS loss:0.0158, REG loss:0.0147, ADV loss:0.0000, Loss:0.0306
CLS loss:0.0105, REG loss:0.0044, ADV loss:0.0000, Loss:0.0149
CLS loss:0.0097, REG loss:0.0030, ADV loss:0.0000, Loss:0.0128
CLS loss:0.0515, REG loss:0.0009, ADV loss:0.0000, Loss:0.0524
CLS loss:0.0749, REG loss:0.0450, ADV loss:0.0000, Loss:0.1198
CLS loss:0.0225, REG loss:0.0133, ADV loss:0.0000, Loss:0.0357
Validate at epoch 4
CLS loss: 0.0393, REG loss: 1088013096503.5908
Over-all F1:0.8007, AUC:0.9649, F1-top:0.5680
Evaluate at epoch 4
CLS loss: 0.0452, REG loss: 238295600471.8192
Over-all F1:0.7432, AUC:0.9672, F1-top:0.5437
CLS loss:0.0118, REG loss:0.0143, ADV loss:0.0000, Loss:0.0261
CLS loss:0.0226, REG loss:0.0026, ADV loss:0.0000, Loss:0.0252
CLS loss:0.0034, REG loss:0.0020, ADV loss:0.0000, Loss:0.0054
CLS loss:0.0451, REG loss:0.0002, ADV loss:0.0000, Loss:0.0453
CLS loss:0.0346, REG loss:0.0273, ADV loss:0.0000, Loss:0.0620
CLS loss:0.0232, REG loss:0.0271, ADV loss:0.0000, Loss:0.0502
CLS loss:0.0028, REG loss:0.0006, ADV loss:0.0000, Loss:0.0034
Validate at epoch 5
CLS loss: 0.0365, REG loss: 1088013095586.4877
Over-all F1:0.8223, AUC:0.9659, F1-top:0.5776
Evaluate at epoch 5
CLS loss: 0.0429, REG loss: 238295599999.5320
Over-all F1:0.7464, AUC:0.9662, F1-top:0.5405
CLS loss:0.0090, REG loss:0.0021, ADV loss:0.0000, Loss:0.0111
CLS loss:0.0457, REG loss:0.0170, ADV loss:0.0000, Loss:0.0627
CLS loss:0.0086, REG loss:0.0009, ADV loss:0.0000, Loss:0.0095
CLS loss:0.0407, REG loss:0.0013, ADV loss:0.0000, Loss:0.0420
CLS loss:0.0423, REG loss:0.0012, ADV loss:0.0000, Loss:0.0435
CLS loss:0.0075, REG loss:0.0028, ADV loss:0.0000, Loss:0.0103
CLS loss:0.0032, REG loss:0.0019, ADV loss:0.0000, Loss:0.0051
Validate at epoch 6
CLS loss: 0.0360, REG loss: 1088013092630.5397
Over-all F1:0.8255, AUC:0.9671, F1-top:0.5785
Evaluate at epoch 6
CLS loss: 0.0455, REG loss: 238295599366.8997
Over-all F1:0.7559, AUC:0.9683, F1-top:0.5536
CLS loss:0.0380, REG loss:0.0592, ADV loss:0.0000, Loss:0.0972
CLS loss:0.0047, REG loss:0.0038, ADV loss:0.0000, Loss:0.0084
CLS loss:0.0052, REG loss:0.0065, ADV loss:0.0000, Loss:0.0117
CLS loss:0.0316, REG loss:0.0296, ADV loss:0.0000, Loss:0.0612
CLS loss:0.0029, REG loss:0.0011, ADV loss:0.0000, Loss:0.0040
CLS loss:0.0096, REG loss:0.0013, ADV loss:0.0000, Loss:0.0109
CLS loss:0.0177, REG loss:0.0022, ADV loss:0.0000, Loss:0.0199
Validate at epoch 7
CLS loss: 0.0358, REG loss: 1088013092444.3586
Over-all F1:0.8141, AUC:0.9689, F1-top:0.5748
Evaluate at epoch 7
CLS loss: 0.0483, REG loss: 238295599177.8809
Over-all F1:0.7443, AUC:0.9671, F1-top:0.5450
CLS loss:0.0641, REG loss:0.0345, ADV loss:0.0000, Loss:0.0986
CLS loss:0.0086, REG loss:0.0006, ADV loss:0.0000, Loss:0.0092
CLS loss:0.0029, REG loss:0.0194, ADV loss:0.0000, Loss:0.0223
CLS loss:0.0097, REG loss:0.0025, ADV loss:0.0000, Loss:0.0122
CLS loss:0.0068, REG loss:0.0007, ADV loss:0.0000, Loss:0.0075
CLS loss:0.0256, REG loss:0.0292, ADV loss:0.0000, Loss:0.0548
CLS loss:0.0041, REG loss:0.0007, ADV loss:0.0000, Loss:0.0048
Validate at epoch 8
CLS loss: 0.0377, REG loss: 1088013093023.2129
Over-all F1:0.8063, AUC:0.9668, F1-top:0.5732
Evaluate at epoch 8
CLS loss: 0.0511, REG loss: 238295599504.4420
Over-all F1:0.7388, AUC:0.9670, F1-top:0.5388
CLS loss:0.0029, REG loss:0.0003, ADV loss:0.0000, Loss:0.0031
CLS loss:0.0254, REG loss:0.0139, ADV loss:0.0000, Loss:0.0393
CLS loss:0.0021, REG loss:0.0020, ADV loss:0.0000, Loss:0.0041
CLS loss:0.0043, REG loss:0.0022, ADV loss:0.0000, Loss:0.0065
CLS loss:0.0352, REG loss:0.0329, ADV loss:0.0000, Loss:0.0681
CLS loss:0.0374, REG loss:0.0060, ADV loss:0.0000, Loss:0.0433
CLS loss:0.0687, REG loss:0.0051, ADV loss:0.0000, Loss:0.0738
Validate at epoch 9
CLS loss: 0.0397, REG loss: 1088013095082.6982
Over-all F1:0.8010, AUC:0.9677, F1-top:0.5700
Evaluate at epoch 9
CLS loss: 0.0548, REG loss: 238295599030.8694
Over-all F1:0.7182, AUC:0.9660, F1-top:0.5274
Early stopping...

--------Evaluating DATE model---------
CLS loss: 0.0360, REG loss: 1088013092630.5397
CLS loss: 0.0455, REG loss: 238295599366.8997
Saving result... ./results/full.csv

Starting_date:14-06-01
 Metrics:
f1:0.7559 auc:0.9683
Pr@1:0.9624 Pr@2:0.8108 Pr@5:0.3808 Pr@10:0.2019
Re@1:0.4295 Re@2:0.7235 Re@5:0.8496 Re@10:0.9007
Rev@1:0.4437 Rev@2:0.7142 Rev@5:0.8322 Rev@10:0.8837
Namespace(act='relu', beta=0.0, date='14-12-01', device='cuda:1', dim=16, epoch=10, fusion='concat', head_num=4, l2=0.0, lr=0.005, output='full.csv', save=1)
./data/torch_data_14-12-01.pickle
CLS loss:0.0181, REG loss:0.0039, ADV loss:0.0000, Loss:0.0220
CLS loss:0.0315, REG loss:0.0278, ADV loss:0.0000, Loss:0.0594
CLS loss:0.0387, REG loss:0.0009, ADV loss:0.0000, Loss:0.0396
CLS loss:0.0168, REG loss:0.0050, ADV loss:0.0000, Loss:0.0218
CLS loss:0.0760, REG loss:0.0258, ADV loss:0.0000, Loss:0.1018
Validate at epoch 1
CLS loss: 0.0383, REG loss: 1088013097615.8987
Over-all F1:0.7912, AUC:0.9659, F1-top:0.5619
Evaluate at epoch 1
CLS loss: 0.0558, REG loss: 238295601250.5594
Over-all F1:0.7246, AUC:0.9550, F1-top:0.5305
CLS loss:0.0251, REG loss:0.0027, ADV loss:0.0000, Loss:0.0278
CLS loss:0.0181, REG loss:0.0069, ADV loss:0.0000, Loss:0.0250
CLS loss:0.0099, REG loss:0.0125, ADV loss:0.0000, Loss:0.0224
CLS loss:0.0075, REG loss:0.0034, ADV loss:0.0000, Loss:0.0108
CLS loss:0.0520, REG loss:0.0012, ADV loss:0.0000, Loss:0.0532
Validate at epoch 2
CLS loss: 0.0384, REG loss: 1088013095940.3425
Over-all F1:0.8021, AUC:0.9613, F1-top:0.5672
Evaluate at epoch 2
CLS loss: 0.0579, REG loss: 238295600949.9973
Over-all F1:0.6389, AUC:0.9532, F1-top:0.5255
CLS loss:0.0286, REG loss:0.0330, ADV loss:0.0000, Loss:0.0616
CLS loss:0.0136, REG loss:0.0044, ADV loss:0.0000, Loss:0.0180
CLS loss:0.0063, REG loss:0.0006, ADV loss:0.0000, Loss:0.0069
CLS loss:0.0025, REG loss:0.0025, ADV loss:0.0000, Loss:0.0050
CLS loss:0.0170, REG loss:0.0095, ADV loss:0.0000, Loss:0.0265
Validate at epoch 3
CLS loss: 0.0376, REG loss: 1088013091981.2688
Over-all F1:0.8038, AUC:0.9608, F1-top:0.5716
Evaluate at epoch 3
CLS loss: 0.0581, REG loss: 238295599657.9686
Over-all F1:0.6631, AUC:0.9545, F1-top:0.5277
CLS loss:0.0049, REG loss:0.0032, ADV loss:0.0000, Loss:0.0080
CLS loss:0.0219, REG loss:0.0290, ADV loss:0.0000, Loss:0.0508
CLS loss:0.0060, REG loss:0.0087, ADV loss:0.0000, Loss:0.0147
CLS loss:0.0158, REG loss:0.0027, ADV loss:0.0000, Loss:0.0185
CLS loss:0.0084, REG loss:0.0055, ADV loss:0.0000, Loss:0.0139
Validate at epoch 4
CLS loss: 0.0373, REG loss: 1088013092872.3898
Over-all F1:0.8064, AUC:0.9629, F1-top:0.5711
Evaluate at epoch 4
CLS loss: 0.0649, REG loss: 238295599625.3930
Over-all F1:0.6221, AUC:0.9549, F1-top:0.5205
CLS loss:0.0549, REG loss:0.0367, ADV loss:0.0000, Loss:0.0916
CLS loss:0.0208, REG loss:0.0027, ADV loss:0.0000, Loss:0.0236
CLS loss:0.0018, REG loss:0.0005, ADV loss:0.0000, Loss:0.0023
CLS loss:0.0167, REG loss:0.0091, ADV loss:0.0000, Loss:0.0258
CLS loss:0.0036, REG loss:0.0009, ADV loss:0.0000, Loss:0.0045
Validate at epoch 5
CLS loss: 0.0406, REG loss: 1088013092630.4286
Over-all F1:0.7886, AUC:0.9619, F1-top:0.5652
Evaluate at epoch 5
CLS loss: 0.0719, REG loss: 238295600117.5798
Over-all F1:0.6066, AUC:0.9434, F1-top:0.5000
CLS loss:0.0148, REG loss:0.0249, ADV loss:0.0000, Loss:0.0397
CLS loss:0.0089, REG loss:0.0000, ADV loss:0.0000, Loss:0.0090
CLS loss:0.0097, REG loss:0.0027, ADV loss:0.0000, Loss:0.0124
CLS loss:0.0099, REG loss:0.0018, ADV loss:0.0000, Loss:0.0117
CLS loss:0.0142, REG loss:0.0036, ADV loss:0.0000, Loss:0.0179
Validate at epoch 6
CLS loss: 0.0383, REG loss: 1088013091809.4963
Over-all F1:0.8013, AUC:0.9663, F1-top:0.5702
Evaluate at epoch 6
CLS loss: 0.0803, REG loss: 238295599178.7820
Over-all F1:0.5710, AUC:0.9542, F1-top:0.5038
CLS loss:0.0541, REG loss:0.0334, ADV loss:0.0000, Loss:0.0875
CLS loss:0.0045, REG loss:0.0010, ADV loss:0.0000, Loss:0.0055
CLS loss:0.0197, REG loss:0.0002, ADV loss:0.0000, Loss:0.0199
CLS loss:0.0652, REG loss:0.0003, ADV loss:0.0000, Loss:0.0656
CLS loss:0.0112, REG loss:0.0027, ADV loss:0.0000, Loss:0.0139
Validate at epoch 7
CLS loss: 0.0388, REG loss: 1088013091851.2316
Over-all F1:0.8266, AUC:0.9676, F1-top:0.5790
Evaluate at epoch 7
CLS loss: 0.0694, REG loss: 238295598884.9869
Over-all F1:0.6994, AUC:0.9606, F1-top:0.5419
CLS loss:0.0011, REG loss:0.0010, ADV loss:0.0000, Loss:0.0021
CLS loss:0.0054, REG loss:0.0048, ADV loss:0.0000, Loss:0.0102
CLS loss:0.0013, REG loss:0.0012, ADV loss:0.0000, Loss:0.0025
CLS loss:0.0029, REG loss:0.0005, ADV loss:0.0000, Loss:0.0034
CLS loss:0.0193, REG loss:0.0093, ADV loss:0.0000, Loss:0.0286
Validate at epoch 8
CLS loss: 0.0400, REG loss: 1088013091370.4675
Over-all F1:0.8073, AUC:0.9636, F1-top:0.5690
Evaluate at epoch 8
CLS loss: 0.0774, REG loss: 238295598826.6303
Over-all F1:0.6342, AUC:0.9572, F1-top:0.5133
CLS loss:0.0548, REG loss:0.0699, ADV loss:0.0000, Loss:0.1247
CLS loss:0.0048, REG loss:0.0021, ADV loss:0.0000, Loss:0.0069
CLS loss:0.0018, REG loss:0.0010, ADV loss:0.0000, Loss:0.0029
CLS loss:0.0048, REG loss:0.0004, ADV loss:0.0000, Loss:0.0052
CLS loss:0.0071, REG loss:0.0055, ADV loss:0.0000, Loss:0.0126
Validate at epoch 9
CLS loss: 0.0423, REG loss: 1088013091928.7146
Over-all F1:0.8007, AUC:0.9607, F1-top:0.5657
Evaluate at epoch 9
CLS loss: 0.1036, REG loss: 238295599099.8159
Over-all F1:0.5994, AUC:0.9509, F1-top:0.4994
CLS loss:0.0050, REG loss:0.0002, ADV loss:0.0000, Loss:0.0052
CLS loss:0.0226, REG loss:0.0259, ADV loss:0.0000, Loss:0.0485
CLS loss:0.0078, REG loss:0.0006, ADV loss:0.0000, Loss:0.0084
CLS loss:0.0023, REG loss:0.0011, ADV loss:0.0000, Loss:0.0034
CLS loss:0.0047, REG loss:0.0004, ADV loss:0.0000, Loss:0.0051
Validate at epoch 10
CLS loss: 0.0455, REG loss: 1088013090664.0983
Over-all F1:0.8089, AUC:0.9646, F1-top:0.5712
Evaluate at epoch 10
CLS loss: 0.1249, REG loss: 238295598115.4538
Over-all F1:0.6657, AUC:0.9562, F1-top:0.5051

--------Evaluating DATE model---------
CLS loss: 0.0388, REG loss: 1088013091851.2316
CLS loss: 0.0694, REG loss: 238295598884.9869
Saving result... ./results/full.csv

Starting_date:14-12-01
 Metrics:
f1:0.6994 auc:0.9606
Pr@1:0.9400 Pr@2:0.7932 Pr@5:0.3724 Pr@10:0.1992
Re@1:0.4195 Re@2:0.7076 Re@5:0.8307 Re@10:0.8885
Rev@1:0.4494 Rev@2:0.6853 Rev@5:0.8173 Rev@10:0.8985
Namespace(act='relu', beta=0.0, date='15-06-01', device='cuda:1', dim=16, epoch=10, fusion='concat', head_num=4, l2=0.0, lr=0.005, output='full.csv', save=1)
./data/torch_data_15-06-01.pickle
CLS loss:0.0297, REG loss:0.0229, ADV loss:0.0000, Loss:0.0526
CLS loss:0.0151, REG loss:0.0283, ADV loss:0.0000, Loss:0.0434
CLS loss:0.0066, REG loss:0.0455, ADV loss:0.0000, Loss:0.0521
Validate at epoch 1
CLS loss: 0.0451, REG loss: 1088013096487.8857
Over-all F1:0.7362, AUC:0.9551, F1-top:0.5410
Evaluate at epoch 1
CLS loss: 0.0476, REG loss: 238295602519.9516
Over-all F1:0.6841, AUC:0.9592, F1-top:0.5201
CLS loss:0.0316, REG loss:0.0351, ADV loss:0.0000, Loss:0.0667
CLS loss:0.0076, REG loss:0.0009, ADV loss:0.0000, Loss:0.0085
CLS loss:0.0104, REG loss:0.0078, ADV loss:0.0000, Loss:0.0183
Validate at epoch 2
CLS loss: 0.0441, REG loss: 1088013096666.8105
Over-all F1:0.7581, AUC:0.9544, F1-top:0.5508
Evaluate at epoch 2
CLS loss: 0.0478, REG loss: 238295602321.5459
Over-all F1:0.6506, AUC:0.9569, F1-top:0.5170
CLS loss:0.0380, REG loss:0.0257, ADV loss:0.0000, Loss:0.0637
CLS loss:0.0094, REG loss:0.0010, ADV loss:0.0000, Loss:0.0104
CLS loss:0.0034, REG loss:0.0010, ADV loss:0.0000, Loss:0.0044
Validate at epoch 3
CLS loss: 0.0435, REG loss: 1088013094082.3519
Over-all F1:0.7931, AUC:0.9557, F1-top:0.5645
Evaluate at epoch 3
CLS loss: 0.0666, REG loss: 238295599887.4161
Over-all F1:0.6819, AUC:0.9570, F1-top:0.5291
CLS loss:0.0126, REG loss:0.0079, ADV loss:0.0000, Loss:0.0205
CLS loss:0.0021, REG loss:0.0008, ADV loss:0.0000, Loss:0.0029
CLS loss:0.0024, REG loss:0.0007, ADV loss:0.0000, Loss:0.0031
Validate at epoch 4
CLS loss: 0.0429, REG loss: 1088013093668.8534
Over-all F1:0.7861, AUC:0.9569, F1-top:0.5638
Evaluate at epoch 4
CLS loss: 0.0589, REG loss: 238295600306.1960
Over-all F1:0.6907, AUC:0.9528, F1-top:0.5336
CLS loss:0.0045, REG loss:0.0019, ADV loss:0.0000, Loss:0.0064
CLS loss:0.0223, REG loss:0.0325, ADV loss:0.0000, Loss:0.0548
CLS loss:0.0027, REG loss:0.0016, ADV loss:0.0000, Loss:0.0043
Validate at epoch 5
CLS loss: 0.0412, REG loss: 1088013091183.4869
Over-all F1:0.7990, AUC:0.9598, F1-top:0.5659
Evaluate at epoch 5
CLS loss: 0.0684, REG loss: 238295597849.4574
Over-all F1:0.6512, AUC:0.9578, F1-top:0.5331
CLS loss:0.0027, REG loss:0.0011, ADV loss:0.0000, Loss:0.0038
CLS loss:0.0177, REG loss:0.0198, ADV loss:0.0000, Loss:0.0376
CLS loss:0.0042, REG loss:0.0015, ADV loss:0.0000, Loss:0.0058
Validate at epoch 6
CLS loss: 0.0429, REG loss: 1088013091658.6993
Over-all F1:0.8007, AUC:0.9546, F1-top:0.5672
Evaluate at epoch 6
CLS loss: 0.0677, REG loss: 238295598451.1469
Over-all F1:0.6646, AUC:0.9529, F1-top:0.5392
CLS loss:0.0084, REG loss:0.0095, ADV loss:0.0000, Loss:0.0179
CLS loss:0.0099, REG loss:0.0041, ADV loss:0.0000, Loss:0.0140
CLS loss:0.0016, REG loss:0.0167, ADV loss:0.0000, Loss:0.0183
Validate at epoch 7
CLS loss: 0.0456, REG loss: 1088013091905.2925
Over-all F1:0.7979, AUC:0.9617, F1-top:0.5665
Evaluate at epoch 7
CLS loss: 0.0788, REG loss: 238295597585.5939
Over-all F1:0.6440, AUC:0.9556, F1-top:0.5281
CLS loss:0.0044, REG loss:0.0001, ADV loss:0.0000, Loss:0.0045
CLS loss:0.0111, REG loss:0.0085, ADV loss:0.0000, Loss:0.0196
CLS loss:0.0158, REG loss:0.0136, ADV loss:0.0000, Loss:0.0295
Validate at epoch 8
CLS loss: 0.0407, REG loss: 1088013091801.1230
Over-all F1:0.8142, AUC:0.9521, F1-top:0.5719
Evaluate at epoch 8
CLS loss: 0.0985, REG loss: 238295598279.8668
Over-all F1:0.6419, AUC:0.9522, F1-top:0.5258
CLS loss:0.0170, REG loss:0.0123, ADV loss:0.0000, Loss:0.0293
CLS loss:0.0338, REG loss:0.0081, ADV loss:0.0000, Loss:0.0419
CLS loss:0.0029, REG loss:0.0006, ADV loss:0.0000, Loss:0.0035
Validate at epoch 9
CLS loss: 0.0453, REG loss: 1088013092581.8693
Over-all F1:0.8066, AUC:0.9596, F1-top:0.5715
Evaluate at epoch 9
CLS loss: 0.0977, REG loss: 238295598976.3944
Over-all F1:0.6772, AUC:0.9557, F1-top:0.5305
CLS loss:0.0022, REG loss:0.0002, ADV loss:0.0000, Loss:0.0024
CLS loss:0.0046, REG loss:0.0016, ADV loss:0.0000, Loss:0.0062
CLS loss:0.0047, REG loss:0.0008, ADV loss:0.0000, Loss:0.0056
Validate at epoch 10
CLS loss: 0.0483, REG loss: 1088013091772.8732
Over-all F1:0.8014, AUC:0.9546, F1-top:0.5650
Evaluate at epoch 10
CLS loss: 0.0942, REG loss: 238295598277.2279
Over-all F1:0.6597, AUC:0.9576, F1-top:0.5201

--------Evaluating DATE model---------
CLS loss: 0.0407, REG loss: 1088013091801.1230
CLS loss: 0.0985, REG loss: 238295598279.8668
Saving result... ./results/full.csv

Starting_date:15-06-01
 Metrics:
f1:0.6419 auc:0.9522
Pr@1:0.8846 Pr@2:0.7627 Pr@5:0.3729 Pr@10:0.1979
Re@1:0.3948 Re@2:0.6804 Re@5:0.8318 Re@10:0.8807
Rev@1:0.4488 Rev@2:0.6711 Rev@5:0.8039 Rev@10:0.8554
Namespace(act='relu', beta=0.0, date='15-12-01', device='cuda:1', dim=16, epoch=10, fusion='concat', head_num=4, l2=0.0, lr=0.005, output='full.csv', save=1)
./data/torch_data_15-12-01.pickle
CLS loss:0.0289, REG loss:0.0258, ADV loss:0.0000, Loss:0.0547
CLS loss:0.0266, REG loss:0.0576, ADV loss:0.0000, Loss:0.0842
Validate at epoch 1
CLS loss: 0.0611, REG loss: 1088013098821.0342
Over-all F1:0.6227, AUC:0.9324, F1-top:0.4870
Evaluate at epoch 1
CLS loss: 0.0690, REG loss: 238295601454.6407
Over-all F1:0.5762, AUC:0.9374, F1-top:0.4560
CLS loss:0.0027, REG loss:0.0012, ADV loss:0.0000, Loss:0.0039
CLS loss:0.0041, REG loss:0.0127, ADV loss:0.0000, Loss:0.0167
Validate at epoch 2
CLS loss: 0.0640, REG loss: 1088013100646.9913
Over-all F1:0.6387, AUC:0.9346, F1-top:0.4962
Evaluate at epoch 2
CLS loss: 0.0629, REG loss: 238295603074.3081
Over-all F1:0.5636, AUC:0.9386, F1-top:0.4573
CLS loss:0.0086, REG loss:0.0018, ADV loss:0.0000, Loss:0.0104
CLS loss:0.0247, REG loss:0.0581, ADV loss:0.0000, Loss:0.0828
Validate at epoch 3
CLS loss: 0.0622, REG loss: 1088013097165.5129
Over-all F1:0.6542, AUC:0.9370, F1-top:0.5007
Evaluate at epoch 3
CLS loss: 0.0684, REG loss: 238295602154.3936
Over-all F1:0.5219, AUC:0.9329, F1-top:0.4513
CLS loss:0.0066, REG loss:0.0022, ADV loss:0.0000, Loss:0.0089
CLS loss:0.0040, REG loss:0.0030, ADV loss:0.0000, Loss:0.0071
Validate at epoch 4
CLS loss: 0.0626, REG loss: 1088013094820.7682
Over-all F1:0.6779, AUC:0.9323, F1-top:0.5100
Evaluate at epoch 4
CLS loss: 0.0854, REG loss: 238295600668.6414
Over-all F1:0.4783, AUC:0.9278, F1-top:0.4391
CLS loss:0.0331, REG loss:0.0316, ADV loss:0.0000, Loss:0.0647
CLS loss:0.0080, REG loss:0.0089, ADV loss:0.0000, Loss:0.0169
Validate at epoch 5
CLS loss: 0.0787, REG loss: 1088013095052.6044
Over-all F1:0.6289, AUC:0.9285, F1-top:0.4877
Evaluate at epoch 5
CLS loss: 0.0891, REG loss: 238295602172.6781
Over-all F1:0.4759, AUC:0.9216, F1-top:0.4022
CLS loss:0.0099, REG loss:0.0004, ADV loss:0.0000, Loss:0.0102
CLS loss:0.0017, REG loss:0.0048, ADV loss:0.0000, Loss:0.0065
Validate at epoch 6
CLS loss: 0.0697, REG loss: 1088013099479.9323
Over-all F1:0.6751, AUC:0.9319, F1-top:0.5125
Evaluate at epoch 6
CLS loss: 0.1013, REG loss: 238295601229.2929
Over-all F1:0.4610, AUC:0.9227, F1-top:0.4095
CLS loss:0.0039, REG loss:0.0014, ADV loss:0.0000, Loss:0.0053
CLS loss:0.0067, REG loss:0.0040, ADV loss:0.0000, Loss:0.0107
Validate at epoch 7
CLS loss: 0.0747, REG loss: 1088013095299.2336
Over-all F1:0.6654, AUC:0.9258, F1-top:0.4966
Evaluate at epoch 7
CLS loss: 0.0958, REG loss: 238295602036.9419
Over-all F1:0.5257, AUC:0.9242, F1-top:0.4271
CLS loss:0.0015, REG loss:0.0005, ADV loss:0.0000, Loss:0.0019
CLS loss:0.0039, REG loss:0.0036, ADV loss:0.0000, Loss:0.0075
Validate at epoch 8
CLS loss: 0.0637, REG loss: 1088013091502.1532
Over-all F1:0.7282, AUC:0.9337, F1-top:0.5298
Evaluate at epoch 8
CLS loss: 0.1322, REG loss: 238295598415.1084
Over-all F1:0.4630, AUC:0.9244, F1-top:0.4200
CLS loss:0.0018, REG loss:0.0021, ADV loss:0.0000, Loss:0.0039
CLS loss:0.0237, REG loss:0.0009, ADV loss:0.0000, Loss:0.0246
Validate at epoch 9
CLS loss: 0.0722, REG loss: 1088013093225.3699
Over-all F1:0.7222, AUC:0.9352, F1-top:0.5290
Evaluate at epoch 9
CLS loss: 0.0967, REG loss: 238295598275.6001
Over-all F1:0.5371, AUC:0.9282, F1-top:0.4522
CLS loss:0.0031, REG loss:0.0012, ADV loss:0.0000, Loss:0.0042
CLS loss:0.0086, REG loss:0.0339, ADV loss:0.0000, Loss:0.0425
Validate at epoch 10
CLS loss: 0.0730, REG loss: 1088013093247.4489
Over-all F1:0.7088, AUC:0.9292, F1-top:0.5217
Evaluate at epoch 10
CLS loss: 0.1081, REG loss: 238295600570.7574
Over-all F1:0.5563, AUC:0.9286, F1-top:0.4355

--------Evaluating DATE model---------
CLS loss: 0.0637, REG loss: 1088013091502.1532
CLS loss: 0.1322, REG loss: 238295598415.1084
Saving result... ./results/full.csv

Starting_date:15-12-01
 Metrics:
f1:0.4630 auc:0.9244
Pr@1:0.7011 Pr@2:0.5430 Pr@5:0.3218 Pr@10:0.1789
Re@1:0.3115 Re@2:0.4845 Re@5:0.7179 Re@10:0.7983
Rev@1:0.3244 Rev@2:0.4695 Rev@5:0.6627 Rev@10:0.7306
Namespace(act='relu', beta=0.0, date='16-06-01', device='cuda:1', dim=16, epoch=10, fusion='concat', head_num=4, l2=0.0, lr=0.005, output='full.csv', save=1)
./data/torch_data_16-06-01.pickle
CLS loss:0.0124, REG loss:0.0044, ADV loss:0.0000, Loss:0.0169
Validate at epoch 1
CLS loss: 0.1675, REG loss: 1088013102844.5558
Over-all F1:0.3787, AUC:0.7674, F1-top:0.2758
Evaluate at epoch 1
CLS loss: 0.1833, REG loss: 238295607822.5070
Over-all F1:0.2604, AUC:0.7944, F1-top:0.1848
CLS loss:0.0478, REG loss:0.0045, ADV loss:0.0000, Loss:0.0523
Validate at epoch 2
CLS loss: 0.1675, REG loss: 1088013105414.2632
Over-all F1:0.3931, AUC:0.7257, F1-top:0.2776
Evaluate at epoch 2
CLS loss: 0.1912, REG loss: 238295607665.0568
Over-all F1:0.2503, AUC:0.7510, F1-top:0.1878
CLS loss:0.0333, REG loss:0.0013, ADV loss:0.0000, Loss:0.0346
Validate at epoch 3
CLS loss: 0.1605, REG loss: 1088013106310.6090
Over-all F1:0.3934, AUC:0.7425, F1-top:0.2805
Evaluate at epoch 3
CLS loss: 0.2034, REG loss: 238295606490.6765
Over-all F1:0.2068, AUC:0.7583, F1-top:0.1918
CLS loss:0.0152, REG loss:0.0021, ADV loss:0.0000, Loss:0.0173
Validate at epoch 4
CLS loss: 0.1671, REG loss: 1088013105581.0767
Over-all F1:0.3966, AUC:0.7272, F1-top:0.2764
Evaluate at epoch 4
CLS loss: 0.1985, REG loss: 238295606895.2543
Over-all F1:0.2135, AUC:0.7284, F1-top:0.1895
CLS loss:0.0035, REG loss:0.0004, ADV loss:0.0000, Loss:0.0039
Validate at epoch 5
CLS loss: 0.1791, REG loss: 1088013104815.7725
Over-all F1:0.3841, AUC:0.7343, F1-top:0.2792
Evaluate at epoch 5
CLS loss: 0.2138, REG loss: 238295606628.5013
Over-all F1:0.1976, AUC:0.7428, F1-top:0.1888
CLS loss:0.0024, REG loss:0.0012, ADV loss:0.0000, Loss:0.0036
Validate at epoch 6
CLS loss: 0.1956, REG loss: 1088013104652.3066
Over-all F1:0.3992, AUC:0.7285, F1-top:0.2829
Evaluate at epoch 6
CLS loss: 0.2495, REG loss: 238295606245.2709
Over-all F1:0.1846, AUC:0.7268, F1-top:0.1889
CLS loss:0.0383, REG loss:0.0406, ADV loss:0.0000, Loss:0.0789
Validate at epoch 7
CLS loss: 0.1682, REG loss: 1088013104534.8425
Over-all F1:0.3975, AUC:0.7404, F1-top:0.2827
Evaluate at epoch 7
CLS loss: 0.1982, REG loss: 238295605784.8892
Over-all F1:0.2006, AUC:0.7340, F1-top:0.2009
CLS loss:0.0042, REG loss:0.0019, ADV loss:0.0000, Loss:0.0061
Validate at epoch 8
CLS loss: 0.1654, REG loss: 1088013104675.7411
Over-all F1:0.4029, AUC:0.7827, F1-top:0.3072
Evaluate at epoch 8
CLS loss: 0.2330, REG loss: 238295605842.1488
Over-all F1:0.1684, AUC:0.7729, F1-top:0.2038
CLS loss:0.0009, REG loss:0.0012, ADV loss:0.0000, Loss:0.0021
Validate at epoch 9
CLS loss: 0.1827, REG loss: 1088013104581.3062
Over-all F1:0.3955, AUC:0.7999, F1-top:0.2970
Evaluate at epoch 9
CLS loss: 0.2552, REG loss: 238295606514.4967
Over-all F1:0.1982, AUC:0.7851, F1-top:0.1989
CLS loss:0.0004, REG loss:0.0004, ADV loss:0.0000, Loss:0.0008
Validate at epoch 10
CLS loss: 0.1882, REG loss: 1088013104949.9362
Over-all F1:0.4021, AUC:0.7678, F1-top:0.2938
Evaluate at epoch 10
CLS loss: 0.2299, REG loss: 238295606826.9330
Over-all F1:0.1811, AUC:0.7458, F1-top:0.1988

--------Evaluating DATE model---------
CLS loss: 0.1654, REG loss: 1088013104675.7411
CLS loss: 0.2330, REG loss: 238295605842.1488
Saving result... ./results/full.csv

Starting_date:16-06-01
 Metrics:
f1:0.1684 auc:0.7729
Pr@1:0.4322 Pr@2:0.2408 Pr@5:0.1142 Pr@10:0.1002
Re@1:0.1929 Re@2:0.2148 Re@5:0.2548 Re@10:0.4471
Rev@1:0.2273 Rev@2:0.2815 Rev@5:0.3389 Rev@10:0.4888