Skip to content

Eval 详细结果

Jump to bottom
limiao edited this page Nov 26, 2017 · 18 revisions

ShowAndTell Advanced (Visual Attention, finetune with decay)

从 105000 开始 finetune, 学习率接续训练时学习率继续 decay, initlr=1.0, decay=0.6

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-107274.eval/out.eval <==
{'CIDEr': 0.46570480087142974, 'Bleu_4': 0.2191086674663006, 'Bleu_3': 0.29616017191038224, 'Bleu_2': 0.4091033131243936, 'Bleu_1': 0.5731448849123701, 'ROUGE_L': 0.47638193895162623, 'METEOR': 0.26361739275531887, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-121148.eval/out.eval <==
{'CIDEr': 1.2347122678027007, 'Bleu_4': 0.43566570813567845, 'Bleu_3': 0.5187694167994402, 'Bleu_2': 0.619918051714172, 'Bleu_1': 0.7376927161882084, 'ROUGE_L': 0.6079666926097379, 'METEOR': 0.3532316317036224, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-141572.eval/out.eval <==
{'CIDEr': 1.1711131434296636, 'Bleu_4': 0.4349628309039307, 'Bleu_3': 0.5159510137405303, 'Bleu_2': 0.6149290451060778, 'Bleu_1': 0.7334652392516001, 'ROUGE_L': 0.60573232806056854, 'METEOR': 0.3485485391111299, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-162296.eval/out.eval <==
{'CIDEr': 1.1273836090770739, 'Bleu_4': 0.42273667684427935, 'Bleu_3': 0.5006161495626947, 'Bleu_2': 0.5995809362035343, 'Bleu_1': 0.7211301802546656, 'ROUGE_L': 0.59671780184505752, 'METEOR': 0.34108511541580383, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-180714.eval/out.eval <==
{'CIDEr': 1.4204206372795392, 'Bleu_4': 0.49208459327421417, 'Bleu_3': 0.5735210507068222, 'Bleu_2': 0.6688107361995176, 'Bleu_1': 0.7776067904720776, 'ROUGE_L': 0.64088902777840517, 'METEOR': 0.3782137474324059, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-201429.eval/out.eval <==
{'CIDEr': 1.4368370975116047, 'Bleu_4': 0.4902321596480561, 'Bleu_3': 0.5725870556662427, 'Bleu_2': 0.6701020692904334, 'Bleu_1': 0.7819463373767803, 'ROUGE_L': 0.6435661233905533, 'METEOR': 0.3789423394900014, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-222072.eval/out.eval <==
{'CIDEr': 1.4260741501129741, 'Bleu_4': 0.4930106451897408, 'Bleu_3': 0.5728017121978524, 'Bleu_2': 0.6669276235265615, 'Bleu_1': 0.7755983211421558, 'ROUGE_L': 0.63859438021508597, 'METEOR': 0.37491112877277516, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-240416.eval/out.eval <==
{'CIDEr': 1.5964980229079728, 'Bleu_4': 0.5271141454124754, 'Bleu_3': 0.6072336066608858, 'Bleu_2': 0.6999556022555864, 'Bleu_1': 0.8044791633055615, 'ROUGE_L': 0.66300392078267434, 'METEOR': 0.39002809947024525, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-260170.eval/out.eval <==
{'CIDEr': 1.5637078774221858, 'Bleu_4': 0.5205912969093995, 'Bleu_3': 0.6007526366733277, 'Bleu_2': 0.6930707779443948, 'Bleu_1': 0.7974344261158429, 'ROUGE_L': 0.65766675258926921, 'METEOR': 0.3879517491454795, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-280867.eval/out.eval <==
{'CIDEr': 1.62532870820203, 'Bleu_4': 0.5358844764868619, 'Bleu_3': 0.6155956468475519, 'Bleu_2': 0.7072494985374767, 'Bleu_1': 0.8090264102893706, 'ROUGE_L': 0.66549887495319682, 'METEOR': 0.3947917346346786, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-300310.eval/out.eval <==
{'CIDEr': 1.6737899724825605, 'Bleu_4': 0.5450147864407877, 'Bleu_3': 0.6241285872988414, 'Bleu_2': 0.7148941267919601, 'Bleu_1': 0.8157276568157203, 'ROUGE_L': 0.67257398266168023, 'METEOR': 0.3975994321571077, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-320957.eval/out.eval <==
{'CIDEr': 1.6634033213728689, 'Bleu_4': 0.5430040195951911, 'Bleu_3': 0.6218563433050309, 'Bleu_2': 0.7126172114999435, 'Bleu_1': 0.8141791033584636, 'ROUGE_L': 0.67203251461781599, 'METEOR': 0.3972044522856004, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-341571.eval/out.eval <==
{'CIDEr': 1.6984006222198726, 'Bleu_4': 0.5507139703517322, 'Bleu_3': 0.6305184590599363, 'Bleu_2': 0.7219657291238037, 'Bleu_1': 0.8224452785263039, 'ROUGE_L': 0.67651941590088283, 'METEOR': 0.40242281646607353, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-362215.eval/out.eval <==
{'CIDEr': 1.6960178718280736, 'Bleu_4': 0.5514960797836915, 'Bleu_3': 0.6307094499555583, 'Bleu_2': 0.7210621925765334, 'Bleu_1': 0.8206813061917348, 'ROUGE_L': 0.67508355469967896, 'METEOR': 0.4019735277445542, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-380486.eval/out.eval <==
{'CIDEr': 1.6835969401254227, 'Bleu_4': 0.546709996303781, 'Bleu_3': 0.6263363522970125, 'Bleu_2': 0.7177266863964339, 'Bleu_1': 0.8195050503576888, 'ROUGE_L': 0.67369221713245286, 'METEOR': 0.4009968140461876, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-400171.eval/out.eval <==
{'CIDEr': 1.734792310160711, 'Bleu_4': 0.558639248464043, 'Bleu_3': 0.6380814240856519, 'Bleu_2': 0.7286661988044402, 'Bleu_1': 0.8283970687922135, 'ROUGE_L': 0.68239377548856384, 'METEOR': 0.40642273208209834, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-421050.eval/out.eval <==
{'CIDEr': 1.7257677511369367, 'Bleu_4': 0.5569486716942493, 'Bleu_3': 0.6363206705520824, 'Bleu_2': 0.7267846717702534, 'Bleu_1': 0.8265120533566281, 'ROUGE_L': 0.68056254418392115, 'METEOR': 0.4045773721619342, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-440810.eval/out.eval <==
{'CIDEr': 1.7115712613065557, 'Bleu_4': 0.5558499996311318, 'Bleu_3': 0.6350407921370217, 'Bleu_2': 0.7252769833277241, 'Bleu_1': 0.8244163133173164, 'ROUGE_L': 0.67842860192656129, 'METEOR': 0.4036840684290523, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-461726.eval/out.eval <==
{'CIDEr': 1.7589541804846072, 'Bleu_4': 0.5645969428294588, 'Bleu_3': 0.6441742535582696, 'Bleu_2': 0.7339507345438603, 'Bleu_1': 0.8318197976491813, 'ROUGE_L': 0.68475365053475301, 'METEOR': 0.4086901529073242, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-480302.eval/out.eval <==
{'CIDEr': 1.7455152268298209, 'Bleu_4': 0.5621817660982643, 'Bleu_3': 0.6418279760512436, 'Bleu_2': 0.7322336827732459, 'Bleu_1': 0.8306973982591518, 'ROUGE_L': 0.68268021858709693, 'METEOR': 0.4073197734742577, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-500133.eval/out.eval <==
{'CIDEr': 1.7447889475624563, 'Bleu_4': 0.5613940162249758, 'Bleu_3': 0.6409039527054217, 'Bleu_2': 0.7311437780323928, 'Bleu_1': 0.830160146286888, 'ROUGE_L': 0.68232338397596415, 'METEOR': 0.40753086129525246, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-520908.eval/out.eval <==
{'CIDEr': 1.7626077084487164, 'Bleu_4': 0.5639172642397113, 'Bleu_3': 0.6433100919727631, 'Bleu_2': 0.7333345089121394, 'Bleu_1': 0.8318088452403855, 'ROUGE_L': 0.68458705256568975, 'METEOR': 0.40939369772393064, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-541622.eval/out.eval <==
{'CIDEr': 1.7578124341462538, 'Bleu_4': 0.5638829000273736, 'Bleu_3': 0.6433369582606651, 'Bleu_2': 0.7334721910380856, 'Bleu_1': 0.8317112892143999, 'ROUGE_L': 0.68428301873712416, 'METEOR': 0.40831655140659817, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-560083.eval/out.eval <==
{'CIDEr': 1.7594315644643419, 'Bleu_4': 0.5633798871547928, 'Bleu_3': 0.6430273296157198, 'Bleu_2': 0.7332498507481183, 'Bleu_1': 0.8317733379412073, 'ROUGE_L': 0.68380315176953055, 'METEOR': 0.4085268744998222, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-580699.eval/out.eval <==
{'CIDEr': 1.7634097294099458, 'Bleu_4': 0.565194269559459, 'Bleu_3': 0.6449521462970716, 'Bleu_2': 0.7352961393656742, 'Bleu_1': 0.8337732295149322, 'ROUGE_L': 0.68440496305115883, 'METEOR': 0.40881289170614266, 'error': 0}

==> show_and_tell_advanced_model_attention_finetune_with_decay/model.ckpt-600000.eval/out.eval <==
{'CIDEr': 1.7528554739608144, 'Bleu_4': 0.5630982296654413, 'Bleu_3': 0.6430270758354999, 'Bleu_2': 0.733393309753308, 'Bleu_1': 0.8319494284687446, 'ROUGE_L': 0.68390081688650439, 'METEOR': 0.40828360436640626, 'error': 0}

ShowAndTell (from scratch)

载入 Inception 后就开始按照原定学习率和 decay 训练整个网络， initlr=2.0, decay=0.5

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-1850.eval/out.eval <==
{'CIDEr': 0.24887338572600123, 'Bleu_4': 0.150042082014817, 'Bleu_3': 0.20337392044473024, 'Bleu_2': 0.2870678267059816, 'Bleu_1': 0.4141331164102599, 'ROUGE_L': 0.41325784886195738, 'METEOR': 0.22830629131031607, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-20088.eval/out.eval <==
{'CIDEr': 0.58431889356405797, 'Bleu_4': 0.2848196675853117, 'Bleu_3': 0.36623950548402134, 'Bleu_2': 0.4778833204740536, 'Bleu_1': 0.6262431926346719, 'ROUGE_L': 0.5166332159150141, 'METEOR': 0.2900974054470146, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-40199.eval/out.eval <==
{'CIDEr': 0.71544440481762439, 'Bleu_4': 0.30811167193859845, 'Bleu_3': 0.389363304663143, 'Bleu_2': 0.4983086088310636, 'Bleu_1': 0.6497856751501331, 'ROUGE_L': 0.52926763448065772, 'METEOR': 0.30035487764798957, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-60374.eval/out.eval <==
{'CIDEr': 0.64970360754741197, 'Bleu_4': 0.29711273096697355, 'Bleu_3': 0.37599761329063874, 'Bleu_2': 0.4804456869972924, 'Bleu_1': 0.6256193520737237, 'ROUGE_L': 0.51680515177749897, 'METEOR': 0.28325193215509714, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-80538.eval/out.eval <==
{'CIDEr': 0.96456790867207287, 'Bleu_4': 0.37725123117474946, 'Bleu_3': 0.4603444797662795, 'Bleu_2': 0.56686587057102, 'Bleu_1': 0.6991650460114629, 'ROUGE_L': 0.57719318431041466, 'METEOR': 0.328758226011726, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-100678.eval/out.eval <==
{'CIDEr': 1.0746324898486637, 'Bleu_4': 0.40256153560478264, 'Bleu_3': 0.48569482515083806, 'Bleu_2': 0.5890922563770034, 'Bleu_1': 0.719474329752497, 'ROUGE_L': 0.59373727764972262, 'METEOR': 0.3416064563332694, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-126543.eval/out.eval <==
{'CIDEr': 1.1605817641757628, 'Bleu_4': 0.43298075014225046, 'Bleu_3': 0.5172314019696499, 'Bleu_2': 0.620005542454966, 'Bleu_1': 0.74192793467588, 'ROUGE_L': 0.6098551604699195, 'METEOR': 0.35296871568287097, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-141162.eval/out.eval <==
{'CIDEr': 1.1762180204765571, 'Bleu_4': 0.4285640629811929, 'Bleu_3': 0.5112122167631216, 'Bleu_2': 0.6130425877048208, 'Bleu_1': 0.7345877410957781, 'ROUGE_L': 0.60551206983212325, 'METEOR': 0.34977511503006986, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-161573.eval/out.eval <==
{'CIDEr': 1.2004872134106424, 'Bleu_4': 0.43800164466739133, 'Bleu_3': 0.5215757235077373, 'Bleu_2': 0.6236383465741311, 'Bleu_1': 0.7448353221636141, 'ROUGE_L': 0.61184894873269791, 'METEOR': 0.357027168292444, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-184795.eval/out.eval <==
{'CIDEr': 1.3381793021382749, 'Bleu_4': 0.47188508396213236, 'Bleu_3': 0.5563520269238758, 'Bleu_2': 0.6565905390933048, 'Bleu_1': 0.7731773282459613, 'ROUGE_L': 0.63447162402363644, 'METEOR': 0.37097904556072864, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-200098.eval/out.eval <==
{'CIDEr': 1.2788633581272515, 'Bleu_4': 0.45480505822421574, 'Bleu_3': 0.5365864946951231, 'Bleu_2': 0.6351718389465785, 'Bleu_1': 0.7520319072012921, 'ROUGE_L': 0.62240584401531451, 'METEOR': 0.35750490629650367, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-220171.eval/out.eval <==
{'CIDEr': 1.3325880654195934, 'Bleu_4': 0.46718468701001625, 'Bleu_3': 0.5511552239221135, 'Bleu_2': 0.6519109584585899, 'Bleu_1': 0.7688892461955107, 'ROUGE_L': 0.63038684680126822, 'METEOR': 0.36973808549511616, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-240248.eval/out.eval <==
{'CIDEr': 1.4367048457421323, 'Bleu_4': 0.4986372133041875, 'Bleu_3': 0.581605859231498, 'Bleu_2': 0.6783036500672495, 'Bleu_1': 0.7872999075601317, 'ROUGE_L': 0.64797949907979568, 'METEOR': 0.3805450080105166, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-260305.eval/out.eval <==
{'CIDEr': 1.4342054529940498, 'Bleu_4': 0.49130035649940634, 'Bleu_3': 0.5749556895440902, 'Bleu_2': 0.6729726388430679, 'Bleu_1': 0.7854572256979989, 'ROUGE_L': 0.6475006058092394, 'METEOR': 0.37890946994921626, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-282261.eval/out.eval <==
{'CIDEr': 1.520176213769479, 'Bleu_4': 0.5159842987363816, 'Bleu_3': 0.5991111954054751, 'Bleu_2': 0.6947715276163974, 'Bleu_1': 0.8014632990807065, 'ROUGE_L': 0.65981613324876687, 'METEOR': 0.39006671354411016, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-300547.eval/out.eval <==
{'CIDEr': 1.5087950396931429, 'Bleu_4': 0.5130475254924224, 'Bleu_3': 0.5956996353003956, 'Bleu_2': 0.6912356391302288, 'Bleu_1': 0.7986790899307756, 'ROUGE_L': 0.65730388664821104, 'METEOR': 0.38673087129962774, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-320780.eval/out.eval <==
{'CIDEr': 1.5235761296404937, 'Bleu_4': 0.5141186207240614, 'Bleu_3': 0.5969977982361052, 'Bleu_2': 0.6926131692094107, 'Bleu_1': 0.799029762065796, 'ROUGE_L': 0.65901981118946362, 'METEOR': 0.38779022227179805, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-340110.eval/out.eval <==
{'CIDEr': 1.5674288548194464, 'Bleu_4': 0.5233330269610377, 'Bleu_3': 0.6059710817294238, 'Bleu_2': 0.70121302992181, 'Bleu_1': 0.8071598759505594, 'ROUGE_L': 0.6648846725671288, 'METEOR': 0.3920914458926464, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-364400.eval/out.eval <==
{'CIDEr': 1.5731767007756496, 'Bleu_4': 0.5244875385139357, 'Bleu_3': 0.6067394904601028, 'Bleu_2': 0.701442217812723, 'Bleu_1': 0.8065856748679452, 'ROUGE_L': 0.66477263457593228, 'METEOR': 0.3926740940965833, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-380437.eval/out.eval <==
{'CIDEr': 1.5615904019479023, 'Bleu_4': 0.5209888396705331, 'Bleu_3': 0.6041855493240875, 'Bleu_2': 0.7001699076118278, 'Bleu_1': 0.8074469649115208, 'ROUGE_L': 0.66407731219143296, 'METEOR': 0.39233876433543513, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-400289.eval/out.eval <==
{'CIDEr': 1.5860789151426766, 'Bleu_4': 0.5279217071844408, 'Bleu_3': 0.6103324818262986, 'Bleu_2': 0.7050135545157133, 'Bleu_1': 0.8101247237379827, 'ROUGE_L': 0.66686712437996487, 'METEOR': 0.39404494652632066, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-420000.eval/out.eval <==
{'CIDEr': 1.589961725892715, 'Bleu_4': 0.5286575957288446, 'Bleu_3': 0.6111402900725104, 'Bleu_2': 0.7061201661275527, 'Bleu_1': 0.8115697564887743, 'ROUGE_L': 0.66756758735087107, 'METEOR': 0.3942324782293273, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-440394.eval/out.eval <==
{'CIDEr': 1.5801964808640137, 'Bleu_4': 0.5257940452945477, 'Bleu_3': 0.6085793690971517, 'Bleu_2': 0.7043167114606367, 'Bleu_1': 0.8107428200302785, 'ROUGE_L': 0.66635190486835194, 'METEOR': 0.39448832833464437, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-462169.eval/out.eval <==
{'CIDEr': 1.593993543326335, 'Bleu_4': 0.5277940514690552, 'Bleu_3': 0.6106009533646296, 'Bleu_2': 0.7059530804195309, 'Bleu_1': 0.811740369291197, 'ROUGE_L': 0.66789566284930202, 'METEOR': 0.3957406930023348, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-480057.eval/out.eval <==
{'CIDEr': 1.5924431785737616, 'Bleu_4': 0.5300886724374098, 'Bleu_3': 0.61289033920188, 'Bleu_2': 0.7080498779961588, 'Bleu_1': 0.8132818527694962, 'ROUGE_L': 0.66834129917724405, 'METEOR': 0.39524013916773343, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-501521.eval/out.eval <==
{'CIDEr': 1.5900872014217005, 'Bleu_4': 0.5281412303845778, 'Bleu_3': 0.6108758544060949, 'Bleu_2': 0.706023285367607, 'Bleu_1': 0.8117946536417691, 'ROUGE_L': 0.66771715185115144, 'METEOR': 0.3946822966054838, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-520252.eval/out.eval <==
{'CIDEr': 1.596893054153528, 'Bleu_4': 0.5298713414785323, 'Bleu_3': 0.6128281420818409, 'Bleu_2': 0.7081072264940091, 'Bleu_1': 0.8136182154690998, 'ROUGE_L': 0.66828925576263387, 'METEOR': 0.3956847961184952, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-540561.eval/out.eval <==
{'CIDEr': 1.5956287902557476, 'Bleu_4': 0.5295737702768312, 'Bleu_3': 0.6124788482917408, 'Bleu_2': 0.707912647169261, 'Bleu_1': 0.8138992678712139, 'ROUGE_L': 0.6683255094437911, 'METEOR': 0.39569690896693394, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-560944.eval/out.eval <==
{'CIDEr': 1.5994520499813691, 'Bleu_4': 0.5298016317769343, 'Bleu_3': 0.6127376499852277, 'Bleu_2': 0.708026514556571, 'Bleu_1': 0.8137556622446036, 'ROUGE_L': 0.66853059508051638, 'METEOR': 0.39593406585070795, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-580411.eval/out.eval <==
{'CIDEr': 1.6017710236246405, 'Bleu_4': 0.5303672267896151, 'Bleu_3': 0.613064141528427, 'Bleu_2': 0.7081012958493698, 'Bleu_1': 0.81378571595253, 'ROUGE_L': 0.66876885822837828, 'METEOR': 0.3959963866700566, 'error': 0}

==> show_and_tell_in_graph_model_fromscratch/model.ckpt-600000.eval/out.eval <==
{'CIDEr': 1.5980188565920066, 'Bleu_4': 0.5289895127687209, 'Bleu_3': 0.611844313142776, 'Bleu_2': 0.707126232610811, 'Bleu_1': 0.8131766502402112, 'ROUGE_L': 0.6682375639770054, 'METEOR': 0.39575849017610204, 'error': 0}

ShowAndTell (finetune with decay) initlr=1.0, decay=0.6

从 105000 开始 finetune, 学习率接续训练时学习率继续 decay, initlr=1.0, decay=0.6

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-106873.eval/out.eval <==
{'CIDEr': 0.32511353751400879, 'Bleu_4': 0.19550129946507885, 'Bleu_3': 0.26839767565078887, 'Bleu_2': 0.3807847268133579, 'Bleu_1': 0.5500238593663177, 'ROUGE_L': 0.45853629071455715, 'METEOR': 0.24590772196381785, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-121762.eval/out.eval <==
{'CIDEr': 0.95299403932311366, 'Bleu_4': 0.36804441136801225, 'Bleu_3': 0.45159093305189074, 'Bleu_2': 0.5588824539203606, 'Bleu_1': 0.6928004279087991, 'ROUGE_L': 0.57223843641116701, 'METEOR': 0.3282977598160312, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-140489.eval/out.eval <==
{'CIDEr': 1.103352458741111, 'Bleu_4': 0.4117366694391421, 'Bleu_3': 0.4948590829767174, 'Bleu_2': 0.5977612258277284, 'Bleu_1': 0.7217375712442279, 'ROUGE_L': 0.59695710871312613, 'METEOR': 0.342779185069633, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-160510.eval/out.eval <==
{'CIDEr': 1.1801625020723858, 'Bleu_4': 0.42406134449060223, 'Bleu_3': 0.5082284321026956, 'Bleu_2': 0.6114982071513314, 'Bleu_1': 0.7353549024765538, 'ROUGE_L': 0.60542627540687799, 'METEOR': 0.3505584059543969, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-180580.eval/out.eval <==
{'CIDEr': 1.3063108004488873, 'Bleu_4': 0.45177643436417814, 'Bleu_3': 0.5362218297065589, 'Bleu_2': 0.6382959423279518, 'Bleu_1': 0.7576369725494413, 'ROUGE_L': 0.62334666586619547, 'METEOR': 0.36272834092068496, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-200785.eval/out.eval <==
{'CIDEr': 1.3063432388123288, 'Bleu_4': 0.46220687261066395, 'Bleu_3': 0.5459800569779543, 'Bleu_2': 0.6459207535268351, 'Bleu_1': 0.7622475838634256, 'ROUGE_L': 0.62787578795465782, 'METEOR': 0.36380908707142123, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-220008.eval/out.eval <==
{'CIDEr': 1.2874743817264114, 'Bleu_4': 0.4576932683311985, 'Bleu_3': 0.5417310313349633, 'Bleu_2': 0.6416629265726063, 'Bleu_1': 0.7568192295026063, 'ROUGE_L': 0.62478433731783301, 'METEOR': 0.3641465996437879, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-241225.eval/out.eval <==
{'CIDEr': 1.4375992378219915, 'Bleu_4': 0.4923698174795924, 'Bleu_3': 0.5765554022647517, 'Bleu_2': 0.6751874683716665, 'Bleu_1': 0.7869822959076449, 'ROUGE_L': 0.64759853165217807, 'METEOR': 0.379829230964296, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-261543.eval/out.eval <==
{'CIDEr': 1.3830125249495138, 'Bleu_4': 0.4781970338022269, 'Bleu_3': 0.5626502930891671, 'Bleu_2': 0.6622063559965793, 'Bleu_1': 0.7760982642051893, 'ROUGE_L': 0.63801651566360884, 'METEOR': 0.3738501335575981, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-281860.eval/out.eval <==
{'CIDEr': 1.5094354492116675, 'Bleu_4': 0.5078631752380262, 'Bleu_3': 0.5915093659350403, 'Bleu_2': 0.6887545653955427, 'Bleu_1': 0.7973579659304907, 'ROUGE_L': 0.65627510097693376, 'METEOR': 0.38580778180499264, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-300231.eval/out.eval <==
{'CIDEr': 1.514061736678094, 'Bleu_4': 0.5112664749483562, 'Bleu_3': 0.5939614415533407, 'Bleu_2': 0.6892783796552296, 'Bleu_1': 0.796992541959445, 'ROUGE_L': 0.65522942045743127, 'METEOR': 0.38539110492895556, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-320531.eval/out.eval <==
{'CIDEr': 1.5179648582064178, 'Bleu_4': 0.509460877599408, 'Bleu_3': 0.5928278366250058, 'Bleu_2': 0.6899674042714838, 'Bleu_1': 0.7991205393450207, 'ROUGE_L': 0.65636963289163242, 'METEOR': 0.38722630131553504, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-341796.eval/out.eval <==
{'CIDEr': 1.5666121007193334, 'Bleu_4': 0.5211015674068172, 'Bleu_3': 0.6041033521542714, 'Bleu_2': 0.7002474150185715, 'Bleu_1': 0.8072336968627898, 'ROUGE_L': 0.66404023914532717, 'METEOR': 0.39120001848392066, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-360166.eval/out.eval <==
{'CIDEr': 1.5671540550214342, 'Bleu_4': 0.5212441404330777, 'Bleu_3': 0.603707941220881, 'Bleu_2': 0.6988419563322945, 'Bleu_1': 0.8047148582080773, 'ROUGE_L': 0.6630503889170245, 'METEOR': 0.39071358062725337, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-380477.eval/out.eval <==
{'CIDEr': 1.5725618951906055, 'Bleu_4': 0.5219909413821956, 'Bleu_3': 0.604865528235645, 'Bleu_2': 0.7001285736998104, 'Bleu_1': 0.8062876411483267, 'ROUGE_L': 0.6631991881793603, 'METEOR': 0.39245977853771413, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-400772.eval/out.eval <==
{'CIDEr': 1.5984923369877089, 'Bleu_4': 0.5275781367277224, 'Bleu_3': 0.6104406259015576, 'Bleu_2': 0.7058949181486549, 'Bleu_1': 0.8111618049023294, 'ROUGE_L': 0.66740703292301429, 'METEOR': 0.39437007112252076, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-420934.eval/out.eval <==
{'CIDEr': 1.6073169297602536, 'Bleu_4': 0.5293860735361849, 'Bleu_3': 0.6124605716732373, 'Bleu_2': 0.7083181920994095, 'Bleu_1': 0.8145835065428608, 'ROUGE_L': 0.66875420700173471, 'METEOR': 0.39573725502919904, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-441225.eval/out.eval <==
{'CIDEr': 1.5989730811308211, 'Bleu_4': 0.5283665952546275, 'Bleu_3': 0.6112911475902254, 'Bleu_2': 0.7067977790628813, 'Bleu_1': 0.812226608990511, 'ROUGE_L': 0.66720046088867713, 'METEOR': 0.3946986297198543, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-461539.eval/out.eval <==
{'CIDEr': 1.6207502774222906, 'Bleu_4': 0.5329529851202248, 'Bleu_3': 0.6155443144505556, 'Bleu_2': 0.7102716503198047, 'Bleu_1': 0.81480584921982, 'ROUGE_L': 0.67038167094180046, 'METEOR': 0.3958955209623072, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-481850.eval/out.eval <==
{'CIDEr': 1.6220932628553564, 'Bleu_4': 0.5332528005962948, 'Bleu_3': 0.6159651626837868, 'Bleu_2': 0.711027488387376, 'Bleu_1': 0.8157567096317635, 'ROUGE_L': 0.67045125558581498, 'METEOR': 0.39634855719510226, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-500219.eval/out.eval <==
{'CIDEr': 1.6296409666692131, 'Bleu_4': 0.5341578506336521, 'Bleu_3': 0.6166639267579699, 'Bleu_2': 0.7114035438994976, 'Bleu_1': 0.8158760161418298, 'ROUGE_L': 0.67062350269446314, 'METEOR': 0.3962304762997709, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-520432.eval/out.eval <==
{'CIDEr': 1.6284513724086742, 'Bleu_4': 0.5336832692321192, 'Bleu_3': 0.6162551765348917, 'Bleu_2': 0.7109769337178518, 'Bleu_1': 0.815563376969786, 'ROUGE_L': 0.67100739199027226, 'METEOR': 0.3968390690703577, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-540700.eval/out.eval <==
{'CIDEr': 1.6337562127146341, 'Bleu_4': 0.5354459427744948, 'Bleu_3': 0.6181579337787473, 'Bleu_2': 0.712813105753542, 'Bleu_1': 0.8169365454699146, 'ROUGE_L': 0.67111965900600601, 'METEOR': 0.39741106191375775, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-560964.eval/out.eval <==
{'CIDEr': 1.6376889675320123, 'Bleu_4': 0.5359547571027581, 'Bleu_3': 0.6182530628961853, 'Bleu_2': 0.7126608602588347, 'Bleu_1': 0.8166296866280583, 'ROUGE_L': 0.6718043647685239, 'METEOR': 0.39736017845162325, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-581226.eval/out.eval <==
{'CIDEr': 1.643282305345962, 'Bleu_4': 0.5353661394771997, 'Bleu_3': 0.617985098987466, 'Bleu_2': 0.7126991368469408, 'Bleu_1': 0.8170435021098659, 'ROUGE_L': 0.67223713017107978, 'METEOR': 0.39765803998045507, 'error': 0}

==> show_and_tell_in_graph_model_2_finetune_with_decay/model.ckpt-600000.eval/out.eval <==
{'CIDEr': 1.6363068908057421, 'Bleu_4': 0.5351827605620687, 'Bleu_3': 0.6177586501079261, 'Bleu_2': 0.7123746957004807, 'Bleu_1': 0.8168690889324185, 'ROUGE_L': 0.67092788453698926, 'METEOR': 0.39783393315047, 'error': 0}

ShowAndTell (finetune with decay) initlr=2.0, decay=0.5

从 105000 开始 finetune, 学习率接续训练时学习率继续 decay, initlr=2.0, decay=0.5

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-106467.eval/out.eval <==
{'CIDEr': 0.23189044228330111, 'Bleu_4': 0.1557450396862652, 'Bleu_3': 0.2162866269758421, 'Bleu_2': 0.31257756457532737, 'Bleu_1': 0.46447928493253293, 'ROUGE_L': 0.43423337342676943, 'METEOR': 0.2252657744881885, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-120704.eval/out.eval <==
{'CIDEr': 0.88976250257849121, 'Bleu_4': 0.3541931637206226, 'Bleu_3': 0.4385313395259278, 'Bleu_2': 0.5469928966255017, 'Bleu_1': 0.6820702383534315, 'ROUGE_L': 0.56090827298988843, 'METEOR': 0.3225865922886468, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-140557.eval/out.eval <==
{'CIDEr': 0.88582066900179346, 'Bleu_4': 0.3472943380136008, 'Bleu_3': 0.4313761608834137, 'Bleu_2': 0.5401951324418804, 'Bleu_1': 0.6783485183941381, 'ROUGE_L': 0.5573209860358278, 'METEOR': 0.31932141345583787, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-161186.eval/out.eval <==
{'CIDEr': 1.0162532475366373, 'Bleu_4': 0.38553093105298625, 'Bleu_3': 0.4701281213661307, 'Bleu_2': 0.576015084804406, 'Bleu_1': 0.7025098737062, 'ROUGE_L': 0.58017700034659647, 'METEOR': 0.3351093269004393, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-180217.eval/out.eval <==
{'CIDEr': 1.1966245307220733, 'Bleu_4': 0.43181272455122405, 'Bleu_3': 0.5162214041250568, 'Bleu_2': 0.6181980253963221, 'Bleu_1': 0.7383707018683981, 'ROUGE_L': 0.60947236411402517, 'METEOR': 0.3539591477674539, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-200027.eval/out.eval <==
{'CIDEr': 1.1826397626915666, 'Bleu_4': 0.42081114779998574, 'Bleu_3': 0.506801561447085, 'Bleu_2': 0.6119812345562075, 'Bleu_1': 0.7393449493118391, 'ROUGE_L': 0.60583376464277705, 'METEOR': 0.35168606033920424, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-220624.eval/out.eval <==
{'CIDEr': 1.1454179608255926, 'Bleu_4': 0.4194133756795997, 'Bleu_3': 0.501951828750827, 'Bleu_2': 0.6032995620004347, 'Bleu_1': 0.7268999271776911, 'ROUGE_L': 0.60007318356390293, 'METEOR': 0.3449454810353404, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-240466.eval/out.eval <==
{'CIDEr': 1.3122753205181816, 'Bleu_4': 0.460048335257382, 'Bleu_3': 0.5445549909445695, 'Bleu_2': 0.6457553084250041, 'Bleu_1': 0.7642491964549798, 'ROUGE_L': 0.62914231545388588, 'METEOR': 0.3661764115160533, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-261020.eval/out.eval <==
{'CIDEr': 1.3271995259582281, 'Bleu_4': 0.461057973453116, 'Bleu_3': 0.5454118276482446, 'Bleu_2': 0.6461900042155918, 'Bleu_1': 0.7641677399796266, 'ROUGE_L': 0.62922081891196979, 'METEOR': 0.36689015943950154, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-280082.eval/out.eval <==
{'CIDEr': 1.3599907967186635, 'Bleu_4': 0.4705555342661079, 'Bleu_3': 0.5557132496527847, 'Bleu_2': 0.6564457785890913, 'Bleu_1': 0.7710747717318305, 'ROUGE_L': 0.63446115830769534, 'METEOR': 0.3700613530657811, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-301465.eval/out.eval <==
{'CIDEr': 1.4313216745149631, 'Bleu_4': 0.486789206593323, 'Bleu_3': 0.5711290397679323, 'Bleu_2': 0.6706220877701398, 'Bleu_1': 0.7841162889638102, 'ROUGE_L': 0.645820
70270948644, 'METEOR': 0.37718594717139553, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-320477.eval/out.eval <==
{'CIDEr': 1.4239779879316445, 'Bleu_4': 0.48664389851013584, 'Bleu_3': 0.5710453262658031, 'Bleu_2': 0.6705794966690268, 'Bleu_1': 0.7835814563985138, 'ROUGE_L': 0.64558075624950273, 'METEOR': 0.3768290567344555, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-340249.eval/out.eval <==
{'CIDEr': 1.4832488127177061, 'Bleu_4': 0.49924619243288354, 'Bleu_3': 0.5835208775929492, 'Bleu_2': 0.6816827763189665, 'Bleu_1': 0.7920384191410407, 'ROUGE_L': 0.65183559823263593, 'METEOR': 0.3827883906135494, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-360851.eval/out.eval <==
{'CIDEr': 1.482969201431569, 'Bleu_4': 0.5004414040201375, 'Bleu_3': 0.5848287607835162, 'Bleu_2': 0.6831915672703562, 'Bleu_1': 0.7938947974379704, 'ROUGE_L': 0.6530128309253298, 'METEOR': 0.38357186839743906, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-380568.eval/out.eval <==
{'CIDEr': 1.4957992484612503, 'Bleu_4': 0.5041246553129815, 'Bleu_3': 0.5877260365333947, 'Bleu_2': 0.6849813646362362, 'Bleu_1': 0.7949138601643693, 'ROUGE_L': 0.6544224379320932, 'METEOR': 0.38371672173279586, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-401177.eval/out.eval <==
{'CIDEr': 1.520774243368904, 'Bleu_4': 0.5083219549350524, 'Bleu_3': 0.5920764269190295, 'Bleu_2': 0.6895575728263001, 'Bleu_1': 0.798677670950111, 'ROUGE_L': 0.65773158210081861, 'METEOR': 0.38629855602806473, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-420194.eval/out.eval <==
{'CIDEr': 1.518317078743197, 'Bleu_4': 0.5096481748283557, 'Bleu_3': 0.593618070971843, 'Bleu_2': 0.6909235187295343, 'Bleu_1': 0.7997863264865236, 'ROUGE_L': 0.6581649994337927, 'METEOR': 0.3868708528076244, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-440057.eval/out.eval <==
{'CIDEr': 1.5224122964522233, 'Bleu_4': 0.5090035222707063, 'Bleu_3': 0.5928540600465712, 'Bleu_2': 0.69025219109915, 'Bleu_1': 0.7992239186499157, 'ROUGE_L': 0.65781628776579593, 'METEOR': 0.38613510472269374, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-460813.eval/out.eval <==
{'CIDEr': 1.5381566560376814, 'Bleu_4': 0.5133664205119185, 'Bleu_3': 0.5971471702759652, 'Bleu_2': 0.6939877914000215, 'Bleu_1': 0.80238487295404, 'ROUGE_L': 0.66017055767853261, 'METEOR': 0.38816461214516623, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-481424.eval/out.eval <==
{'CIDEr': 1.5354493827106372, 'Bleu_4': 0.5120389955615597, 'Bleu_3': 0.595776392910444, 'Bleu_2': 0.6929631414126627, 'Bleu_1': 0.8019726874697988, 'ROUGE_L': 0.6602450728993231, 'METEOR': 0.3881222825313499, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-500455.eval/out.eval <==
{'CIDEr': 1.5337219406597127, 'Bleu_4': 0.513258319762036, 'Bleu_3': 0.5968434938325697, 'Bleu_2': 0.6936949855958618, 'Bleu_1': 0.8021275121652655, 'ROUGE_L': 0.66008288753919431, 'METEOR': 0.38811553427563117, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-520255.eval/out.eval <==
{'CIDEr': 1.5439775756438725, 'Bleu_4': 0.5140039544266042, 'Bleu_3': 0.5978391813453288, 'Bleu_2': 0.6948479199648323, 'Bleu_1': 0.8035318567830422, 'ROUGE_L': 0.66101103134675288, 'METEOR': 0.3888133019053088, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-540786.eval/out.eval <==
{'CIDEr': 1.5424891682341093, 'Bleu_4': 0.5136508437273911, 'Bleu_3': 0.5976837849601082, 'Bleu_2': 0.695160779529488, 'Bleu_1': 0.8042445930372798, 'ROUGE_L': 0.66123100173121696, 'METEOR': 0.3896130485687921, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-560583.eval/out.eval <==
{'CIDEr': 1.544314538602787, 'Bleu_4': 0.5139024561624587, 'Bleu_3': 0.5976238957067987, 'Bleu_2': 0.6947163171930727, 'Bleu_1': 0.8037577906598522, 'ROUGE_L': 0.66128674086694594, 'METEOR': 0.3896773537073951, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-581158.eval/out.eval <==
{'CIDEr': 1.5463609451588463, 'Bleu_4': 0.5143664422414851, 'Bleu_3': 0.5982195867304685, 'Bleu_2': 0.695339635355975, 'Bleu_1': 0.8039848292126063, 'ROUGE_L': 0.66154284988529322, 'METEOR': 0.3894968252420756, 'error': 0}

==> show_and_tell_in_graph_model_3_finetune_with_decay/model.ckpt-600000.eval/out.eval <==
{'CIDEr': 1.5454255724593597, 'Bleu_4': 0.5146543713639896, 'Bleu_3': 0.5984360426329598, 'Bleu_2': 0.6955330877002908, 'Bleu_1': 0.8043540592073236, 'ROUGE_L': 0.66186077170292823, 'METEOR': 0.3901790637544266, 'error': 0}

ShowAndTell (finetune with decay)

从 105000 开始 finetune， initlr=1.0, decay=0.9, every_epochs=2.0

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-106482.eval/out.eval <==
{'CIDEr': 0.40871684736857472, 'Bleu_4': 0.21272582097060522, 'Bleu_3': 0.2840776826003769, 'Bleu_2': 0.39429070109850634, 'Bleu_1': 0.5605567572576272, 'ROUGE_L': 0.45
895375684935158, 'METEOR': 0.25052961496749176, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-121014.eval/out.eval <==
{'CIDEr': 0.88862756114194752, 'Bleu_4': 0.35718457037837853, 'Bleu_3': 0.4409785902092341, 'Bleu_2': 0.548009554199005, 'Bleu_1': 0.6851289444746748, 'ROUGE_L': 0.5616
1325990849609, 'METEOR': 0.31888682798725343, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-140271.eval/out.eval <==
{'CIDEr': 1.0971707150698358, 'Bleu_4': 0.40649034086407027, 'Bleu_3': 0.4900052381990188, 'Bleu_2': 0.5931829756936368, 'Bleu_1': 0.720690173758966, 'ROUGE_L': 0.59606
358537314219, 'METEOR': 0.34225499809462023, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-160127.eval/out.eval <==
{'CIDEr': 1.062417035785918, 'Bleu_4': 0.39254865125327687, 'Bleu_3': 0.4766121909710349, 'Bleu_2': 0.5813063167424958, 'Bleu_1': 0.709719830302078, 'ROUGE_L': 0.585395
99200398618, 'METEOR': 0.337571740118561, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-180831.eval/out.eval <==
{'CIDEr': 1.1920010254610296, 'Bleu_4': 0.42960906020900835, 'Bleu_3': 0.5127691818196729, 'Bleu_2': 0.6135373700516862, 'Bleu_1': 0.7326590033071869, 'ROUGE_L': 0.6072
3100353232562, 'METEOR': 0.35258132675398923, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-200718.eval/out.eval <==
{'CIDEr': 1.3416243946955986, 'Bleu_4': 0.4713689765629563, 'Bleu_3': 0.5546557550942366, 'Bleu_2': 0.6528832593823296, 'Bleu_1': 0.7659463960192248, 'ROUGE_L': 0.63266
715697378995, 'METEOR': 0.3679545148451162, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-221502.eval/out.eval <==
{'CIDEr': 1.3423972622763736, 'Bleu_4': 0.4669544876487772, 'Bleu_3': 0.5501227341603667, 'Bleu_2': 0.6487319310015653, 'Bleu_1': 0.7647441093601481, 'ROUGE_L': 0.63291
255692365433, 'METEOR': 0.36727066538915787, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-240593.eval/out.eval <==
{'CIDEr': 1.4101533454724695, 'Bleu_4': 0.4819815349485115, 'Bleu_3': 0.565548743051791, 'Bleu_2': 0.6636829617126633, 'Bleu_1': 0.7766145211634323, 'ROUGE_L': 0.640421
31920347312, 'METEOR': 0.3724362661865993, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-260459.eval/out.eval <==
{'CIDEr': 1.4207544602128646, 'Bleu_4': 0.4885103325080523, 'Bleu_3': 0.5705786653996692, 'Bleu_2': 0.6667997929349436, 'Bleu_1': 0.7763390523424194, 'ROUGE_L': 0.64071
262555288555, 'METEOR': 0.37390658231305895, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-281131.eval/out.eval <==
{'CIDEr': 1.4917682191502983, 'Bleu_4': 0.5018078678318141, 'Bleu_3': 0.5846347796925463, 'Bleu_2': 0.6817391687090015, 'Bleu_1': 0.7911927351802898, 'ROUGE_L': 0.65107
842563132812, 'METEOR': 0.38101101628511713, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-300153.eval/out.eval <==
{'CIDEr': 1.486253599980357, 'Bleu_4': 0.5039510632590413, 'Bleu_3': 0.5870441879488093, 'Bleu_2': 0.6837529546946015, 'Bleu_1': 0.7932058795408301, 'ROUGE_L': 0.651925
05032404602, 'METEOR': 0.38269141386302147, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-320016.eval/out.eval <==
{'CIDEr': 1.519828774917394, 'Bleu_4': 0.5078555292134204, 'Bleu_3': 0.589758529497995, 'Bleu_2': 0.6853832378262579, 'Bleu_1': 0.7918782159498499, 'ROUGE_L': 0.65230554408794417, 'METEOR': 0.38336279904831777, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-340694.eval/out.eval <==
{'CIDEr': 1.5312033210615867, 'Bleu_4': 0.5123199299529585, 'Bleu_3': 0.5949926208980053, 'Bleu_2': 0.690537391431985, 'Bleu_1': 0.7967425467522148, 'ROUGE_L': 0.65627946704403628, 'METEOR': 0.38507849932956995, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-360516.eval/out.eval <==
{'CIDEr': 1.5312291774276383, 'Bleu_4': 0.515815316994766, 'Bleu_3': 0.5977719731744809, 'Bleu_2': 0.6925764267947295, 'Bleu_1': 0.7994446128741132, 'ROUGE_L': 0.65709736606228819, 'METEOR': 0.386535546001232, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-381091.eval/out.eval <==
{'CIDEr': 1.5808962397758237, 'Bleu_4': 0.5216849009886566, 'Bleu_3': 0.6042544042015333, 'Bleu_2': 0.6994521445670683, 'Bleu_1': 0.80537224855512, 'ROUGE_L': 0.66217623890891486, 'METEOR': 0.3913442006951405, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-400062.eval/out.eval <==
{'CIDEr': 1.5510512495458975, 'Bleu_4': 0.5186848602931114, 'Bleu_3': 0.6004799899392248, 'Bleu_2': 0.6949033837819719, 'Bleu_1': 0.8006360164669823, 'ROUGE_L': 0.65776339362077718, 'METEOR': 0.3864610079985209, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-420076.eval/out.eval <==
{'CIDEr': 1.5869365783180849, 'Bleu_4': 0.528101839107245, 'Bleu_3': 0.6100216453777237, 'Bleu_2': 0.7036553288160068, 'Bleu_1': 0.8070417198084182, 'ROUGE_L': 0.66492118046624926, 'METEOR': 0.3921088792450608, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-440780.eval/out.eval <==
{'CIDEr': 1.6280212773961786, 'Bleu_4': 0.5335082599629604, 'Bleu_3': 0.6154751470923349, 'Bleu_2': 0.7095130113580913, 'Bleu_1': 0.8132164996143224, 'ROUGE_L': 0.6688314711912865, 'METEOR': 0.3946126877996813, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-460725.eval/out.eval <==
{'CIDEr': 1.6333717300978943, 'Bleu_4': 0.5313513244352774, 'Bleu_3': 0.613471911312142, 'Bleu_2': 0.7077285369727359, 'Bleu_1': 0.8120190526667842, 'ROUGE_L': 0.66780052301104098, 'METEOR': 0.3948245394481986, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-481578.eval/out.eval <==
{'CIDEr': 1.6447929124264604, 'Bleu_4': 0.5373653739944227, 'Bleu_3': 0.619695720449391, 'Bleu_2': 0.7136187408034167, 'Bleu_1': 0.8168279737156258, 'ROUGE_L': 0.6721839977220766, 'METEOR': 0.39754696880083135, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-500720.eval/out.eval <==
{'CIDEr': 1.6289469612051779, 'Bleu_4': 0.533536772028828, 'Bleu_3': 0.6161836278544074, 'Bleu_2': 0.7108027045370062, 'Bleu_1': 0.8151307847456868, 'ROUGE_L': 0.66926190314535439, 'METEOR': 0.39613893719292476, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-520680.eval/out.eval <==
{'CIDEr': 1.6494577621712048, 'Bleu_4': 0.5384814140177898, 'Bleu_3': 0.6209943803308475, 'Bleu_2': 0.7156546674947021, 'Bleu_1': 0.8196790041172591, 'ROUGE_L': 0.67332050425239964, 'METEOR': 0.3987993980368527, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-540662.eval/out.eval <==
{'CIDEr': 1.6344171448147853, 'Bleu_4': 0.5357269790667725, 'Bleu_3': 0.6181170296265958, 'Bleu_2': 0.7125356173667896, 'Bleu_1': 0.8165422070185717, 'ROUGE_L': 0.67045830467574097, 'METEOR': 0.3973751354056789, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-560514.eval/out.eval <==
{'CIDEr': 1.6542377484486079, 'Bleu_4': 0.5380688502082993, 'Bleu_3': 0.6200358718536387, 'Bleu_2': 0.7139240571894261, 'Bleu_1': 0.8176208430688788, 'ROUGE_L': 0.67184904758997277, 'METEOR': 0.3981874789649363, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-581181.eval/out.eval <==
{'CIDEr': 1.6629519631382192, 'Bleu_4': 0.5410477200091387, 'Bleu_3': 0.6229390401914344, 'Bleu_2': 0.7167922683443948, 'Bleu_1': 0.8204793106637304, 'ROUGE_L': 0.67402881483833033, 'METEOR': 0.39929058162114167, 'error': 0}

==> show_and_tell_in_graph_model_4_finetune_with_decay/model.ckpt-600000.eval/out.eval <==
{'CIDEr': 1.6566025142895853, 'Bleu_4': 0.5411917258447477, 'Bleu_3': 0.6232052659701651, 'Bleu_2': 0.7168969941221279, 'Bleu_1': 0.819915430008249, 'ROUGE_L': 0.67329321079374715, 'METEOR': 0.39892628814006054, 'error': 0}

ShowAndTell Advanced (Visual Attention, finetune with decay, Data augmentation)

从 105000 开始 finetune, 学习率接续训练时学习率继续 decay, initlr=1.0, decay=0.6

epoch Bleu_4 CIDEr METEOR ROUGE_L
106424 0.1457 0.2059 0.2263 0.4159
120295 0.4341 1.2232 0.3604 0.6124
140419 0.4201 1.1955 0.3445 0.5996
160042 0.4330 1.1925 0.3505 0.6073
180285 0.4837 1.4212 0.3760 0.6407
200420 0.4876 1.4325 0.3758 0.6415
220572 0.4831 1.4085 0.3746 0.6382
240627 0.5166 1.5547 0.3850 0.6550
260420 0.5295 1.5975 0.3916 0.6654
280255 0.5337 1.6146 0.3934 0.6669
300536 0.5469 1.6761 0.3993 0.6745
320286 0.5328 1.6273 0.3906 0.6637
340456 0.5561 1.7226 0.4038 0.6784
360634 0.5568 1.7294 0.4056 0.6815
380061 0.5537 1.7175 0.4025 0.6778
400411 0.5665 1.7656 0.4086 0.6847
420000 0.5633 1.7614 0.4068 0.6835
441024 0.5581 1.7436 0.4060 0.6820
460602 0.5685 1.7822 0.4096 0.6871
480164 0.5685 1.7803 0.4104 0.6872
500491 0.5703 1.7819 0.4099 0.6879
520041 0.5720 1.7971 0.4106 0.6885
528005 0.5715 1.7920 0.4113 0.6884
541206 0.5724 1.7946 0.4106 0.6883
561157 0.5736 1.7986 0.4122 0.6895
581505 0.5730 1.7962 0.4119 0.6892
600000 0.5724 1.7972 0.4113 0.6890
621091 0.5733 1.8022 0.4120 0.6892
640713 0.5732 1.8031 0.4126 0.6896
660336 0.5724 1.7934 0.4119 0.6889
680637 0.5729 1.8011 0.4123 0.6892
700000 0.5734 1.8010 0.4121 0.6890

ShowAndTell Advanced (fine tune with decay) lstm_unit=128

从 105000 开始 finetune, 学习率接续训练时学习率继续 decay, initlr=1.0, decay=0.9, per 2.0 epoch, lstm unit=128

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-106510.eval/out.eval <==
{'CIDEr': 0.36797420857018764, 'Bleu_4': 0.19834088992887297, 'Bleu_3': 0.2714774718414129, 'Bleu_2': 0.38302239498952007, 'Bleu_1': 0.5521730577418897, 'ROUGE_L': 0.4536553197579194, 'METEOR': 0.25455677743449767, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-120708.eval/out.eval <==
{'CIDEr': 0.8648651382234972, 'Bleu_4': 0.3376970491403136, 'Bleu_3': 0.4208132340424732, 'Bleu_2': 0.5297268746788052, 'Bleu_1': 0.6672059943779668, 'ROUGE_L': 0.54556618672397295, 'METEOR': 0.3130282337358398, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-140415.eval/out.eval <==
{'CIDEr': 1.0999574458245345, 'Bleu_4': 0.4023164691675225, 'Bleu_3': 0.4883904691858901, 'Bleu_2': 0.5946694355929807, 'Bleu_1': 0.7221773929613827, 'ROUGE_L': 0.59694661637950119, 'METEOR': 0.3437719843712334, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-160901.eval/out.eval <==
{'CIDEr': 1.1673472539648975, 'Bleu_4': 0.41166458523061233, 'Bleu_3': 0.4969323046597834, 'Bleu_2': 0.6027398881594938, 'Bleu_1': 0.7322706201120531, 'ROUGE_L': 0.59947885816554003, 'METEOR': 0.34639892553764584, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-180747.eval/out.eval <==
{'CIDEr': 1.1637932381424618, 'Bleu_4': 0.4203070605128548, 'Bleu_3': 0.5043072319723673, 'Bleu_2': 0.6074514150381377, 'Bleu_1': 0.730727346003337, 'ROUGE_L': 0.6008655233157133, 'METEOR': 0.34785766226295456, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-201256.eval/out.eval <==
{'CIDEr': 1.2724999438031879, 'Bleu_4': 0.44998446500819045, 'Bleu_3': 0.5339822751422633, 'Bleu_2': 0.6353384364545511, 'Bleu_1': 0.7554168912055034, 'ROUGE_L': 0.62134659632108946, 'METEOR': 0.3605334277147221, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-220175.eval/out.eval <==
{'CIDEr': 1.3258999491387531, 'Bleu_4': 0.4616534268380112, 'Bleu_3': 0.5459248393354141, 'Bleu_2': 0.6470560594949445, 'Bleu_1': 0.7646184006563145, 'ROUGE_L': 0.6308599522925501, 'METEOR': 0.36725830486125116, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-241465.eval/out.eval <==
{'CIDEr': 1.3706500464619795, 'Bleu_4': 0.4673445979438162, 'Bleu_3': 0.5529023307611443, 'Bleu_2': 0.654543138891198, 'Bleu_1': 0.7719081466764967, 'ROUGE_L': 0.63531929832890688, 'METEOR': 0.36962580196157396, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-260379.eval/out.eval <==
{'CIDEr': 1.3587839433569775, 'Bleu_4': 0.47342858792902276, 'Bleu_3': 0.5569447423451803, 'Bleu_2': 0.6557701629880054, 'Bleu_1': 0.7688870824812829, 'ROUGE_L': 0.63366887572413322, 'METEOR': 0.3681634474535597, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-280089.eval/out.eval <==
{'CIDEr': 1.4246911170917225, 'Bleu_4': 0.4842059587539873, 'Bleu_3': 0.5679712166576061, 'Bleu_2': 0.6673174775397446, 'Bleu_1': 0.7806076253832578, 'ROUGE_L': 0.64418391217303272, 'METEOR': 0.37673372766197094, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-300517.eval/out.eval <==
{'CIDEr': 1.4073731046267191, 'Bleu_4': 0.47925678182801523, 'Bleu_3': 0.5640702910418595, 'Bleu_2': 0.6653238166661914, 'Bleu_1': 0.7808547380012334, 'ROUGE_L': 0.6422
9888103722577, 'METEOR': 0.3774499665354913, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-320207.eval/out.eval <==
{'CIDEr': 1.4589818712151483, 'Bleu_4': 0.4963210823029324, 'Bleu_3': 0.5800212346905671, 'Bleu_2': 0.6770110965700993, 'Bleu_1': 0.7870859991663363, 'ROUGE_L': 0.64922582936637896, 'METEOR': 0.3809197867697427, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-340695.eval/out.eval <==
{'CIDEr': 1.475970286171485, 'Bleu_4': 0.5009578487426155, 'Bleu_3': 0.5838047023810665, 'Bleu_2': 0.6800216832868062, 'Bleu_1': 0.7884416708710645, 'ROUGE_L': 0.65163096748882332, 'METEOR': 0.3803734515787177, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-360394.eval/out.eval <==
{'CIDEr': 1.5160227696488979, 'Bleu_4': 0.5050166747839487, 'Bleu_3': 0.5890487682132682, 'Bleu_2': 0.6875200373208923, 'Bleu_1': 0.7978083750405868, 'ROUGE_L': 0.65545459960965502, 'METEOR': 0.38556338875297164, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-380887.eval/out.eval <==
{'CIDEr': 1.534958809998515, 'Bleu_4': 0.5098820920036026, 'Bleu_3': 0.5937994592855487, 'Bleu_2': 0.6914716655377624, 'Bleu_1': 0.8006432960451781, 'ROUGE_L': 0.65962745533714207, 'METEOR': 0.38760272602776913, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-400605.eval/out.eval <==
{'CIDEr': 1.5553605794706209, 'Bleu_4': 0.5139807582165652, 'Bleu_3': 0.5974181404656778, 'Bleu_2': 0.6941838276486704, 'Bleu_1': 0.8010808819625552, 'ROUGE_L': 0.66005715019673006, 'METEOR': 0.38816885650481175, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-421088.eval/out.eval <==
{'CIDEr': 1.5622922291304431, 'Bleu_4': 0.5178015608286759, 'Bleu_3': 0.6007231168366048, 'Bleu_2': 0.6959473146398398, 'Bleu_1': 0.8022364686635713, 'ROUGE_L': 0.6618234257774005, 'METEOR': 0.38899144358203763, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-440002.eval/out.eval <==
{'CIDEr': 1.5566355786812214, 'Bleu_4': 0.5171188694099659, 'Bleu_3': 0.6003339124454303, 'Bleu_2': 0.6964484299184749, 'Bleu_1': 0.8033957361729964, 'ROUGE_L': 0.66260611588306573, 'METEOR': 0.38913461819157, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-461278.eval/out.eval <==
{'CIDEr': 1.5664419714963582, 'Bleu_4': 0.5182171910155178, 'Bleu_3': 0.600976120640246, 'Bleu_2': 0.696600784461038, 'Bleu_1': 0.8028638111833314, 'ROUGE_L': 0.66152079610136583, 'METEOR': 0.3890252670822437, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-480868.eval/out.eval <==
{'CIDEr': 1.5758590667518972, 'Bleu_4': 0.520967002008999, 'Bleu_3': 0.603708913599725, 'Bleu_2': 0.699329786420287, 'Bleu_1': 0.8056723410490366, 'ROUGE_L': 0.66361196160926705, 'METEOR': 0.39056887154738673, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-500441.eval/out.eval <==
{'CIDEr': 1.5827634625433837, 'Bleu_4': 0.5235656312494492, 'Bleu_3': 0.6066320951108976, 'Bleu_2': 0.7023355620447369, 'Bleu_1': 0.8084043365632564, 'ROUGE_L': 0.66540405083425158, 'METEOR': 0.39223150606811585, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-520797.eval/out.eval <==
{'CIDEr': 1.5944707661656123, 'Bleu_4': 0.5274761913080757, 'Bleu_3': 0.6104541914475698, 'Bleu_2': 0.7057992286872988, 'Bleu_1': 0.8113781193488856, 'ROUGE_L': 0.66753131889843187, 'METEOR': 0.3946267722158354, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-540376.eval/out.eval <==
{'CIDEr': 1.6149448469313292, 'Bleu_4': 0.528984414320093, 'Bleu_3': 0.6119177165619664, 'Bleu_2': 0.7076001888041092, 'Bleu_1': 0.8136709136116668, 'ROUGE_L': 0.66938312380421838, 'METEOR': 0.3952783545697303, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-560922.eval/out.eval <==
{'CIDEr': 1.6106816913184463, 'Bleu_4': 0.5292756908369953, 'Bleu_3': 0.6120947060891795, 'Bleu_2': 0.7072391862318623, 'Bleu_1': 0.8118169727970564, 'ROUGE_L': 0.6691678589221518, 'METEOR': 0.39432020424502356, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-580699.eval/out.eval <==
{'CIDEr': 1.6204660979734609, 'Bleu_4': 0.5308883741020533, 'Bleu_3': 0.6138231490208452, 'Bleu_2': 0.7090208114087609, 'Bleu_1': 0.8141533182558003, 'ROUGE_L': 0.66976229816205735, 'METEOR': 0.3961562000507441, 'error': 0}

==> model/show_and_tell_in_graph_model_5_finetune_with_decay/model.ckpt-600000.eval/out.eval <==
{'CIDEr': 1.6012001445131934, 'Bleu_4': 0.5299509267841847, 'Bleu_3': 0.6130929737071172, 'Bleu_2': 0.7086639181703127, 'Bleu_1': 0.814197825717292, 'ROUGE_L': 0.66903238032965806, 'METEOR': 0.39610802825880737, 'error': 0}

Visual Attention 2-layer Highway LSTM Network

initlr=1.0, decay=0.6, 比没有 Highway 稍好一点儿

epoch Bleu_4 CIDEr METEOR ROUGE_L
80484 0.4258 1.1581 0.3408 0.5993
100456 0.4424 1.2232 0.3568 0.6136
121208 0.4698 1.3491 0.3638 0.6271
160512 0.4726 1.3707 0.3700 0.6294
180049 0.5009 1.4637 0.3809 0.6461
201070 0.4814 1.3793 0.3669 0.6362
220867 0.4616 1.3391 0.3629 0.6205
240549 0.5396 1.6291 0.3955 0.6680
260372 0.5351 1.6131 0.3936 0.6678
280632 0.5475 1.6696 0.4001 0.6750
301203 0.5467 1.6609 0.3980 0.6728
320617 0.5448 1.6589 0.3998 0.6735
340608 0.5569 1.7069 0.4028 0.6797
362006 0.5551 1.7049 0.4044 0.6797
380592 0.5520 1.6874 0.4030 0.6790
400936 0.5614 1.7317 0.4058 0.6829
420208 0.5576 1.7177 0.4065 0.6818
441306 0.5550 1.7075 0.4039 0.6786
461133 0.5646 1.7382 0.4083 0.6839
481326 0.5639 1.7380 0.4082 0.6832
501213 0.5625 1.7353 0.4072 0.6836
540058 0.5628 1.7466 0.4085 0.6840
560670 0.5626 1.7459 0.4084 0.6838
581209 0.5643 1.7507 0.4089 0.6850
600000 0.5636 1.7448 0.4088 0.6846

semantic attention

epoch Bleu_4 CIDEr METEOR ROUGE_L
180973 0.0000 0.0001 0.0219 0.0044
201097 0.3208 0.7698 0.2953 0.5322
220357 0.3445 0.8733 0.3060 0.5520
240481 0.4082 1.1112 0.3404 0.5949
261399 0.4363 1.2011 0.3514 0.6116
280555 0.4676 1.3262 0.3639 0.6300
300541 0.4820 1.4066 0.3729 0.6371
321386 0.4668 1.3271 0.3622 0.6273
340491 0.5112 1.5261 0.3847 0.6547
360470 0.5015 1.4727 0.3818 0.6499
381675 0.5116 1.5287 0.3857 0.6556
400053 0.5292 1.5861 0.3937 0.6650
421214 0.5243 1.5865 0.3889 0.6613
440660 0.5238 1.5928 0.3898 0.6619
460858 0.5415 1.6561 0.3961 0.6715
481695 0.5341 1.6432 0.3969 0.6705
500029 0.5329 1.6191 0.3951 0.6695
520855 0.5468 1.6638 0.4004 0.6740
541615 0.5471 1.6534 0.4008 0.6737
560857 0.5490 1.6913 0.4015 0.6778
581152 0.5506 1.6955 0.4016 0.6778
600000 0.5499 1.6949 0.4028 0.6782
620399 0.5522 1.7107 0.4037 0.6796
641596 0.5527 1.7086 0.4022 0.6786
660099 0.5518 1.7069 0.4038 0.6791
680410 0.5519 1.7089 0.4045 0.6797
701737 0.5535 1.7089 0.4041 0.6793
720321 0.5532 1.7140 0.4043 0.6796
741392 0.5546 1.7216 0.4048 0.6805
760762 0.5550 1.7132 0.4042 0.6802
781140 0.5545 1.7184 0.4045 0.6804
800000 0.5549 1.7188 0.4047 0.6801

semantic attention with luong attention

对比BahdanauAttention attention, CIDEr高一点

epoch Bleu_4 CIDEr METEOR ROUGE_L
181663 0.1535 0.2358 0.2266 0.4441
200207 0.3696 0.9786 0.3302 0.5730
220287 0.3722 0.9426 0.3233 0.5712
241544 0.4304 1.2083 0.3507 0.6037
260081 0.4352 1.2297 0.3560 0.6114
281267 0.4677 1.3436 0.3675 0.6282
300677 0.4737 1.3632 0.3701 0.6330
320961 0.4320 1.2337 0.3558 0.6122
340362 0.5011 1.4720 0.3793 0.6466
360611 0.5015 1.4946 0.3827 0.6501
381750 0.4819 1.4060 0.3712 0.6351
400240 0.5294 1.6131 0.3909 0.6653
421376 0.5242 1.5825 0.3906 0.6615
440749 0.5117 1.5536 0.3870 0.6556
461010 0.5390 1.6542 0.3971 0.6700
480389 0.5374 1.6391 0.3971 0.6693
500644 0.5399 1.6612 0.3966 0.6705
520013 0.5434 1.6642 0.3992 0.6726
540256 0.5426 1.6768 0.3971 0.6718
561239 0.5496 1.6960 0.4026 0.6773
580283 0.5521 1.7142 0.4031 0.6787
600734 0.5517 1.7016 0.4035 0.6775
620089 0.5516 1.7048 0.4037 0.6779
640182 0.5544 1.7202 0.4048 0.6790
660357 0.5486 1.7062 0.4033 0.6781
680082 0.5540 1.7189 0.4050 0.6790
700340 0.5526 1.7232 0.4041 0.6787
720357 0.5494 1.7208 0.4052 0.6790
740834 0.5555 1.7393 0.4059 0.6806
761175 0.5517 1.7269 0.4049 0.6791
780617 0.5532 1.7207 0.4058 0.6790
800000 0.5536 1.7385 0.4059 0.6801

semantic attention, use idf weighted attribute loss

对比平均weighted的结果，可以提升1个千分点左右的ROUGE

epoch Bleu_4 CIDEr METEOR ROUGE_L
201435 0.1997 0.3789 0.2524 0.4583
221153 0.3583 0.9137 0.3209 0.5625
240842 0.3681 0.9151 0.3235 0.5667
260517 0.3989 1.0844 0.3356 0.5840
280286 0.4600 1.3041 0.3616 0.6230
300042 0.4790 1.3586 0.3681 0.6344
320518 0.4751 1.3836 0.3690 0.6329
340265 0.5058 1.5069 0.3815 0.6506
361458 0.4895 1.4202 0.3757 0.6407
381160 0.4848 1.4174 0.3691 0.6369
400885 0.5199 1.5608 0.3868 0.6606
420599 0.5184 1.5583 0.3887 0.6620
440311 0.5094 1.5398 0.3878 0.6559
460697 0.5304 1.6156 0.3955 0.6668
480248 0.5389 1.6363 0.3972 0.6716
501235 0.5380 1.6414 0.3972 0.6705
520744 0.5481 1.6894 0.4012 0.6773
540285 0.5444 1.6602 0.4000 0.6738
560538 0.5497 1.6973 0.4034 0.6787
580253 0.5495 1.6947 0.4001 0.6773
601436 0.5490 1.6963 0.4020 0.6778
620180 0.5520 1.7021 0.4037 0.6803
641545 0.5521 1.7119 0.4036 0.6798
660320 0.5513 1.7012 0.4045 0.6795
681729 0.5536 1.7131 0.4046 0.6806
700303 0.5528 1.7175 0.4049 0.6801
721238 0.5519 1.7132 0.4032 0.6796
740684 0.5556 1.7261 0.4053 0.6813
760055 0.5534 1.7194 0.4043 0.6803
780553 0.5552 1.7233 0.4050 0.6807
800000 0.5533 1.7197 0.4051 0.6805
Clone this wiki locally