python script hangs when trainer_count > 1 and call trainer.train() more than once.

[juliecbd]

import paddle.v2 as paddle
paddle.init(use_gpu=False, trainer_count=2)

if we set trainer_count > 1, and call trainer.train() more than one time, then the program just hangs. If we set trainer_count=1, the script runs as expected. What could be the reason? Thanks

[lcy-seso]

I have met the same bug #2565.

[jacquesqiao]

just to confirm. is it hang when paddle.trian or paddle.infer? Because @lcy-seso meet a similar problem when calling paddle.infer multiple times

[juliecbd]

Mine is when train()

…

On Jun 23, 2017, at 6:30 PM, 乔龙飞 ***@***.***> wrote: just to confirm. is it hang when paddle.trian or paddle.infer? Because @lcy-seso <https://github.com/lcy-seso> meet a similar problem when calling paddle.infer multiple times — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#2534 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AbSLuEGW723keAu8bjeSeDWD-dZ_ZGa4ks5sHGa2gaJpZM4N_3fc>.

[jacquesqiao]

thx，can you paste or give a demo to reproduce the problem?

[juliecbd]

Yes, just simply import paddle.v2 as paddle import paddle.v2.dataset.uci_housing as uci_housing def main(): # init paddle.init(use_gpu=False, trainer_count=2) # network config x = paddle.layer.data(name='x', type=paddle.data_type.dense_vector(13)) y_predict = paddle.layer.fc(input=x, size=1, act=paddle.activation.Linear()) y = paddle.layer.data(name='y', type=paddle.data_type.dense_vector(1)) cost = paddle.layer.mse_cost(input=y_predict, label=y) # create parameters parameters = paddle.parameters.create(cost) # create optimizer optimizer = paddle.optimizer.Momentum(momentum=0) trainer = paddle.trainer.SGD( cost=cost, parameters=parameters, update_equation=optimizer) feeding = {'x': 0, 'y': 1} # event_handler to print training and testing info def event_handler(event): if isinstance(event, paddle.event.EndIteration): if event.batch_id % 100 == 0: print "Pass %d, Batch %d, Cost %f" % ( event.pass_id, event.batch_id, event.cost) if isinstance(event, paddle.event.EndPass): result = trainer.test( reader=paddle.batch(uci_housing.test(), batch_size=2), feeding=feeding) print "Test %d, Cost %f" % (event.pass_id, result.cost) # training trainer.train( reader=paddle.batch( paddle.reader.shuffle(uci_housing.train(), buf_size=500), batch_size=2), feeding=feeding, event_handler=event_handler, num_passes=30) trainer.train( reader=paddle.batch( paddle.reader.shuffle(uci_housing.train(), buf_size=500), batch_size=2), feeding=feeding, event_handler=event_handler, num_passes=30) if __name__ == '__main__': main()

…

On Jun 23, 2017, at 6:34 PM, 乔龙飞 ***@***.***> wrote: thx，can you paste or give a demo to reproduce the problem? — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#2534 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AbSLuBDTNocW6nBuA2pQbhqKq7wMOLhoks5sHGe0gaJpZM4N_3fc>.

[jacquesqiao]

thanx, I reproduced this problem with your demo. It's very strange, I will have a look.

[juliecbd]

Thank you

…

On Jun 23, 2017, at 7:00 PM, 乔龙飞 ***@***.***> wrote: thanx, I reproduced this problem with your demo. It's very strange, I will have a look. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#2534 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AbSLuAToK93mKdUlrYikBPJ8qtI4htLhks5sHG26gaJpZM4N_3fc>.