Bad Performance in test data set

[LiangSun1994]

I have read your this paper which give excellent result than original lstm. Recently, after implementing this idea in TensorFlow, However, I have got very bad results in the test data set. Here is the source code.
The following picture is the result of accuracy. The yellow line is training loss. The blue line is training loss when the training flag in the batch norm is set to false. The red line is test loss.

I have tried the bn-lstm code you have mentioned. For example:
https://github.com/OlavHN/bnlstm
https://gist.github.com/spitis/27ab7d2a30bbaf5ef431b4a02194ac60
They got a similar result. Please take a look at this discussion. Please help me whether I have mad a stupid mistake.
@cooijmanstim @ballasn @Thrandis @caglar