Regularization

[rongyixiao]

hello,I'd like to ask:
bulk_feat = Dense(CATES, use_bias=True, activity_regularizer=regularizers.l1(0), activation=softmax)(cfeat)
According to the paper should be like this:
bulk_feat = Dense(CATES, use_bias=True, kernel_regularizer=regularizers.l1(1.0), activation=softmax)(cfeat)
And there should be some adjustment of lambda coefficients。

[StevenBanama]

Agree with you. I dont experiment all regularizer due to limitation of time. I just wanna to keep bulk_feat as steady distribution , So you can change it.

[rongyixiao]

thank you!