What might be the reasons of the Neural Network model is unable to decrease loss during training period?
Ans: Large Learning rate will cause the optimization to diverge, small learning rate will prevent you from making real improvement,
Share:
Ans: Large Learning rate will cause the optimization to diverge, small learning rate will prevent you from making real improvement,