This is part 2 summary of Prof Andrews specialization course "Improving Deep Neural Networks Hyperparameter, tuning, regularization, optimization" (Week1)
Regularization should be used when our neural network overfits the data. (And how'd we know if our NN overfits on data please refer Setting up Machine Learning Application)
Read More »
Tags:
cost function,
early stopping,
gradient descent,
hyperparameter,
machine learning,
overfitting,
regularization,
weight decay