How do Neural Networks update weights and Biases during Back Propagation?
Ans. To reduce the error by changing the values of weights and biases.
calculate the rate of change of error w.r.t change in weight.
Since we are propagating backwards, first thing we need to do is, calculate the change in total errors w.r.t the output O1 and O2.
Now, we will propagate further backwards and calculate the change in output O1 w.r.t to its total net input.
Step – 3: Putting all the values together and calculating the updated weight value
Now, let’s put all the values together:
Let’s calculate the updated value of W5:
This is an example to know how to update the weights and biases in Neural Network. This process continues until we get minimized error.