View
0
Download
0
Category
Preview:
Citation preview
CS230:Lecture3ThemathematicsofdeeplearningBackpropagation,Initializations,Regularization
KianKatanforoosh
I– BackpropagationII– InitializationsIII– Regularization
I- Backpropagation
Problemstatement
A– LogisticRegressionbackpropagationforonetrainingexample
B– LogisticRegressionbackpropagationforabatchofmexamples
Question:Youhavetrainedananimalclassifier.Canyoutellwhatpartoftheinputledtothisprediction?
II- Initializations
Problemstatement
Inclass,you’veseenthat:
Thegoal:
Let’sprovethat: !"# "[%&'] = !"# "[%] → !"# +[%] = 1-[%&']
Let’sprovethat: !"# "[%&'] = !"# "[%] → !"# +[%] = 1-[%&']
!"# "[%] = !"# .[%] = !"# / +',1% "1%&'2 345
16'Checkpoint:
We’veshownthatforeverylayerl: !"# "[%] = -[%&']!"# +[%] !"# "[%&']
Recommended