Index 0: IN IN IN IN IN IN
Index 1: - H H H H H
Index 2: -- H H H H
Index 3: ---- H H
Index 4: ------ O
For each of these layers, create a connection object forwards and backwards to respective neurons (meaning its all connected)
Steps:
- Check to make sure the input works for the model
- Then, set the input neurons with their input values
- For every other neuron starting at layer 1, set their value to the values from all connected neurons, multiplied by all connected weights, and added to its bias. (All this is squished by a sigmoid function)
- Stop at output
- FOR ERROR
- Calculate error for output layer: (known answer - system guess)
- Calculate error for all of the hidden layers, back to front
((Forward_Weight₁ * Forward_Neuron₁) + (Forward_Weight₂ * Forward_Neuron₂) ...)
- FOR WEIGHTS:
- output of the hidden layer passed through the derivative of sigmoid
- multiply above by the output errors of the neurons
- multiply above my the learning rate
- multiply above by the input of the last neuron
learning rate * hidden error * derivative(hidden) * input
- FOR BIASES
- output of the hidden layer passed through the derivative of sigmoid
- multiply above by the output errors of the neurons
- multiply above my the learning rate
learning rate * hidden error * derivative(hidden)