Library · Skill map
Neural Networks
From a single neuron to training deep networks — with the math kept honest.
5 chapters · 14 skills
Map what you already knowChapter 1
Foundations
- The artificial neuron
- Activation functionsNeeds The artificial neuron
- Layers and forward passNeeds Activation functions
Chapter 2
How networks learn
- Loss functionsNeeds Layers and forward pass
- Gradient descentNeeds Loss functions
- BackpropagationNeeds Gradient descent
Chapter 3
Training in practice
- Overfitting and generalizationNeeds Backpropagation
- OptimisersNeeds Gradient descent
- Initialization and normalizationNeeds Optimisers
Chapter 4
Architectures
- Convolutional networksNeeds Layers and forward pass
- Sequence modelsNeeds Layers and forward pass
- AttentionNeeds Sequence models
Chapter 5
Evaluation and judgment
- MetricsNeeds Overfitting and generalization
- Debugging trainingNeeds Metrics