Neural Networks & Deep Learning¶
What this subject is for: The architectural primitives every modern model is built from — MLPs, CNNs, RNNs, residuals, normalization, optimization, scaling laws.
Track status: 13 substantive concept pages · 1 stub awaiting next cycle. See the live generation status and the latest retrospective.
Concepts¶
- Adaptive optimizers
- Backpropagation
- Batch normalization
- Gradient Descent
- Layer Normalization
- Normalization
- Optimization
- Regularization in Large Model Fine-Tuning
- Residual connections
- Residual Networks
- Scaling laws in neural networks
- Transformer Architecture
- Transformers
Auto-seeded stubs awaiting next cycle: what-can-you-build-next-template-04-neural-networks-deep-learning
Arcs through this subject¶
Key thinkers¶
Author pages pending.
Builds tied to this subject¶
MVB recipes pending — currently they live inside concept pages' Build it sections.
Auto-rebuilt from filesystem state by scripts/rebuild_track_indexes.py — see system architecture.