Blame
|
1 | # Deep Learning |
||||||
| 2 | ||||||||
| 3 | Neural networks from the single perceptron to modern transformers: how depth, the right activations, and gradient-based training let a model learn its own features instead of hand-crafted ones. |
|||||||
| 4 | ||||||||
|
5 | **Prerequisites:** the [Machine Learning](/en/Machine%20Learning) course (especially the perceptron in [Linear classification](/en/Machine%20Learning/05%20Linear%20classification)), basic Python, calculus, and linear algebra. |
||||||
|
6 | |||||||
| 7 | ## Syllabus |
|||||||
| 8 | ||||||||
| 9 | 1. [Introduction](/en/Deep%20Learning/01%20Introduction) |
|||||||
| 10 | 2. [Multilayer perceptron](/en/Deep%20Learning/02%20Multilayer%20perceptron) |
|||||||
| 11 | 3. [Activation functions](/en/Deep%20Learning/03%20Activation%20functions) |
|||||||
| 12 | 4. [Loss functions and output layers](/en/Deep%20Learning/04%20Loss%20functions%20and%20output%20layers) |
|||||||
| 13 | 5. [Backpropagation](/en/Deep%20Learning/05%20Backpropagation) |
|||||||
| 14 | 6. [Optimization](/en/Deep%20Learning/06%20Optimization) |
|||||||
| 15 | 7. [Initialization and vanishing gradients](/en/Deep%20Learning/07%20Initialization%20and%20vanishing%20gradients) |
|||||||
| 16 | 8. [Normalization](/en/Deep%20Learning/08%20Normalization) |
|||||||
| 17 | 9. [Regularization and dropout](/en/Deep%20Learning/09%20Regularization%20and%20dropout) |
|||||||
| 18 | 10. [Convolutional networks](/en/Deep%20Learning/10%20Convolutional%20networks) |
|||||||
|
19 | 11. [Embeddings and representation learning](/en/Deep%20Learning/11%20Embeddings%20and%20representation%20learning) |
||||||
| 20 | 12. [Recurrent networks](/en/Deep%20Learning/12%20Recurrent%20networks) |
|||||||
| 21 | 13. [LSTM and GRU](/en/Deep%20Learning/13%20LSTM%20and%20GRU) |
|||||||
| 22 | 14. [Attention](/en/Deep%20Learning/14%20Attention) |
|||||||
| 23 | 15. [Transformers](/en/Deep%20Learning/15%20Transformers) |
|||||||
|
24 | |||||||
| 25 | --- |
|||||||
| 26 | [Machine Learning](/en/Machine%20Learning) · [MLOps](/en/MLOps) · [Home](/en) |
|||||||
