Topics to Look For¶
- Sequence models
- RNNs
- GRU
- LSTM
- Bidirectional RNN
- Word embeddings
Resources¶
- DeepLearning.ai: Sequence Models, Week 1, all videos (12 videos)
- DeepLearning.ai: Sequence Models, Week 2, Introduction to Word Embeddings (4 videos)
Supplemental¶
- The Unreasonable Effectiveness of Recurrent Neural Networks is an article that provides a nice, deep dive into RNNs, full of visual explanations and examples.
- Chapter 8 - Recurrent Neural Networks from Dive into Deep Learning covers recurrent neural networks with lots of examples, diagrams, and embedded code (including PyTorch examples).
- Chapter 10 - Sequence Modeling: Recurrent and Recursive Nets from the Deep Learning book, as usual for this resource, is fairly math-heavy and quite detailed. I recommend using it as a reference in which to look up specific topics for this week to gain a different perspective and possibly a few more details.