• Recap: LSTM, Gated Recurrent Unit (GRU)
  • Multi-layer RNNs
  • Bi-directional RNNs
  • Use cases:
    • n to 1, 1 to n, n to n
    • Image captioning, Translation, Character RNN
  • Topic: Autoencoders
  • Manifold hypothesis
    • real-world data lives in a low-dimensional non-linear manifold
    • Data concentrates around a low-dimensional manifold
  • Manifold in machine learning
  • Principal component analysis