Skip to main content
For this course you need to review some basic calculus. The best resource for it is Khan Academy’s Multivariate Calculus. Go through the videos and exercises in Units 1 and 2 only. For more advanced reader, and specifically for fully understanding deep learning that includes matrix calculus there is a very good reference here. We have also shot a recitation video for you to review some of the concepts.
Calculus recitation for my classes. Recitation was delivered by my TA Pritam Sen. Key references: (Bengio, 2012; Lin et al., 2016; Dumoulin & Visin, 2016)

References

  • Bengio, Y. (2012). Practical recommendations for gradient-based training of deep architectures.
  • Dumoulin, V., Visin, F. (2016). A guide to convolution arithmetic for deep learning.
  • Lin, H., Tegmark, M., Rolnick, D. (2016). Why does deep and cheap learning work so well?.