Blog

Technical insights, tutorials, and thoughts on AI

Batch Normalization

•
Machine learning Batch normalization
Papers Sergey Ioffe and Christian Szegedy: Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift, ICML 2015. J.L. Ba, J. R. Kiros, and G.E. Hinton. Layer...

Rotation Invariant CNN

•
Machine learning
This Stack Overflow post explores a question I had reading about Convolutional Neural Networks: Why rotation-invariant neural networks are not used in winners of the popular competitions?

Ali Ghodsi U Waterloo AI Courses

•
Machine learning Statistics
I came across Ali Gholdsi’s lectures by chance, and some of the YouTube comments were so positive that I had to watch his lectures: “These lectures are way more informative than the Stanford ones”,...

Orson Welles

•
Film
I’ve started watching The Lady from Shanghai. Film noir of Orson Welles with his then wife, I think, Rita Hayworth.

CS231n assignments

•
Python Deep learning
Course links CS231n: Convolutional Neural Networks for Visual Recognition (Spring 2017), syllabus, 2016 video, 2017 videos, 2017 slides, 2021 slides 2019 Syllabus and Assignments Github: cs2...

Docker for Deep Learning

•
Python Machine learning Docker
It is often good practice to run the development environment in a docker container. This is useful when doing distributed development with multiple engineers, who may each use a different versio...

Learning Deep Learning (book review)

•
Python Deep learning
Review of Learning Deep Learning: Theory and Practice of Neural Networks, Computer Vision, Natural Language Processing, and Transformers Using TensorFlow, by Magnus Ekman (2021)

Paddle OCR

•
Python
Here are a chapter notebooks for Deep Learning with PyTorch, E. Stevens et al (2020) (github). The notebooks I created below are optimized for Google Colab, and are slightly more complete than the ...

Entropy

•
Computation theory
References: C. Shannon: A Mathematical Theory of Communication (1948) E.T. Jaynes: Probability Theory: The Logic of Science (2003) K. Mallick: Thermodynamics and Information Theory, video ...