Here are a collection of animations I made for visualizing typical operations in Convolutional Neural Networks. I used them in the context of IVADO/Mila’s deep learning schools.

All animations were done using the 3blue1brown’s manim library. Check out the code to reproduce the images.

1D Convolution

2D Convolution

Zero Padding

Valid Convolution

Same Convolution

Full Convolution

Strided Convolution

Strided 1 and Stride 2

Pooling

Dilated Convolution

MNIST Convolution

Depth

RGB Convolution

RGB to Volume

Volume to Volume

1x1 Convolution

Global Pooling

Transpose Convolution