~/blog/tutorials/deep-learning

Perceptron Ann

Jun 29, 202614 min read

Perceptron Intuition

The perceptron is the atom of deep learning. Every multi-billion-parameter transformer you've heard about is, at its core, a vast arrangement of units that trac…

Tutorial

Jun 29, 202618 min read

Advantages and Disadvantages of Perceptron

The perceptron converged cleanly on the loan approval dataset from the previous post. Five applicants, two normalized features — income ratio and credit score r…

Tutorial

Jun 29, 202613 min read

ANN Intuition and Learning

A perceptron can draw exactly one straight line. Churn prediction, fraud detection, and handwriting recognition all require curved, non-linear decision boundari…

Tutorial

Jun 29, 202614 min read

Backpropagation and Weight Updation

The network in the previous post made a prediction of ŷ ≈ 0.536 for a sample whose true label is 0. The binary cross-entropy loss came out to 0.767. That is a l…

Tutorial

Jun 29, 202612 min read

Chain Rule of Derivatives

Every weight update in a neural network comes down to one question: how does a change in W affect the loss? The problem is that Loss doesn't mention W directly.…