Tutorial
Jul 1, 20266 min read
0
Loss Function vs Cost Function
The terms "loss function" and "cost function" are used interchangeably in most textbooks, tutorials, and framework documentation. That ambiguity hides a distinc…
~/blog/tutorials/deep-learning
Loss Functions
Tutorial
Jul 1, 20269 min read
0
Regression Cost Functions
Regression outputs a continuous number. The loss function for regression measures how far that number is from the true value — but how you measure "far" determi…
Tutorial
Jul 1, 202610 min read
0
Classification Loss Functions
Regression loss measures distance — how far is the prediction from the true number. Classification loss measures information — how surprised are you by the true…
Tutorial
Jul 1, 20267 min read
0
Which Loss Function to Use When
You have now seen five loss functions: MSE, MAE, Huber, BCE, CCE, Sparse CCE, Hinge, and Focal. The first question when starting a new supervised learning task…
Tutorial
Jul 3, 20267 min read
0
Log-Cosh Loss
MSE squares the error — a prediction that is 30,000 off on a house price gets 900,000,000 added to the loss. One extreme outlier can dominate the entire trainin…