Bessel's Correction

When you compute variance in NumPy, you pass ddof=1 for sample variance and ddof=0 for population variance. Most people do this mechanically. But understanding why the denominator changes from $n$ to $n-1$ is one of those insights that permanently improves how you think about estimation from data.

The short version: when you use the sample mean to estimate variance, you introduce a systematic bias. Dividing by $n-1$ instead of $n$ corrects that bias. Without the correction, your variance estimate is always too small — and small variance estimates make models look more stable than they are.

The Anchor Dataset

Throughout this post, every example uses six cross-validation accuracy scores from a classifier:

Mean: $\bar{x}=0.838$

Why the Bias Exists: The Core Intuition

Here is the fundamental problem. You want to measure how much your CV scores vary around the true population mean $\mu$ — the model's real generalization accuracy. But you do not know $\mu$. You only know $\bar{x}$, the sample mean computed from those same six folds.

The sample mean $\bar{x}$ is calculated from the data. By construction, it is always closer to the data than $\mu$ would be. Deviations from $\bar{x}$ are always at least as small as deviations from $\mu$, never larger.

Why? Because $\bar{x}$ is the value that minimizes the sum of squared deviations from any of the data points. $\mu$ does not have this property — it is the true center of the population, which may or may not be close to your specific sample. So when you compute:

${\sum }_{i=1}^n(x_i-\bar{x}{)}^2$

you get a smaller number than:

${\sum }_{i=1}^n(x_i-\mu {)}^2$

Dividing the smaller sum by $n$ gives a variance estimate that is systematically too small. Bessel's correction compensates by inflating the denominator to $n-1$.

A Concrete Example with the CV Scores

With our six folds, the sum of squared deviations from $\bar{x}=0.838$ is:

${\sum }_{i=1}^6(x_i-0.838{)}^2=(-0.018{)}^2+(-0.048{)}^2+(0.072{)}^2+(0.012{)}^2+(-0.058{)}^2+(0.042{)}^2$

$=0.000324+0.002304+0.005184+0.000144+0.003364+0.001764=0.013084$

Dividing by $n=6$ gives 0.002181. Dividing by $n-1=5$ gives 0.002617. The uncorrected estimate is about 17% lower. With only 6 folds, that is a meaningful underestimate of the model's true variance.

The Degrees of Freedom Explanation

There is a second, equivalent way to understand $n-1$: degrees of freedom.

You have $n=6$ data points. Once you have computed the sample mean $\bar{x}$, a constraint is imposed on your data:

${\sum }_{i=1}^n(x_i-\bar{x})=0$

This is always exactly zero — the deviations above the mean and below the mean cancel out perfectly. This means: if you know the mean and any five of the six deviations, the sixth deviation is completely determined. You have no freedom to choose it.

So out of six deviations, only five are "free to vary" independently. You are dividing by the number of independent pieces of information — which is $n-1=5$, not $n=6$.

More formally: degrees of freedom is the number of independent pieces of information available after estimating a parameter. Estimating variance required first estimating the mean — that consumed one degree of freedom, leaving $n-1$ for variance estimation.

The Math: Why n-1 Gives an Unbiased Estimate

The expected value of the sample variance with denominator $n-1$ equals the population variance:

$E\left[\frac{\sum (x_i-\bar{x}{)}^2}{n-1}\right]={\sigma }^2$

With denominator $n$ instead:

$E\left[\frac{\sum (x_i-\bar{x}{)}^2}{n}\right]=\frac{n-1}{n}{\sigma }^2$

The factor $\frac{n-1}{n}$ is always less than 1. Dividing by $n$ gives you $(n-1)/n$ of the true variance — always an underestimate.

Does This Actually Matter in Practice?

For our 6-fold CV scenario:

$\frac{n-1}{n}=\frac{5}{6}=0.833$

So dividing by $n$ gives you only 83% of the true variance — an 17% underestimate. The uncorrected standard deviation would be $\sqrt{0.002181}\approx 0.047$ instead of $\sqrt{0.002617}\approx 0.051$.

With large CV fold counts, the correction barely matters. With 5–10 folds — which is typical — it matters enough to report.

Python Demonstration

import numpy as np

accuracy = np.array([0.82, 0.79, 0.91, 0.85, 0.78, 0.88])

var_n = np.var(accuracy, ddof=0)
var_n1 = np.var(accuracy, ddof=1)
std_n = np.std(accuracy, ddof=0)
std_n1 = np.std(accuracy, ddof=1)

print(f"Variance (ddof=0, divide by n):   {var_n:.6f}")
print(f"Variance (ddof=1, divide by n-1): {var_n1:.6f}")
print(f"Ratio:                            {var_n / var_n1:.4f}")
print(f"Expected ratio (n-1)/n:           {5/6:.4f}")
print()
print(f"Std dev (ddof=0): {std_n:.4f}")
print(f"Std dev (ddof=1): {std_n1:.4f}")

The ratio of the two variances is exactly $(n-1)/n=5/6=0.8333$. This confirms that dividing by $n$ gives exactly $(n-1)/n$ of the true unbiased estimate, every time.

Calculation Trace

When Dividing by n Is Correct

If you truly have data for the entire population — not a sample — divide by $N$. This is rare in practice. If you have accuracy scores for every possible test-set split you will ever evaluate (not just a sample of folds), those are population values and division by $N$ is correct.

In ML, you are almost always working with samples. Use $n-1$.

Related Concepts

This post explains a correction that appeared in the dispersion post: why np.var(..., ddof=1) is the right call for sample data. The next post on standard deviation builds directly on this: the sample standard deviation is $\sqrt{s^2}$ with $s^2$ computed using $n-1$. From here, degrees of freedom become a concept you will encounter repeatedly — in t-tests (where the t-distribution has $n-1$ degrees of freedom), in chi-squared tests, and in ANOVA. The intuition is always the same: each estimated parameter consumes a degree of freedom.

When This Framework Breaks Down

Bessel's correction gives an unbiased estimate of variance, but "unbiased" does not mean "accurate for small samples." With $n=3$ or $n=4$ CV folds, even the corrected variance estimate is noisy enough to be nearly meaningless. The standard error of the variance estimator itself is large when $n$ is small. With fewer than 10 folds, bootstrap resampling gives a more honest picture of variance uncertainty than the $n-1$ formula alone. Also, Bessel's correction assumes the observations are independent. In repeated cross-validation with overlapping folds, this assumption is violated, and the $n-1$ formula underestimates variance.

Test Your Understanding

1. You have accuracy = [0.82, 0.79, 0.91, 0.85, 0.78, 0.88]. Compute the sample variance manually by dividing the sum of squared deviations by both $n=6$ and $n-1=5$. What is the percentage difference?

2. Why can you not compute a meaningful sample variance from a single observation ($n=1$)? What does the formula $1/(n-1)$ tell you about this case?

3. A colleague argues: "With 100 CV folds, the correction barely matters — 99/100 is nearly 1." They propose using ddof=0 for simplicity. At what sample size does the bias from using $n$ instead of $n-1$ drop below 1%? Is the colleague's argument valid at $n=20$?

4. The sample mean $\bar{x}$ is said to be an "unbiased estimator" of $\mu$. Is the sample standard deviation $s$ an unbiased estimator of $\sigma$? (Hint: taking the square root of an unbiased estimator does not give an unbiased estimator.)

Once this clicks, you might want to explore Standard Deviation — which takes the variance's squared units and turns them back into something interpretable.

Previous: Measure Of Dispersion | Next: Standard Deviation