Benford's law
A Socratic walk-through of Benford's law — reasoned out one step at a time, not lectured.
The question we started with
THE QUESTION #Why do the leading digits of real-world numbers favour 1 far more often than 9?
Take a large pile of real numbers — river lengths, town populations, invoice totals, the market capitalisations on an exchange — and look only at the first digit of each. The obvious expectation is that each of the nine digits turns up about a ninth of the time, near 11%. What you actually find is that 1 leads about 30% of the time and 9 leads under 5%. The first instinct is that some particular quirk of rivers or invoices is responsible. But it happens across unrelated domains at once, which rules that out. So what property do they share?
Reasoning it through
REASONING #Notice something suspicious about the digit 1: it is not a category, it is an interval. A number leads with 1 when it lies between 1 and 2, or 10 and 20, or 100 and 200. It leads with 9 only between 9 and 10, or 90 and 100. On an ordinary ruler those intervals are the same width. On a logarithmic ruler they are not: the stretch from 1 to 2 occupies log₁₀2 ≈ 0.301 of the decade, while 9 to 10 occupies log₁₀(10/9) ≈ 0.046. The digit 1 owns nearly a third of the decade and 9 owns about a twentieth.
So if the numbers were spread evenly along a logarithmic ruler, the leading-digit frequencies would just be those interval widths: P(d) = log₁₀(1 + 1/d). That gives 30.1% for 1, 17.6% for 2, 12.5% for 3, and on down to 4.6% for 9. Those are the observed figures.
Which turns the question into a better one. Why would real numbers be spread evenly in the logarithm?
Here is the argument that convinces me. Ask what unit the numbers are in. River lengths could be in kilometres or miles; invoices in dollars or yen; populations are unitless but could be counted in thousands. Changing the unit multiplies every value by a constant. If there is any universal first-digit law — one that does not depend on which arbitrary unit a clerk happened to use — it must survive being multiplied by a constant. Pinkham showed in 1961 that only one distribution over leading digits has that property, and it is the logarithmic one. Scale invariance is the deep reason; the log ruler is what scale invariance looks like.
There is a second route that reaches the same place. Consider what multiplication does. A quantity that grows by percentages — compound interest, populations, prices — takes equal steps in the logarithm, not in the value itself. It lingers at 1,000 for as long as it takes to reach 2,000, but races from 9,000 to 10,000 in a fraction of that. Anything driven by proportional growth spends most of its life with a small leading digit. Powers of 2 and the Fibonacci numbers follow the law essentially exactly, for precisely this reason.
Both routes need the same precondition, and it is the one that decides whether the law applies at all: the data must span several orders of magnitude. If your numbers run from 1 to 100,000, there are decades for the log-uniformity to average over. If they run from 60 to 75, there is nothing to average, and the digits will be whatever that narrow band dictates.
The analogy
THE ANALOGY #Think of the pages of a well-used book of logarithm tables — which is exactly how Simon Newcomb noticed the pattern in 1881. The early pages, for numbers beginning with 1, were far grubbier than the later ones. He inferred that people look up such numbers more often, and worked out the logarithmic frequencies from that. The book is a ruler on which each digit occupies a different width of shelf, and the wear marks measure the width.
Wear on the pages records how often people consulted a number, which mixes the underlying distribution with human interest in it — and the law is a statement about the numbers themselves, not about attention paid to them.
Clarifying the model
THE MODEL #The single most important correction is that Benford's law is not a law about numbers in general. It is a law about a particular kind of collection, and stating the conditions matters more than stating the formula.
It fails, entirely correctly, for bounded data: adult heights in centimetres cluster in the 150-190 band, so 1 leads almost always — not Benford, just narrow. It fails for assigned identifiers: phone numbers, postcodes and account numbers were allocated by a scheme, not generated by a process, and their digits reflect the scheme. It fails for anything with a floor and ceiling imposed by convention, and for genuinely uniform draws such as lottery numbers.
The forensic use follows from the same conditions, and so do its limits. Mark Nigrini's work made digit tests a standard auditing tool, since a person inventing plausible-looking figures tends to spread first digits far too evenly. But a deviation from Benford is not evidence of fraud. Legitimate data deviates whenever it is bounded, truncated, rounded, subject to price points ending in 99, capped by an approval threshold, or simply too narrow in range — and with enough records, a chi-squared test will find a statistically significant deviation in almost any real dataset, because no real dataset is exactly log-uniform. False positives are the normal case, not the exception. The test is a flag for where to look, never a finding in itself, and its confident use in public arguments about election returns has generally been an abuse of it.
A picture of it
THE PICTURE #How to readEach wedge is one possible leading digit, sized by how often it should appear in data that spans several orders of magnitude — the percentages are log₁₀(1 + 1/d), not measurements from any one dataset. Compare the first wedge with the last: 1 is expected roughly six and a half times as often as 9. If the digits were equally likely, all nine wedges would be identical at 11.1%, and the visible taper is exactly the departure the law describes.
What became clearer
WHAT CLEARED #The first digit is not a label but a slice of the number line, and on a logarithmic scale those slices are wildly unequal. Any collection of numbers spread over several decades — especially one produced by proportional growth — lands roughly uniformly on that scale, and inherits the slice widths as digit frequencies. Scale invariance is the reason it can be a law at all rather than a coincidence of one dataset. And the conditions are not fine print: they are what tells you whether the law applies here, and whether a deviation means anything.
Where to go next
ONWARD #- Why Hill's 1995 result — drawing distributions at random from random distributions — converges on the same law.
- How second-digit and last-two-digit tests are used in auditing, and what each is sensitive to.
Key terms
TERMS #| Term | What it means |
|---|---|
| Leading digit | the first non-zero digit of a number, independent of its magnitude or decimal point. |
| Scale invariance | the property of being unchanged when every value is multiplied by a constant, as happens on a change of units. |
| Mantissa | the fractional part of a number's base-10 logarithm; Benford's law is the claim that it is roughly uniform. |
| Digit test | an audit comparing observed leading-digit frequencies against the Benford distribution to flag data worth inspecting. |
Every term the collection defines is gathered in the glossary.