Topics / Chapter 1

Why does statistics exist?

To understand what the numbers in front of us represent and how sure we can be about them.

You can’t weigh every ear in the field

You want to know the thousand-kernel weight of a wheat variety. Weighing all the millions of ears in the field is impossible. Instead you take a few hundred ears at random, weigh them, and generalize the result to the whole field.

All of statistics comes down to these two steps:

  1. Understanding the data you have: organizing, summarizing and plotting the hundreds of numbers you measured. This is descriptive statistics, covered in Chapters 2 and 3.
  2. Generalizing from your data to the whole: answering “The sample mean came out at 42 g, so what is the true mean of the field, and how sure am I?” This is inferential statistics. Hypothesis tests, confidence intervals and analysis of variance all belong here.

Population, sample and the numbers calculated from them

To avoid mixing up what each number stands for, you need this distinction:

What does it cover?What is a number calculated from it called?Notation
PopulationEvery individual you are interested in (all the ears in the field)ParameterMean μ\mu, standard deviation σ\sigma
SampleThe part of the population you actually select and measure (300 ears)Statistic (estimator)Mean xˉ\bar{x}, standard deviation ss

The parameter is almost never known; what we have is always a sample. The xˉ\bar{x} calculated from the sample is an estimate of the unknown μ\mu. Given as a single number it is a point estimate (“the mean is 42 g”); given as a range it is an interval estimate (“the mean is very probably between 40 and 44 g”).

Who is who in an experiment?

Imagine you set up a fertilizer trial: four nitrogen rates, each on three plots.

TermIn this trial
TreatmentWhat you are testing: the nitrogen rates
Independent variableThe variable you control: nitrogen rate
Dependent variableThe variable whose response you measure: yield (kg/da)
Experimental unitThe smallest unit a treatment is applied to: a single plot

This distinction decides which test you will choose later. “Does nitrogen rate affect yield?” asks about the effect of the independent variable on the dependent variable.

The type of data decides which calculations make sense

Not every number can be treated the same way. If you coded variety names as 1, 2, 3, saying “the average variety is 2.4” is meaningless. The scale on which you collected the data limits which statistics you can use:

ScaleWhat can you do?ExampleUsable measures
NominalOnly “same / different”Variety name, soil type, diseased yes/noFrequency, mode
OrdinalYou can rank, but the gaps are not equalDisease severity scale (0–5), quality grade+ Median, quartiles
IntervalDifferences are meaningful but zero is arbitraryTemperature (°C)+ Mean, standard deviation
RatioZero really means “none”; multiples are meaningfulYield, plant height, kernel count+ Coefficient of variation, geometric mean

Note that 20 °C is not “twice as hot” as 10 °C: the zero point was chosen arbitrarily. With yield, however, 600 kg/da really is twice 300 kg/da.

There is also the distinction between discrete and continuous data. Data obtained by counting is discrete (kernels per ear: 31, 32, 33…). Data obtained by measuring or weighing is continuous (a plant can be 74.3 cm tall). This decides which chart you draw and which distribution you use.

Count or ratio?

Perhaps the most practical part of statistical literacy is noticing when a number you are shown is misleading.

Suppose four universities had these pass rates in an exam:

UniversitySat the examPassedPass rate
A604575%
B554785%
C624674%
D22100%

University D looks like the winner at 100%, but only 2 people sat the exam. Had one more person sat and failed, the rate would drop to 67%. Rates calculated from small samples are very unstable. The reverse also holds: someone who looks only at the “number who passed” may think the school with the most students is the most successful. Don’t decide without seeing the raw count and the rate together.

In the field: when a leaflet says “90% of farmers who used this product were satisfied”, the first thing to ask is how many farmers were asked. 9 out of 10 is not as reliable as 900 out of 1000.