During World War II, fighter planes would come back from battle with bullet holes. The Allies found the areas that were most commonly hit by enemy fire. They sought to strengthen the most commonly damaged parts of the planes to reduce the number that was shot down.
A mathematician, Abraham Wald, pointed out that perhaps there was another way to look at the data. Perhaps the reason certain areas of the planes weren’t covered in bullet holes was that planes that were shot in those areas did not return. This insight led to the armor being re-enforced on the parts of the plane where there were no bullet holes.
The story behind the data is arguably more important than the data itself. Or more precisely, the reason behind why we are missing certain pieces of data may be more meaningful than the data we have.
Wald, Abraham. Archived 2019-07-13 at the Wayback Machine. Center for Naval Analyses.
Wallis, W. Allen (1980). “The Statistical Research Group, 1942-1945: Rejoinder”. Journal of the American Statistical Association.
“Bullet Holes & Bias: The Story of Abraham Wald”. mcdreeamie-musing
“AMS :: Feature Column :: The Legend of Abraham Wald”. American Mathematical Society
‘How Not to Be Wrong’ by Jordan Ellenberg (released in 2014)