Synopsis.
Name
The Bigger Picture. Look at the whole and the answer is plain: the new treatment does worse than the old, the university admits women at a lower rate than men, the one team's batting is lower across the season, the number built from all the data says so, and there is a lot of data, and the big number feels like the truth precisely because it is big. But split the same data into its groups and every group says the opposite: the new treatment does better on the small stones and better on the large stones, the university admits women at an equal or higher rate in almost every single department, the one team's batting is higher in this year and higher in that year. Both are true. The whole says one thing and each part says the other, from the very same rows, and neither is a mistake. What has happened is that something lurking underneath sorted the cases unevenly into the groups: the hard cases went mostly to the new treatment, the women mostly applied to the departments that admit few of anyone, the seasons the one team batted little were the seasons everyone batted well, so the groups are not alike, and pooling them mixes unlike things with unlike weights, and the mixture reverses the trend. And here is the part with no way out on the page: you cannot tell from the numbers which level to believe. The aggregate is right if the grouping is a mere accident, and the split is right if the grouping is the thing that does the causing, and the data alone does not know which, because the data cannot say what caused what. So a careful person, trusting the big honest number, steps back to see the bigger picture and acts on it, and acts against everything every subgroup shows, and is wrong, or right, and cannot tell which from the table no matter how long they stare, because the answer was never in the table. It was in the cause, and the cause is the one thing the counting left out.
Arc
The bend is this: a trend can hold in every subgroup and reverse in the pooled whole, because a lurking variable sorts the cases unevenly across the groups, so the same data supports opposite conclusions at different levels, and which one should guide action turns on the causal structure, which the numbers do not carry. It runs on a confounder unevenly spread. Two variables can be associated one way inside each subgroup and the opposite way once the subgroups are combined, whenever a third variable, correlated with both the grouping and the outcome, is distributed unevenly across the groups (Simpson; Yule). The subgroups are not alike: the lurking variable has loaded them differently, so pooling them averages unlike things with unlike weights, and the weighting alone can flip the direction of the trend. And both readings are correct. The aggregate trend is a true summary of the pooled data, and the subgroup trends are true summaries of the parts, from the identical rows, so neither is an error and neither is a lie: the reversal is not a miscount but a genuine feature of an unevenly confounded table (Blyth). The same honest numbers, read at two levels, say two opposite things, and both are right about the level they describe. And the numbers cannot adjudicate. Whether to trust the whole or the parts depends on what caused the uneven sorting: if the grouping is incidental, the aggregate is the right guide, and if the grouping is on the causal path, the strata are, and no amount of the data itself can tell which, because a table records association and the choice turns on causation, which a table does not hold (Pearl). The decision needs a causal model the counting never supplied. And the bigger the picture, the more it persuades. The aggregate is built from all the data and carries the authority of the larger number, so stepping back to the whole feels like rising above the noise to the truth, and it is exactly this feeling, that more data pooled is a clearer view, that leads a careful person to trust the total and act against every subgroup, confidently and wrongly, or confidently and rightly, with no way on the page to know. None of it is error or deceit. The pooled number is honestly computed, the subgroup numbers are honestly computed, trusting the larger sample is a sound instinct, and acting on the clearest summary is what any careful analyst does: no one fudges a figure, and the reversal emerges from the sum of correct counts read at a level the data cannot license. Draw the causal structure, decide which variable is a confounder to adjust away and which is a mediator to leave alone, and the right level can be chosen and the decision made well: but the causal structure is an assumption brought from outside, not a fact read from the table, so it cannot be proven by the data it is meant to interpret, and the wrong causal model adjusts the wrong way and reverses the reversal with equal confidence, so the escape is bought by committing to a cause the numbers can neither supply nor confirm, staking the answer on a judgement the data will never settle.
Stakes
Whether the same honest data can be made to give one answer, when it gives two and cannot say which is right. Every plot but the last moves the same way: toward the aggregate, which each analyst is right to compute and trust for its size, and away from the strata, which are equally right and point the other way, and neither level can be faulted because both are true of what they summarise. The production cannot make the numbers choose, because the reversal is a real feature of an unevenly confounded table and the choice of level turns on causation, which the table does not record, so trusting the bigger picture is the sound instinct working on what it can see, not a blunder. It can only show that no one miscounts or lies, that the pooled number and the subgroup numbers are both honest and both correct, and that the one move that decides the matter, drawing the causal structure to pick the level, must be made by bringing in an assumption the data can neither supply nor confirm, and staking the answer on a cause that the wrong guess reverses with equal confidence, so both readings are true and the decision is real and the thing that would settle it is the one thing the counting left out.
Estate
khai-misfits: the house that holds this production and answers for the whole run.