Exposure-Driven Residual Disclosure
Repeated exposure to a domain accumulates prediction residuals until their systematic structure becomes observable. Noise averages out; bias does not.

Repeated exposure to a domain accumulates prediction residuals until their systematic structure becomes observable. Noise averages out; bias does not.

Expose yourself to the problem until the deltas of the system output stop averaging out and become impossible to ignore. Then, once each systematic delta is isolated, fix them in Greediest Pareto order: each step takes the fix with the highest marginal (submodular) contribution, the largest net-new reduction in systematic residual per unit of effort given the fixes already made, until only irreducible noise remains in the residuals.
Exposure-driven residual disclosure (EDRD) is the process by which repeated contact with a domain makes a model’s systematic misfit visible.
Line: Substrate-agnostic, repetition-accumulated visibility gain of systematic over stochastic prediction residuals under sustained, outcome-coupled domain exposure.
Sentence form: A process, common to human minds and artificial predictive models, in which repeated exposure to a domain accumulates prediction residuals until their systematic structure becomes observable. It exposes where the model’s priors fit, where they err randomly (variance, which averages out), and where they err systematically (bias, which accumulates), whether across the whole domain or only within a recurring sub-context.
EDRD is independent of whether the model then updates. It differs from learning, which changes the model, and from evaluation, which measures it once.
The number of exposures needed before a bias becomes visible grows with noise and shrinks with the square of the bias.
For Gaussian residuals this is the minimum evidence any detector needs: is inversely proportional to the KL divergence between biased and unbiased residuals, which is . Halving the bias quadruples the exposure needed; a bias active in 10% of cases takes ten times longer to surface.
Repetition discloses bias only under three conditions; outside them, exposure accumulates without revealing anything.
The mechanism has precedents in every field below, ranked from closest to most distant conceptual match. EDRD’s own contribution is the framing: exposure itself as the disclosure instrument, disclosure decoupled from update, and one category for minds and AI models.
Yu, A. J., & Dayan, P. (2005). Uncertainty, neuromodulation, and attention. Neuron, 46(4), 681–692. doi:10.1016/j.neuron.2005.04.026. ↩
Page, E. S. (1954). Continuous inspection schemes. Biometrika, 41(1–2), 100–115. doi:10.1093/biomet/41.1-2.100. ↩
Wald, A. (1945). Sequential tests of statistical hypotheses. The Annals of Mathematical Statistics, 16(2), 117–186. doi:10.1214/aoms/1177731118. ↩
Wei, K., & Körding, K. (2009). Relevance of error: what drives motor adaptation? Journal of Neurophysiology, 101(2), 655–664. doi:10.1152/jn.90545.2008. ↩
| Term | Meaning in this document |
|---|
| Model | Any system that predicts outcomes from priors: a human mind or an AI model, treated as one behavioral category |
| Exposure | One cycle of predicting, acting, and receiving an outcome in a domain, where the outcome arrives soon and clearly enough to be paired with the prediction that produced it |
| Residual | The gap between the observed outcome and the model’s prediction |
| Disclosure | The point at which accumulated residuals cross an observer’s detection threshold (), making their structure observable. The observer can be the model itself (metacognition) or an external one; each has its own and , hence its own |
| Symbol | Meaning |
|---|
| Size of the systematic error | |
| Noise in each residual | |
| Fraction of exposures where the bias is active (1 when it is global) | |
| The observer’s confidence threshold |
| Field | Work | What it shares with EDRD |
|---|
| Mathematics | Doob decomposition (martingale theory) | Any accumulated residual stream splits uniquely into a martingale (unpredictable error) plus a predictable drift (bias): the fit / random error / bias split, stated as a theorem |
| Neuroscience | Yu & Dayan (2005), expected vs unexpected uncertainty1 | The random error vs bias split, with distinct neuromodulators (acetylcholine, norepinephrine) signaling each |
| Statistics | Page’s CUSUM (1954); Wald’s SPRT23 | Their detection delay is |
| Physics | Metrology: systematic vs random error | Only the random part shrinks as |
| Physics | Le Verrier and Uranus; Mercury’s perihelion | Persistent orbital residuals disclosed Neptune and, after the “Vulcan” non-update, general relativity |
| Neuroscience | Wei & Körding (2009), relevance of error4 | The motor system judges whether an error is relevant before adapting: the “bias > noise?” check |
| Philosophy of science | Kuhn, anomaly accumulation5 | EDRD at the scale of a scientific community |
| Mathematics | Chernoff–Stein lemma; Cramér large deviations | Error probability in telling biased from unbiased decays as exp(−n · KL): the information-theoretic floor behind n* ∝ 1/KL |
| Mathematics | Law of large numbers; central limit theorem | The formal reason noise averages out (mean of n residuals shrinks its noise as σ/√n) while a constant bias b survives intact |
| Computer science | Domino (Eyuboglu et al., ICLR 2022)6 | Finds systematic errors on data slices: conditional bias (p < 1) |
| Expertise | Hogarth, kind vs wicked environments; Kahneman & Klein (2009)78 | Expertise forms only where feedback is regular: the feedback fidelity condition |
| Neuroscience | Burge, Ernst & Banks (2008)9 | Adaptation rate set by a Kalman-style ratio of noise to drift: the update vs disclosure trade-off |
| Mathematics | Birkhoff ergodic theorem | Time averages along one trajectory converge to the space average: sustained exposure to one domain recovers its true statistics, so residual structure becomes visible from experience alone |
| Neuroscience | Rao & Ballard (1999); Feldman & Friston (2010)1011 | Prediction errors weighted by their precision |
| Organizations | Argyris, single vs double-loop learning12 | “Update priors (or not)” |
| Computer science | Gradient boosting (Friedman 2001)13 | Each new component is fit to the current residuals: “fix the largest delta, repeat” |
| Mathematics | Submodular maximization (Nemhauser, Wolsey & Fisher 1978)14 | Picking the next fix by highest marginal contribution is within (1 − 1/e) ≈ 63% of optimal: the guarantee behind Greediest Pareto order |
Kuhn, T. S. (1962). The Structure of Scientific Revolutions. University of Chicago Press. ↩
Eyuboglu, S., Varma, M., Saab, K., Delbrouck, J.-B., Lee-Messer, C., Dunnmon, J., Zou, J., & Ré, C. (2022). Domino: Discovering systematic errors with cross-modal embeddings. International Conference on Learning Representations (ICLR). arXiv:2203.14960. ↩
Hogarth, R. M. (2001). Educating Intuition. University of Chicago Press. ↩
Kahneman, D., & Klein, G. (2009). Conditions for intuitive expertise: a failure to disagree. American Psychologist, 64(6), 515–526. doi:10.1037/a0016755. ↩
Burge, J., Ernst, M. O., & Banks, M. S. (2008). The statistical determinants of adaptation rate in human reaching. Journal of Vision, 8(4), 20. doi:10.1167/8.4.20. ↩
Rao, R. P. N., & Ballard, D. H. (1999). Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience, 2(1), 79–87. doi:10.1038/4580. ↩
Feldman, H., & Friston, K. J. (2010). Attention, uncertainty, and free-energy. Frontiers in Human Neuroscience, 4, 215. doi:10.3389/fnhum.2010.00215. ↩
Argyris, C. (1977). Double loop learning in organizations. Harvard Business Review, 55(5), 115–125. ↩
Friedman, J. H. (2001). Greedy function approximation: a gradient boosting machine. The Annals of Statistics, 29(5), 1189–1232. doi:10.1214/aos/1013203451. ↩
Nemhauser, G. L., Wolsey, L. A., & Fisher, M. L. (1978). An analysis of approximations for maximizing submodular set functions—I. Mathematical Programming, 14(1), 265–294. doi:10.1007/BF01588971. ↩