Evidence and context

A program archive should have room for a promising approach that did not deliver, an expected result that remained uncertain and a change that the team decided to reverse.

Franco, Malhotra and Simonovits examined 221 social-science experiments and found that strong results were 40 percentage points more likely to be published than null results. Their sample concerned survey experiments with American adults, not international aid programs. It demonstrates a problem of selective visibility in research, rather than an estimate of hidden findings in development work. Science, 2014

The methodological question raised by that study is what a program record chooses to retain. If the archive is built around material suitable for public promotion, it may not serve the same purpose as a record intended to guide future decisions.

An illustrative scenario is a team testing a new recruitment approach and seeing little change. The experience could still help the next team: which group was targeted, what was attempted, how long the test ran and how confidently the result can be interpreted.

An inconclusive observation should also stay inconclusive. It should not be relabelled as proof that the intervention failed merely to produce a neat lesson.

The goal is a history that remains useful when the next decision is difficult. Disappointing and uncertain findings deserve a place in that history.

Implications for research and practice

Null or disappointing findings are part of an informative evidence base. Publication bias in research is not a direct estimate of missing program reports.

Scope and limitations

This is a selective narrative brief based on the linked publications, not a systematic review or a new empirical study. Illustrative scenarios and practice implications are editorial analysis. Findings should be interpreted within the settings, methods and observation periods of their original sources.