Evidence and context

A pilot result gives a program designer evidence to consider. Moving into a new setting requires an additional judgement about which parts of that evidence will still apply.

Eva Vivalt's research on generalising impact evaluations finds substantial variation in effects and systematic differences associated with study characteristics. The analysis helps explain why an estimate should travel with information about how and where it was generated. It does not provide a rule that predicts the outcome of every future implementation. Vivalt, Journal of the European Economic Association, 2020

An illustrative scenario is a service model tested by a small team with frequent specialist support. A larger program may use different staffing arrangements or operate in more varied locations. Those differences are questions to investigate, not automatic reasons to abandon expansion.

Implications for research and practice

A successful pilot does not determine the effect of wider implementation. Transportability depends on delivery conditions and the population reached.

Scope and limitations

This is a selective narrative brief based on the linked publications, not a systematic review or a new empirical study. Illustrative scenarios and practice implications are editorial analysis. Findings should be interpreted within the settings, methods and observation periods of their original sources.