Chen, Y-F.‏‎, Hemming, Karla, Stevens, Andrew J. and Lilford, Richard (2016) Secular trends and evaluation of complex interventions : the rising tide phenomenon. BMJ Quality & Safety, 25 (5). pp. 303-310. doi:10.1136/bmjqs-2015-004372 ISSN 2044-5415.

Research output not available from this repository.

Request-a-Copy directly from author or use local Library Get it For Me service.

Request Changes to record.

Abstract

Evaluations of service delivery interventions with contemporaneous controls often yield null results, even when the intervention appeared promising in advance. There can be many reasons for null results. In this paper we introduce the concept of a ‘rising tide’ phenomenon being a possible explanation of null results. We note that evaluations of service delivery interventions often occur when awareness of the problems they intend to address is already heightened, and pressure to tackle them is mounting throughout a health system. An evaluation may therefore take place in a setting where the system as a whole is improving – where there is a pronounced temporal trend or a ‘rising tide causing all vessels to rise’. As a consequence, control sites in an intervention study will improve. This reduces the difference between intervention and control sites and predisposes the study to a null result, leading to the conclusion that the intervention has no effect. We discuss how a rising tide may be distinguished from other causes of improvement in both control and intervention groups, and give examples where the rising tide provides a convincing explanation of such a finding. We offer recommendations for interpretation of research findings where improvements in the intervention group are matched by improvements in the control group. Understanding the rising tide phenomenon is important for a more nuanced interpretation of null results arising in the context of system-wide improvement. Recognition that a rising tide may have predisposed to a null result in one health system cautions against generalising the result to another health system where strong secular trends are absent.

Item Type:	Journal Article
Divisions:	Faculty of Science, Engineering and Medicine > Medicine > Warwick Medical School > Health Sciences > Population, Evidence & Technologies (PET) Faculty of Science, Engineering and Medicine > Medicine > Warwick Medical School
Journal or Publication Title:	BMJ Quality & Safety
Publisher:	BMJ Publishing Group Ltd.
ISSN:	2044-5415
Official Date:	May 2016
Dates:	Date Event May 2016 Published 6 September 2015 Available 13 August 2015 Accepted 7 May 2015 Submitted
Volume:	25
Number:	5
Page Range:	pp. 303-310
DOI:	10.1136/bmjqs-2015-004372
Status:	Peer Reviewed
Publication Status:	Published
Access rights to Published version:	Open Access (Creative Commons)

Request changes or add full text files to a record

Repository staff actions (login required)

View Item