Paper: Evidence based surgery - don't show this to the patients!

I stopped to read a summary of this paper, mainly because I was struck by the thought that surgery may not be evidence-based... The best bit about this paper, for me, is that the authors have described the elephant in the room (or should that be in the operating theatre). Well done to them.

World J Surg. 2012 Aug;36(8):1723-31.
Evidence-based surgery: barriers, solutions, and the role of evidence synthesis.
Garas G, Ibrahim A, Ashrafian H, Ahmed K, Patel V, Okabayashi K, Skapinakis P, Darzi A, Athanasiou T.

No benefits from spread, scaling up unless the baseline is poor?

I've been going on about the issue of top-down spread / scaling up initiatives which overstate the benefits. For example, if the pilot projects gets a 50% improvement, then that is, of course, relevant to their baseline. And we can only translate this benefit across a system f we know the baseline of all the individual potential beneficiaries. The worse we can do is take a national average and then assume everyone can get the same 50% improvement that the pilot site obtained.

I've written about this in "Undressing the Elephant: Why good practice doesn't spread in healthcare" and it's great to see a systematic review based around diabetes care that supports the notion that "interventions solely targeted at healthcare professionals seem to be beneficial only is baseline HbA(1c) control is poor". [This research and paper was funded by Ontario Ministry for Health]

Lancet. 2012 Jun 16;379(9833):2252-61. Epub 2012 Jun 9
Effectiveness of quality improvement strategies on the management of diabetes: a systematic review and meta-analysis.
Tricco AC, Ivers NM, Grimshaw JM, Moher D, Turner L, Galipeau J, Halperin I, Vachon B, Ramsay T, Manns B, Tonelli M, Shojania K.

Sustainabilty of QI results; we're not sure how to make it happen

I love systematic reviews. Someone else does the hard work of synthesising the literature and pointing out the strengths and weaknesses.

If you come across anyone purporting to tell you how you can sustain the results of your improvement work, then send them this paper.  Basically, we're not sure how sustainability happens other than it is a complex matter, and not one for a checklist or one day seminar. What I like about this systematic review is it points out the complexity, the system dynamics issues and the need for published work to identify the contextual factors in the sustainability (or not) or results.

Excellent work here by the authors.
Thank you.


Implement Sci. 2012 Mar 14;7(1):17. [Epub ahead of print]
The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research.
Wiltsey Stirman S, Kimberly J, Cook N, Calloway A, Castro F, Charns M.




Partial Abstract

"RESULTS:
Although "sustainability" was the term most commonly used in the literature to refer to what happened after initial implementation, not all the studies that were reviewed actually presented working definitions of the term. Most study designs were retrospective and naturalistic. Approximately half of the studies relied on self-reports to assess sustainability or elements that influence sustainability. Approximately half employed quantitative methodologies, and the remainder employed qualitative or mixed methodologies. Few studies that investigated sustainability outcomes employed rigorous methods of evaluation (e.g., objective evaluation, judgement of implementation quality or fidelity). Among those that did, a small number reported full sustainment or high fidelity. Very little research has examined the extent, nature, or impact of adaptations to the interventions or programs once implemented. Influences on sustainability included organizational context, capacity, processes, and factors related to the new program or practice themselves.
CONCLUSIONS:
Clearer definitions and research that is guided by the conceptual literature on sustainability are critical to the development of the research in the area. Further efforts to characterize the phenomenon and the factors that influence it will enhance the quality of future research. Careful consideration must also be given to interactions among influences at multiple levels, as well as issues such as fidelity, modification, and changes in implementation over time. While prospective and experimental designs are needed, there is also an important role for qualitative research in efforts to understand the phenomenon, refine hypotheses, and develop strategies to promote sustainment."

How does organisational context impact spread and adoption

Those who know me, know I am critical of the continued use of Roger's Diffusion Curve as a means of telling people how and how to plan for the spread and adoption of good practice. If you read Roger's work in depth you will understand its limitations.

One of these is the lack of attention to context. It's fairly obvious to anyone involved in spread and adoption of good practice that leadership, organisational culture and readiness to change etc. are all important in the process. The problem is, although many models and frameworks are drawn up to show how context is important - which is an excellent first step - there is a shortage of published work on the topic.

A key problem is that those who publish ignore the contextual factors.  A recent review paper by Emmens, Weiner & Fernandez looks at this issue.


Health Educ Behav. 2012 Feb;39(1):87-105. Epub 2011 Jul 1.
Systems antecedents for dissemination and implementation: a review and analysis of measures 

Systematic Review of Communities of Practice in Healthcare

I love systematic reviews. They are hard work, major undertakings and make life much easier for the rest of us. Compliments to the authors of this new paper which can be accessed online.



How and why are communities of practice established in the healthcare sector?
A systematic review of the literature.

Geetha Ranmuthugala, Jennifer J Plumb, Frances C Cunningham, Andrew
Georgiou, Johanna I Westbrook, Jeffrey Braithwaite

Australian Institute of Health Innovation, University of New South Wales, Sydney,
NSW 2052, Australia.