advancing a conceptual model...EPIS cover.JPG

Advancing a conceptual model of evidence-based practice implementation in public service sectors

This paper proposes the original EPIS framework, a
multi-level, four phase model of implementation process
(i.e., Exploration, Preparation, Implementation,
Sustainment) and outer and inner context factors.

EPIS Systematic review

Moullin, J C, Dickson, K S, Stadnick, N A, Rabin, B A, Aarons, G A (In press) Systematic Review of the Exploration, Preparation, Implementation, Sustainment (EPIS) Framework. Implementation Science.

Effective implementation of evidence-based practices (EBPs) remains a significant challenge. Numerous existing models and frameworks identify key factors and processes to facilitate implementation. However, there is a need to better understand how individual models and frameworks are applied in research projects, how they can support the implementation process, and how they might advance implementation science. This systematic review examines and describes the research application of a widely used implementation framework, the Exploration, Preparation, Implementation, Sustainment (EPIS) framework.

The EPIS Framework has been disseminated, adopted, and used in diverse health, allied health, and social care settings both domestically and abroad. Below on this page are links to some publications that used or cited EPIS, or influenced EPIS development.

Griffith TL, Zammuto RF, Aiman-Smith L: Why new technologies fail: Overcoming the invisibility of implementation. Ind Manage 1999, 41:29-34.

Klein KJ, Knight AP: Innnovation implementation: Overcoming the challenge. Curr Dir Psychol Sci 2005, 14:243-246.

Rizzuto TE, Reeves J: A multidisciplinary meta-analysis of human barriers to technology implementation.Consult Psychol J: Pract Res 2007, 59:226-240.

Moullin JC, Sabater-Hernández D, Fernandez-Llimos F, Benrimoj SI: A systematic review of implementation frameworks of innovations in healthcare and resulting generic implementation framework. Health Research Policy and Systems 2015, 13:16.

Nilsen P: Making sense of implementation theories, models and frameworks. Implement Sci 2015, 10:53.

Tabak RG, Khoong EC, Chambers DA, Brownson RC: Bridging research and practice: Models for dissemination and implementation research. Am J Prev Med 2012, 43:337-350.

Mazzucca S, Tabak RG, Pilar M, Ramsey AT, Baumann AA, Kryzer E, Lewis EM, Padek M, Powell BJ, Brownson RC: Variation in research designs used to test the effectiveness of dissemination and implementation strategies: A review. Frontiers in Public Health 2018, 6.

Aarons GA, Hurlburt M, Horwitz SM: Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Hlth 2011, 38:4-23.

Aarons GA, Ehrhart MG, Farahnak LR, Sklar M: Aligning leadership across systems and organizations to develop a strategic climate for evidence-based practice implementation. Annu Rev Public Health 2014, 35:255-274.

Brownson RC, Colditz GA, Proctor EK: Dissemination and implementation research in health: Translating science to practice. USA: Oxford University Press; 2012.

Chambers DA: Commentary: Increasing the Connectivity Between Implementation Science and Public Health: Advancing Methodology, Evidence Integration, and Sustainability. Annu Rev Public Health 2018, 39:1-4.

Green L, Kreuter M: Health program planning: An educational and ecological approach. Boston: McGraw Hill; 2005.

Aarons GA, Green AE, Palinkas LA, Self-Brown S, Whitaker DJ, Lutzker JR, Silovsky JF, Hecht DB, Chaffin MJ: Dynamic adaptation process to implement an evidence-based child maltreatment intervention. Implement Sci 2012, 7:1-9.

Chambers DA, Glasgow RE, Stange KC: The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci 2013, 8:117.

Stirman SW, Miller CJ, Toder K, Calloway A: Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implement Sci 2013, 8:65.

Klein KJ, Sorra JS: The challenge of innovation implementation. Acad Manage Rev 1996, 21:1055-1080.

Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O, Peacock R: Storylines of research in diffusion of innovation: A meta-narrative approach to systematic review. Social Science & Medicine 2005, 61:417-430.

Aarons GA, Ehrhart MG, Moullin JC, Torres EM, Green AE: Testing the Leadership and Organizational Change for Implementation (LOCI) Intervention in substance abuse treatment: A cluster randomized trial study protocol. Implement Sci 2017, 12:29.

Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS medicine 2009, 6:e1000097.

Leavy B, Kwak L, Hagströmer M, Franzén E: Evaluation and implementation of highly challenging balance training in clinical practice for people with Parkinson’s disease: protocol for the HiBalance effectiveness-implementation trial. BMC Neurology 2017, 17:27.

Peltzer K, Prado G, Horigian V, Weiss S, Cook R, Sifunda S, Jones D: Prevention of mother-to-child transmission (PMTCT) implementation in rural community health centres in Mpumalanga province, South Africa. Journal of Psychology in Africa 2016, 26:415-418.

Patterson TL, Semple SJ, Chavarin CV, Mendoza DV, Santos LE, Chaffin M, Palinkas L, Strathdee SA, Aarons GA: Implementation of an efficacious intervention for high risk women in Mexico: protocol for a multi-site randomized trial with a parallel study of organizational factors. Implement Sci 2012, 7:105.

de Melo MNT, de Sá RMPF, Filho DAM: Sustainability of an innovative school food program: a case study in the northeast of Brazil. SciELO Public Health 2016, 21:1899-1908.

Willging CE, Green AE, Ramos MM: Implementing school nursing strategies to reduce LGBTQ adolescent suicide: a randomized cluster trial study protocol. Implement Sci 2016, 11:145.

Williams JR, Blais MPB, D, Dusablon T, Williams WO, Hennessy KD: Predictors of the decision to adopt motivational interviewing in community health settings. The Journal of Behavioral Health Services & Research2014, 41:294-307.

Skolarus TA, Lehmann T, Tabak RG, Harris J, Lecy J, Sales AE: Assessing citation networks for dissemination and implementation research frameworks. Implement Sci 2017, 12:97.

Shoup JA, Gaglio B, Varda D, Glasgow RE: Network analysis of RE-AIM framework: Chronology of the field and the connectivity of its contributors. Translational Behavioral Medicine 2014, 5:216-232.

Atkins L, Francis J, Islam R, O’Connor D, Patey A, Ivers N, Foy R, Duncan EM, Colquhoun H, Grimshaw JM: A guide to using the Theoretical Domains Framework of behaviour change to investigate implementation problems. Implement Sci 2017, 12:77.

Stetler CB, Damschroder LJ, Helfrich CD, Hagedorn HJ: A guide for applying a revised version of the PARIHS framework for implementation. Implement Sci 2011, 6:99.

Consolidated Framework for Implementation Research (CFIR) []

Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) []

Tricco AC, Ashoor HM, Cardoso R, MacDonald H, Cogo E, Kastner M, McKibbon A, Grimshaw JM, Straus SE: Sustainability of knowledge translation interventions in healthcare decision-making: a scoping review.Implement Sci 2016, 11:55.

Shelton RC, Cooper BR, Stirman SW: The sustainability of evidence-based interventions and practices in public health and health care. Annu Rev Public Health 2018.

Gates LB, Hughes A, Kim DH: Influence of staff attitudes and capacity on the readiness to adopt a career development and employment approach to services in child welfare systems. Journal of Public Child Welfare2015, 9:323-340.

Moore LA, Aarons GA, Davis JH, Novins DK: How do providers serving American Indians and Alaska Natives with substance abuse problems define evidence-based treatment? Psychol Serv 2015, 12:92-100.

Glasgow RE, Vogt T, Boles S: Evaluating the public health impact of health promotion interventions: The RE-AIM framework. Am J Public Health 1999, 89:1322-1327.

Harden SM, Smith ML, Ory MG, Smith-Ray RL, Estabrooks PA, Glasgow RE: RE-AIM in clinical, community, and corporate settings: Perspectives, strategies, and recommendations to enhance public health impact.Frontiers in Public Health 2018, 6:71.

Kirk MA, Kelley C, Yankey N, Birken SA, Abadie B, Damschroder L: A systematic review of the use of the Consolidated Framework for Implementation Research. Implement Sci 2016, 11:72.

Proctor EK, Powell BJ, Baumann AA, Hamilton AM, Santens RL: Writing implementation research grant proposals: Ten key ingredients. Implement Sci 2012, 7:96.

Watson DP, Adams EL, Shue S, Coates H, McGuire A, Chesher J, Jackson J, Omenka OI: Defining the external implementation context: An integrative systematic literature review. BMC Health Services Research 2018, 18:209.

Lewis CC, Stanick CF, Martinez RG, Weiner BJ, Kim M, Barwick M, Comtois KA: The Society for Implementation Research Collaboration Instrument Review Project: A methodology to promote rigorous evaluation.Implement Sci 2015, 10:2.

Rabin BA, Purcell P, Naveed S, P MR, Henton MD, Proctor EK, Brownson RC, Glasgow RE: Advancing the application, quality and harmonization of implementation science measures. Implement Sci 2012, 7:119.

Rabin BA, Lewis CC, Norton WE, Neta G, Chambers D, Tobin JN, Brownson RC, Glasgow RE: Measurement resources for dissemination and implementation research in health. Implement Sci 2016, 11:42.

Lewis CC, Stanick C, Lyon A, Darnell D, Locke J, Puspitasari A, Marriott BR, Dorsey CN, Larson M, Jackson C, et al: Proceedings of the Fourth Biennial Conference of the Society for Implementation Research Collaboration (SIRC) 2017: Implementation mechanisms: What makes implementation work and why? part 1. In Society for Implementation Research Collaboration2018. Implementation Science; 2017

Proceedings from the 10th Annual Conference on the Science of Dissemination and Implementation. In Science of Dissemination and Implementation2018; Arlington, VA, USA. Implementation Science; 2017: 728.

Palinkas LA, Cooper BR: Mixed methods evaluation in dissemination and implementation science. In Dissemination and Implementation Research in Health: Translating Science to Practice. Edited by Brownson RC, Colditz G, Proctor EK. New York: Oxford University Press; 2017

Holtrop JS, Rabin BA, Glasgow RE: Qualitative approaches to use of the RE-AIM framework: Rationale and methods. BMC Health Services Research 2018, 18:177.

Gleacher AA, Olin SS, Nadeem E, Pollock M, Ringle V, Bickman L, Hoagwood K: Implementing a measurement feedback system in community mental health clinics: a case study of multilevel barriers and facilitators.Adm Policy Ment Hlth 2016:1-15.

QUALRIS workgroup: Qualitative research in implementation science. National Cancer Institute; 2017.

Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J: Mixed method designs in implementation research. Adm Policy Ment Hlth 2011, 38:44-53.

Aarons GA, Fettes DL, Sommerfeld DH, Palinkas LA: Mixed methods for implementation research: Application to evidence-based practice implementation and staff turnover in community-based organizations providing child welfare services. Child Maltreatment 2012, 17:67-79.

Wiley T, Belenko S, Knight D, Bartkowski J, Robertson A, Aarons G, Wasserman G, Leukefeld C, DiClemente R, Jones D: Juvenile Justice-Translating Research Interventions for Adolescents in the Legal System (JJ-TRIALS): a multi-site, cooperative implementation science cooperative. Implement Sci 2015, 10:A43.

Stirman SW, Kimberly J, Cook N, Calloway A, Castro F, Charns M: The sustainability of new programs and innovations: A review of the empirical literature and recommendations for future research. Implement Sci2012, 7:17.

Knight DK, Belenko S, Wiley T, Robertson AA, Arrigona N, Dennis M, Bartkowski JP, McReynolds LS, Becan JE, Knudsen HK, et al: Juvenile Justice—Translational Research on Interventions for Adolescents in the Legal System (JJ-TRIALS): a cluster randomized trial targeting system-wide improvement in substance use services. Implement Sci 2016, 11:57.

Mancini JA, Marek LI: Sustaining community-based programs for families: Conceptualization and measurement. Family Relations 2004, 53:339-347.

Caldwell DF, O'Reilly CA, III: The determinants of team-based innovation in organizations: The role of social influence. Small Gr Res 2003, 34:497-517.

Ehrhart MG, Aarons GA, Farahnak LR: Assessing the organizational context for EBP implementation: The development and validity testing of the Implementation Climate Scale (ICS). Implement Sci 2014, 9:157.

Steckler A, Goodman RM, McLeroy KR, Davis S, Koch G: Measuring the diffusion of innovative health promotion programs. Am J Health Promot 1992, 6:214-225.

Patterson MG, West MA, Shackleton VJ, Dawson JF, Lawthom R, Maitlis S, Robinson DL, Wallace AM: Validating the organizational climate measure: Links to managerial practices, productivity and innovation. Journal of Organizational Behavior 2005, 26:379-408.

Glisson C: The organizational context of children's mental health services. Clin Child Fam Psych 2002, 5:233-253.

Lehman WEK, Greener JM, Simpson DD: Assessing organizational readiness for change. J Subst Abuse Treat2002, 22:197-209.

Glisson C, Landsverk J, Schoenwald S, Kelleher K, Hoagwood K, Mayberg S, Green P, Research Network on Youth Mental Health: Assessing the organizational social context (OSC) of mental health services: Implications for research and practice. Adm Policy Ment Hlth 2008, 35:98-113.

Siegel SM, Kaemmerer WF: Measuring the perceived support for innovation in organizations. J Appl Psychol 1978, 63:553-562.

Aarons G: Organizational Climate for Evidence-Based Practice Implementation: Development of a New Scale. Proceedings of the Annual Association for Behavioral and Cognitive Therapies: November 2011; Toronto 2011.

Anderson NR, West MA: Measuring climate for work group innovation: Development and validation of the Team Climate Inventory. Journal of Organizational Behavior 1998, 19:235-258.

Holt DT, Armenakis AA, Feild HS, Harris SG: Readiness for organizational change: The systematic development of a scale. J Appl Behav Sci 2007, 43:232-255.

Aarons GA, Ehrhart MG, Farahnak LR: The Implementation Leadership Scale (ILS): Development of a brief measure of unit level implementation leadership. Implement Sci 2014, 9:157.

Bass BM, Avolio BJ: The multifactor leadership questionnaire. Palo Alto, CA: Consulting Psychologists Press; 1989.

Beidas RS, Barmish AJ, Kendall PC: Training as usual: Can therapist behavior change after reading a manual and attending a brief workshop on cognitive behavioral therapy for youth anxiety? the Behavior Therapist 2009, 32:97-101.

Dimeff LA, Koerner K, Woodcock EA, Beadnell B, Brown MZ, Skutch JM, Paves AP, Bazinet A, Harned MS: Which training method works best? A randomized controlled trial comparing three methods of training clinicians in dialectical behavior therapy skills. Behav Res Ther 2009, 47:921-930.

Weersing VR, Weisz JR, Donenberg GR: Development of the Therapy Procedures Checklist: A therapist-report measure of technique use in child and adolescent treatment. J Clin Child Adolesc 2002, 31:168-180.

McLeod BD, Weisz JR: The Therapy Process Observational Coding System for Child Psychotherapy-Strategies Scale. J Clin Child Adolesc Psychol 2010, 39:436–443.

Boyatzis RE, Goleman D, Rhee KS, Bar-On R, Parker JD: Handbook of Emotional Intelligence. In Clustering competence in emotional intelligence: Insights from the emotional competence inventory. Edited by Bar-On R, Parker JDA. San Francisco: Jossey-Bass; 2000: 343-362.

Aarons GA: Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Ment Health Serv Res 2004, 6:61-74.

Stumpf RE, Higa-McMillan CK, Chorpita BF: Implementation of evidence-based services for youth: Assessing provider knowledge. Behavior modification 2009, 33:48-65.

Funk SG, Champagne MT, Wiese RA, Tornquist EM: Barriers: The barriers to research utilization scale. Appl Nurs Res 1991, 4:39-45.

Schaufeli WB, Leiter MP: Maslach Burnout Inventory–general survey. In The Maslach burnout inventory-test manual. 1996: 19-26.