The use of the PARIHS framework in implementation research and practice : A citation analysis of the literature

The use of the PARIHS framework in

implementation research and practice

—a

citation analysis of the literature

Anna Bergström

1,2*

, Anna Ehrenberg

3,4

, Ann Catrine Eldh

5,6

, Ian D. Graham

7,8

, Kazuko Gustafsson

3,9

,

Gillian Harvey

4

, Sarah Hunter

10

, Alison Kitson

10,11

, Jo Rycroft-Malone

12

and Lars Wallin

3,13

Abstract

Background: The Promoting Action on Research Implementation in Health Services (PARIHS) framework was

developed two decades ago and conceptualizes successful implementation (SI) as a function (f) of the evidence (E)

nature and type, context (C) quality, and the facilitation (F), [SI = f (E,C,F)]. Despite a growing number of citations of

theoretical frameworks including PARIHS, details of how theoretical frameworks are used remains largely unknown.

This review aimed to enhance the understanding of the breadth and depth of the use of the PARIHS framework.

Methods: This citation analysis commenced from four core articles representing the key stages of the framework

’s

development. The citation search was performed in Web of Science and Scopus. After exclusion, we undertook an

initial assessment aimed to identify articles using PARIHS and not only referencing any of the core articles. To assess

this, all articles were read in full. Further data extraction included capturing information about where (country/

countries and setting/s) PARIHS had been used, as well as categorizing how the framework was applied. Also,

strengths and weaknesses, as well as efforts to validate the framework, were explored in detail.

Results: The citation search yielded 1613 articles. After applying exclusion criteria, 1475 articles were read in full,

and the initial assessment yielded a total of 367 articles reported to have used the PARIHS framework. These articles

were included for data extraction. The framework had been used in a variety of settings and in both high-, middle-,

and low-income countries. With regard to types of use, 32% used PARIHS in planning and delivering an

intervention, 50% in data analysis, 55% in the evaluation of study findings, and/or 37% in any other way. Further

analysis showed that its actual application was frequently partial and generally not well elaborated.

Conclusions: In line with previous citation analysis of the use of theoretical frameworks in implementation science,

we also found a rather superficial description of the use of PARIHS. Thus, we propose the development and

adoption of reporting guidelines on how framework(s) are used in implementation studies, with the expectation

that this will enhance the maturity of implementation science.

Keywords: Citation analysis, PARIHS framework, Implementation science, Knowledge translation

© The Author(s). 2020 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain

permission directly from the copyright holder. To view a copy of this licence, visithttp://creativecommons.org/licenses/by/4.0/.

The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the

data made available in this article, unless otherwise stated in a credit line to the data. * Correspondence:anna.bergstrom@kbh.uu.se

1_{Department of Women’s and Children’s health, Uppsala Global Health} Research on Implementation and Sustainability (UGHRIS), Uppsala, Sweden 2_{Institute for Global Health, University College London, London, UK} Full list of author information is available at the end of the article

Introduction

There has been an increased use of theoretical

frame-works in the field of implementation science in the last

decade, with most developed in the last two decades [

1

,

2

]. Tabak et al. identified 61 theoretical models used in

dissemination and implementation science [

3

]. However,

while theoretical frameworks are increasingly being

cited, more research is needed to understand how they

are chosen and applied, and how their use relates to

im-proved implementation outcomes [

1

,

4

]. Variously

de-scribed in the form of theories, frameworks, or models,

all strive to provide conceptual clarity on different

as-pects of implementation practice and research. For

consistency, we will refer to these as theoretical

frame-works, or simply

“frameworks.”

The Promoting Action on Research Implementation in

Health Services (PARIHS) framework is a

multi-dimensional framework which was developed to

expli-citly challenge the pipeline conceptualization of

imple-mentation [

5

]. The PARIHS framework is a commonly

used conceptual framework [

1

,

4

] that posits successful

implementation (SI) as a function (f) of the nature and

type of evidence (E) (including research, clinical

experi-ence, patient experiexperi-ence, and local information), the

qualities of the context (C) of implementation (including

culture, leadership, and evaluation), and the way the

im-plementation process is facilitated (F) (internal and/or

external person acting as a facilitator to enable the

process of implementation); SI = f(E,C,F). The

frame-work was informed by Rogers’ Diffusion of Innovations

[

6

] and various organizational theories and theories from

social science [

7

] and generated inductively by working

with clinical staff to help them understand the practical

nature of getting evidence into practice. The PARIHS

framework was initially published in 1998 [

5

] and

up-dated based on a conceptual analysis in 2002 [

8

] and

fur-ther primary research [

9

]. A further refinement was

undertaken in 2015 [

10

], resulting in the integrated or

i-PARIHS. Articles using the revised version are not

PARIHS framework has been described as a determinant

framework in that it specifies determinants that act as

barriers and enablers influencing implementation

out-comes [

2

]. Skolarus et al. [

1

] identified Kitson et al. [

5

]

as one of the two primary originating sources of

influ-ence in their citation analysis of dissemination and

im-plementation frameworks.

Despite the growing number of citations of theoretical

frameworks in scientific articles, the detail of how

frame-works are used remains largely unknown. Systematic

re-views of the application of two other commonly used

frameworks [

1

], the Knowledge to Action framework

[

11

] and the Consolidated Framework for

Implementa-tion Research [

12

], both reported that use of these

frameworks, beyond simply citation, was uncommon.

While PARIHS has been widely cited, it has also been

scrutinized; in 2010, Helfrich et al. published a

qualita-tive critical synthesis of studies that had used the

PAR-IHS framework [

13

], finding six core concept articles

and 18 empirical articles. One of the reported findings

was that PARIHS was generally used as an organizing

framework for analysis. At the time, no studies used

PARIHS prospectively to design implementation

strat-egies [

13

]. A systematic review applying citation analysis

to map the use of PARIHS (similar to those undertaken

for the Knowledge to Action framework (KTA) [

11

] and

the Consolidated Framework for Implementation

Re-search (CFIR) [

12

]) has not yet been performed.

Systematic reviews can contribute to the development

of existing theoretical frameworks by critically reviewing

what authors state as their weaknesses and strengths;

they can also direct future and current users of

frame-works to examples of using the frameframe-works in different

ways. To contribute to this development from the

per-spective of the PARIHS framework, we undertook a

cit-ation analysis of the published peer-reviewed literature

that focused on the reported use of PARIHS (and its

main elements), in what contexts the framework has

been applied, and what scholars who have used the

PARIHS framework (and its main elements) report as its

strengths, limitations, and validity.

Methods

The method used for this study is citation analysis, i.e.,

the examination of the frequency and patterns of

cita-tions in scientific articles, in this case articles citing the

core PARIHS framework publications. A team of

re-searchers with engagement in the development and/or

use of the PARIHS framework was constituted. Initially,

the group decided on the core publications for the

cit-ation analysis. Four articles were selected as they

repre-sented the key stages of the framework’s development,

namely the original paper that described PARIHS, plus

• Describes how a well-established theoretical framework—PAR-IHS—has been operationalized in the scientific literature and provides examples of its use in implementation studies. • The findings underline that descriptions of the use of the framework generally were not that transparent and often partial. • Findings also point at difficulties in using the framework, such as lack of guidance on key steps to overcome barriers and support implementation

• Identifies the need of common guidelines on how theories, models, and frameworks should be reported in research articles.

visions to the framework:

1. Kitson A, Harvey G, McCormack B. Enabling the

implementation of evidence-based practice: a

con-ceptual framework. Qual Health Care.

1998;7(3):149-58.

2. Rycroft-Malone J, Kitson A, Harvey G, McCormack

B, Seers K, Titchen A, et al. Ingredients for change:

revisiting a conceptual framework. BMJ Quality Saf.

2002;11(2):174-80.

3. Rycroft-Malone J, Harvey G, Seers K, Kitson A,

McCormack B, Titchen A. An exploration of the

factors that influence the implementation of evidence

into practice. J Clin Nurs. 2004;13(8):913-24.

4. Kitson AL, Rycroft-Malone J, Harvey G,

McCor-mack B, Seers K, Titchen A. Evaluating the

success-ful implementation of evidence into practice using

the PARiHS framework: theoretical and practical

challenges. Implement Sci. 2008;3:1.

Citation search

Citation searches were performed by an information

specialist (KG) to retrieve published articles citing any of

the four core articles. The searches were performed in

two citation databases: Web of Science and Scopus. The

first searches were performed between 31 March 2016

and 1 April 2016. Later, 6 September 2019, additional

searches were performed in respective databases. These

searches were limited to citations that were published 1

April 2016–31 August 2019 to update the result from

the first searches. All citations that were published

Sep-tember 1998 (i.e., when Kitson et al 1998 was

pub-lished)–31 August 2019 (i.e., prior to the search date) in

respective databases were collected in EndNote Library.

Endnote was used for checking duplicates and retrieving

full texts. To manage the scope of the citation analysis,

we opted to only include articles in English published in

peer-reviewed scientific journals. The searches in Web

of Science were, because of the subscription, limited to

Web of Science Core Collection without Book Citation

Index.

Data extraction

The Preferred Reporting Items for Systematic Reviews

and Meta-Analyses (PRISMA) flow diagram [

14

] for the

data extraction is provided in Fig.

1

. Initially, an

assess-ment to identify the articles that used the PARIHS

framework in any other way than merely referencing

one or more of the core articles was performed

(Add-itional file

1

). For this initial assessment, all articles were

read in full. After identifying articles where the PARIHS

framework was used, data extraction was undertaken

using a tailor-made data capture form (Additional file

1

).

erative cycles by the research team. Apart from

captur-ing information about where (country/countries and

setting/s) and with whom (professional groups and roles)

PARIHS had been applied, the form included questions

on whether PARIHS was used in one or more of the

fol-lowing ways:

1) In planning and delivering an intervention,

2) In data analysis,

3) In the evaluation of study findings, and/or

4) In any other way.

Each of these questions was followed by an

open-ended item for extracting information on how this was

reported [

15

]. To enhance reliability and data richness,

each reviewer copy-pasted sections of the article

corre-sponding to the open-ended reply into the data

extrac-tion form when appropriate and indicated page, column,

and row. Two additional items captured whether the

PARIHS framework had been tested or validated, as well

as any reported strengths and weaknesses of the

frame-work. Thus, we report on what the authors of the

in-cluded articles claim to have done, rather than a

judgment as to how and to what extent they actually

used the PARIHS framework.

For data extraction and validation, the research team

was divided into four pairs, ensuring that each article

was assessed separately by at least two research team

members. The pairs received batches of 20 articles at a

time. Variations in the assessments were discussed until

consensus was reached within the pair(s). Further,

quer-ies detected within the pairs were raised and discussed

with the whole research team, until consensus was

achieved. Regular whole-team online meetings were held

to consolidate findings between every new batch of

arti-cles and throughout the development and analysis

process. In total, the group had > 20 online meetings

and four face-to-face meetings from the initial

establish-ment of the group in January 2015.

Data analysis

Categorical data were analyzed using descriptive

statis-tics, whereas the open-ended items were analyzed

quali-tatively [

16

], including the collated extractions of data to

illustrate each of the four types of use (i.e., how the

PARIHS framework was depicted in terms of (1)

plan-ning and delivering an intervention, (2) analysis, (3)

evaluation of study findings, and/or (4) in any other

way).

Applying a content analysis approach [

17

], members

of the research team worked separately with the texts

extracted from the reviewed articles. The extracts for

each open-ended item were read and reread, to get a

sense of the whole. Next, variations were identified and

formed as categories. Findings for each question were

summarized in short textual descriptions, which were

shared with the whole team. In a face-to-face meeting,

the data relating to each question were critically

dis-cussed and comparisons were made between the

find-ings for each question, to identify overlaps and

relationships about how PARIHS has been used.

Results

After duplicate control, 1613 references remained. These

were sorted by language and type of publication. In this

phase, 131 references categorized as books, book

chap-ters, conference proceedings, and publications written in

non-English language were excluded. Also, three of the

four core articles (i.e., the three citing Kitson et al. [

5

]

which was the starting point for development of the

PARIHS framework and therefore did not appear in the

citation search) were excluded from the database [

8

,

9

,

18

], as were four articles expanding and refining

PAR-IHS [

19

–

22

]. Accordingly, 1475 articles remained, and

after the assessment excluding those merely citing

PAR-IHS, a further 1108 articles were excluded, leaving 367

articles that cited one or more of the core articles, and

made explicit use of the PARIHS framework (see Fig.

1

and Table

1

).

Of these 367 articles, 235 cited Kitson et al. [

5

], 208

cited Kitson et al. [

18

], 136 cited Rycroft-Malone et al.

Fig. 1 Adapted PRISMA flow diagram

Table

1

List

of

articles

for

data

extraction

for

citation

analysis

of

the

use

of

the

PARIHS

framework.

The

table

is

sorted

on

type

of

article,

type

of

use

of

the

PA

RIHS

framework,

author

and

year

of

publication

Autho rs Ref Year of pub l. Fu ll title Count ry(ies ) Se tting PARIH S used: Type of article To pla n/deli ver an interve ntion In the an alysis a In the eva luation o f finding s In any othe r way Chinm an, Dan iels, et al. [ 23 ] 2017 Provi sion of peer spe cialist services in VA pat ient ali gned care te ams: Prot ocol for test ing a cluste r ran domized im plem entat ion tri al USA Pri mary health car e setting ✓✓ ✓ Prot ocol Gordo n, Lee, et al. [ 24 ] 2018 A compl ex culturally targeted interve ntion to reduc e Hispanic dis parities in living kidney donor trans plantation: An effect ivenes s-im plem entation hyb rid study proto col USA Co mmuni ty/ Soc ial care se tting ✓✓ ✓ Prot ocol Roberg e, Fourn ier, et al. [ 25 ] 2013 Im plem enting a know ledge app lication progr am for anxiet y and depression in com munit y-based primary men tal heal th car e: A mu ltiple case study research prot ocol Canad a Pri mary health car e setting ✓✓ ✓ Prot ocol Blan co-Mavillard, Benn asar-Ve ny, et al. [ 26 ] 2018 Im plem entation of a know ledge mob ilizati on mod el to prevent peripheral venou s catheter-re lated adve rse event s: PR EBACP study-a multic enter clus ter-ran domized tri al prot ocol Spain Ho spital se tting ✓✓ Prot ocol Bucknall, Harve y, et al. [ 27 ] 2017 Pri oritizing Respo nses Of Nurses To de teriorating patien t Observations (PRON TO) protocol : Testing the eff ectiven ess of a faci litation interve ntion in a pragmatic, clus ter-ran domized tri al with an embe dded proc ess evaluation and cost an alysis Aus tralia Ho spital se tting ✓✓ Prot ocol Choui nard, Hud on, et al. [ 28 ] 2013 Cas e manage ment an d self-manage ment sup port for frequ ent users with chroni c dis ease in primary care: A pragmatic ran domized cont rolled trial Canad a Pri mary health car e setting ✓✓ Prot ocol Cully, Arment o, et al. [ 29 ] 2012 Bri ef cog nitive be havioral the rapy in primary care: a hybrid type 2 pat ient-ran domized eff ective ness-impleme ntation de sign USA Pri mary health car e setting ✓✓ Prot ocol Gurung , Jha, et al. [ 30 ] 2019 Scal ing U p Safer Birth Bun dle Throu gh Q uality Im provement in Nepal (SUS TAIN) a step ped we dge cluste r rando mized cont rolled trial in public hospitals Nepal Ho spital se tting ✓✓ Prot ocol Owe n, Drum mond , et al. [ 31 ] 2013 Moni tori ng an d managing me tabolic eff ects of antipsychot ics: A cluster random ized trial of an interve ntion com binin g evide nce-USA Mu ltiple se ttings ✓✓ Prot ocol

Table

1

List

of

articles

for

data

extraction

for

citation

analysis

of

the

use

of

the

PARIHS

framework.

The

table

is

sorted

on

type

of

article,

type

of

use

of

the

PA

RIHS

framework,

author

and

year

of

publication

(Co

ntinued)

Autho rs Ref Year of pub l. Fu ll title Count ry(ies ) Se tting PARIH S used: Type of article To pla n/deli ver an interve ntion In the an alysis a In the eva luation o f finding s In any othe r way bas ed quality im provement an d exte rnal faci litation Powell , Kitson , et al. [ 32 ] 2013 A study proto col for app lying the co-creat ing know ledge trans lation framewo rk to a popu lation heal th study Aus tralia Pu blic heal th ✓✓ Prot ocol Rycro ft-Malone , Ande rson, et al. [ 33 ] 2014 Ac cessibility an d im plement ation in UK se rvices of an effect ive depre ssion relaps e pre vention progr am -mindf ulness-based cog nitive the rapy (MBCT ): ASPIR E study prot ocol UK Not rep orted ✓✓ Prot ocol Rycro ft-Malone , Dopson, et al. [ 34 ] 2009 Stud y prot ocol for the trans lating res earch in elde r car e (TREC ): Building contex t throu gh case studies in lon g-term care proje ct (pro ject two) Canad a Co mmuni ty/ Soc ial care se tting ✓✓ Prot ocol Rycro ft-Malone , Wilkinson, et al. [ 35 ] 2011 Im plem enting heal th res earch through aca demi c and cl inical partn erships: A real istic eva luati on of the Coll aborations for Leadership in App lied Hea lth Rese arch an d Care (CLAHR C) UK Mu ltiple se ttings ✓✓ Prot ocol Kilbourne , Alm irall, et al. [ 36 ] 2014 Prot ocol: Adaptive Implem entat ion of Eff ective Prog rams Trial (A DEPT ): Clu ster ran domized SM ART trial comparing a st andard versus enh anced im plem entation st rategy to improve outcom es of a mood dis orders program USA Co mmuni ty/ Soc ial care se tting ✓✓ Prot ocol McGilton, Davis , et al. [ 37 ] 2012 An inpatient rehab ilitation mod el of care targ eting patie nts with cogn itive impairment Canad a Mu ltiple se ttings ✓✓ Prot ocol Botti , Kent, et al. [ 38 ] 2014 Deve lopme nt of a Mana geme nt Alg orithm for Post-op erative Pain (MAP P) afte r tot al kne e and total hip replacement: Stud y ratio nale and design Aus tralia Ho spital se tting ✓ Prot ocol Cad ilhac, Andre w, et al. [ 39 ] 2018 Im proving qua lity and out comes of stroke car e in hospitals: Protoc ol an d statist ical an alysis plan for the Stro ke123 imple menta tion st udy Aus tralia Ho spital se tting ✓ Prot ocol Perez, Ru sso, et al. [ 40 ] 2013 Comp ariso n of high and low intens ity cont act be tween se condary and prim ary car e to d e tect people at ultra-high risk for psycho sis: Study protocol for a the ory-bas ed, cl uster random ized contro lled trial UK Pri mary health car e setting ✓ Prot ocol

Table

1

List

of

articles

for

data

extraction

for

citation

analysis

of

the

use

of

the

PARIHS

framework.

The

table

is

sorted

on

type

of

article,

type

of

use

of

the

PA

RIHS

framework,

author

and

year

of

publication

(Co

ntinued)

Autho rs Ref Year of pub l. Fu ll title Count ry(ies ) Se tting PARIH S used: Type of article To pla n/deli ver an interve ntion In the an alysis a In the eva luation o f finding s In any othe r way Ray-B arruel, Cook e, et al. [ 41 ] 2018 Im plem enting the I-DE CIDED clinical de cision-making tool for peripheral intravenous cath eter ass essment and safe removal: prot ocol for an interru pted ti me-series study Aus tralia Ho spital se tting ✓ Prot ocol Saint, Olm sted, et al. [ 42 ] 2009 Tra nslating heal th car e-assoc iated urin ary tract inf ection prevention research into prac tice via the bla dder bundle USA Ho spital se tting ✓ Prot ocol Samps on, Fe ast, et al. [ 43 ] 2019 Evi dence-based interven tion to reduce avo idable hos pital admissions in care home residents (the Be tter Healt h in Re sidents in Care Ho mes (BHiR CH) study): Protoc ol for a pil ot clus ter ran domized tri al UK Co mmuni ty/ Soc ial care se tting ✓ Prot ocol Seer s, Cox, et al. [ 44 ] 2012 FI RE (fac ilitating im plement ation of res earch evi dence) : A study prot ocol UK, Ireland, Swed en, Nethe rlands Co mmuni ty/ Soc ial care se tting ✓ Prot ocol Sken e, Gerrish, et al. [ 45 ] 2016 Deve loping family-cent ered car e in a neon atal inten sive car e unit: An action research st udy prot ocol UK Ho spital se tting ✓ Prot ocol Wallin, Målqvist, et al. [ 46 ] 2011 Im plem enting know ledge into practic e for im proved neonat al sur vival; A cluster-ran domized , com munit y-based trial in Quang Ninh provi nce, Viet nam Viet nam Co mmuni ty/ Soc ial care se tting ✓ Prot ocol Conk lin, Kothari, et al. [ 47 ] 2011 Kn owledg e-to-ac tion proces ses in SHRT N col laborati ve comm unitie s of prac tice: A study prot ocol Canad a Mu ltiple se ttings ✓✓ Prot ocol Estabro oks, Sq uires, et al. [ 48 ] 2009 Stud y prot ocol for the trans lating res earch in el der care (TREC ): Build ing contex t -An or ganizational monitori ng progr am in long-te rm car e projec t (proje ct one) Canad a Co mmuni ty/ Soc ial care se tting ✓✓ Prot ocol Kitson, Schultz, et al. [ 49 ] 2013 The pre vention and reduction of we ight loss in an acut e tert iary care se tting: Protoc ol for a prag matic step ped we dge random ized clus ter trial (the PR oWL proje ct) Aus tralia Ho spital se tting ✓✓ Prot ocol Noyes , Williams, et al. [ 50 ] 2010 Evi dence into prac tice: Eva luating a child-centred interve ntion for diabetes me dicine managemen t The EP IC Project UK Mu ltiple se ttings ✓✓ Prot ocol Chao, Chang, et al. [ 51 ] 2016 Adj unctive acupun cture for pain an d symp tom manage ment in the inpatient setting : prot ocol for a pilo t hybrid effective ness-imple menta tion st udy USA Ho spital se tting ✓ Prot ocol

Table

1

List

of

articles

for

data

extraction

for

citation

analysis

of

the

use

of

the

PARIHS

framework.

The

table

is

sorted

on

type

of

article,

type

of

use

of

the

PA

RIHS

framework,

author

and

year

of

publication

(Co

ntinued)

Autho rs Ref Year of pub l. Fu ll title Count ry(ies ) Se tting PARIH S used: Type of article To pla n/deli ver an interve ntion In the an alysis a In the eva luation o f finding s In any othe r way Hack, Ruet her, et al. [ 52 ] 2011 Stud y prot ocol: Add ressi ng evi dence and cont ext to facilitat e trans fer and uptake of cons ultation reco rding use in onco logy: A know ledge trans lation implem entat ion study Canad a Ho spital se tting ✓ Prot ocol Stetler, Ritchie, et al. [ 53 ] 2007 Im proving qua lity of care throu gh ro utine, succ essful im plement ation of evi dence-base d prac tice at the bedside : A n organizational case st udy prot ocol usin g the Pettig rew and Whipp mod el of st rategic chang e USA Ho spital se tting ✓ Prot ocol Urquh art, Port er, et al. [ 54 ] 2012 Exp loring the interp erson al-, organization-, and syst em-leve l fact ors that influence the im plem entation an d use of an inno vation-syn optic rep orting-in cancer car e Canad a Ho spital se tting ✓ Prot ocol Watkins, Nag le, et al. [ 55 ] 2017 Labou ring Together: Coll aborative all iances in mat ernity care in Victo ria, Australia-proto col of a mi xed-m ethods study Aus tralia Ho spital se tting ✓ Prot ocol De Pe dro-Gómez, Mora les-Asenc io, et al. [ 56 ] 2012 Det ermini ng fact ors in evide nce-based cl inical prac tice amon g hospi tal and primary care nurs ing st aff Spain Mu ltiple se ttings ✓ Prot ocol Slaug hter, Estabro oks, et al. [ 57 ] 2013 Su staining Tra nsfers throu gh Af fordabl e Rese arch Tra nslation (START) : Stud y proto col to ass ess know ledge trans lation interven tions in cont inuing care setting s Canad a Co mmuni ty/ Soc ial care se tting ✓ Prot ocol Eriksson, Huy, et al. [ 58 ] 2016 Proc ess eva luati on of a know ledge translation interve ntion using facilitation of local st akehold er groups to improve neo natal survival in the Quang Ni nh provi nce, Viet nam Viet nam Pri mary health car e setting ✓✓ ✓ ✓ Empi rical study Eriksson, Nga, et al. [ 59 ] 2011 Ne wborn car e and know ledge translation -pe rceptions among prim ary healthcare staff in nor thern Viet nam Viet nam Co mmuni ty/ Soc ial care se tting ✓✓ ✓ ✓ Empi rical study Long-T ounsel, Wilson, et al. [ 60 ] 2014 Urban and Subu rban Ho spital Syste m Im plem entation of Multipoint Access Targete d Temp eratu re Mana geme nt in Postcardiac Arrest Patie nts USA Ho spital se tting ✓✓ ✓ ✓ Empi rical study McW illiam, Ko thari, et al. [ 61 ] 2009 Evol ving the the ory and praxis of know ledge trans lation throu gh soc ial interact ion: A social phe nome nologi cal study Canad a Co mmuni ty/ Soc ial care se tting ✓✓ ✓ ✓ Empi rical study Obre cht, Van Hulle Vince nt, et al. [ 62 ] 2014 Im plem entation of eviden ce-based pract ice for a pediatric pai n assessment instrument USA Ho spital se tting ✓✓ ✓ ✓ Empi rical study

Table

1

List

of

articles

for

data

extraction

for

citation

analysis

of

the

use

of

the

PARIHS

framework.

The

table

is

sorted

on

type

of

article,

type

of

use

of

the

PA

RIHS

framework,

author

and

year

of

publication

(Co

ntinued)

Autho rs Ref Year of pub l. Fu ll title Count ry(ies ) Se tting PARIH S used: Type of article To pla n/deli ver an interve ntion In the an alysis a In the eva luation o f finding s In any othe r way Allen, Hall , et al. [ 63 ] 2018 Im proving hospi tal enviro nmenta l hyg iene with the use of a targeted mu lti-m odal bund le strategy Aus tralia Ho spital se tting ✓✓ ✓ Empi rical study Bahtse vani an d Idvall [ 64 ] 2016 To Assess Prere quisites before an Imple menta tion Strat egy in an Orthop aedic Dep artme nt in Sweden Sw eden Ho spital se tting ✓✓ ✓ Empi rical study Bamf ord, Roth well, et al. [ 65 ] 2013 Im proving car e for pe ople after stroke: Ho w chang e was activel y facilitat ed UK Mu ltiple se ttings ✓✓ ✓ Empi rical study Brenn er, Bre shears, et al. [ 66 ] 2011 Im plem entation of a Su icide Nom enclat ure within Tw o V A Hea lthcare Setting s USA Mu ltiple se ttings ✓✓ ✓ Empi rical study Brow n and McCormack [ 67 ] 2016 Exp loring psych ological safe ty as a compone nt of facilitat ion wit hin the Prom oting Ac tion on Re search Im plement ation in Hea lth Service s fra mework UK Ho spital se tting ✓✓ ✓ Empi rical study Diffin, Ewing, et al. [ 68 ] 2018 Faci litating successful implem entat ion of a pe rson-centred interven tion to support family car ers within palliative care: a qualitat ive study of the Carer Support Need s Asses sment Tool (C SNAT) interve ntion UK Mu ltiple se ttings ✓✓ ✓ Empi rical study Diffin, Ewing, et al. [ 69 ] 2018 The Inf luence of Conte xt and Pract itioner Attitu de s o n Im plement ation of Pe rson-Centered Ass essment an d Support for Family Carers Wi thin Pal liative Care UK Co mmuni ty/ Soc ial care se tting ✓✓ ✓ Empi rical study Drainon i, Koppe lman, et al. [ 70 ] 2016 Why is it so hard to im plement chang e? A qua litative exa minati on of barri ers and faci litators to distribu tion of na loxone for overdo se pre vention in a safe ty net environ ment USA Ho spital se tting ✓✓ ✓ Empi rical study Ellis, H oward, et al. [ 71 ] 2005 From wo rkshop to work prac tice: An exploration of contex t and facilitation in the devel opm ent of eviden ce-based pract ice Aus tralia Ho spital se tting ✓✓ ✓ Empi rical study Gerrish, Laker, et al. [ 72 ] 2016 Enhan cing the quality of or al nut rition support for hospitalized patients : a mixed method s know ledge trans lation study (The EQON S study) UK Ho spital se tting ✓✓ ✓ Empi rical study Gesth alter, Koppe lman, et al. [ 73 ] 2017 Eva luations of Implem entat ion at Early-Adopt ing Lung Cancer Screeni ng Prog ram s: Lessons Learn ed USA Mu ltiple se ttings ✓✓ ✓ Empi rical study Harri s, Jones, et al. [ 74 ] 2015 Chan ging pract ice to support self-manage ment an d recove ry in menta l illnes s: Applicat ion of an im plem entation mod el Aus tralia Co mmuni ty/ Soc ial care se tting ✓✓ ✓ Empi rical study Harve y, McCormack , e t al. [ 75 ] 2018 Des ignin g and implem enting two faci litation interve ntions with in the "Fa cilitating Im plem entation of Researc h Evidence (FIRE )' UK, Ireland, Nethe rlands, Sw eden Co mmuni ty/ Soc ial care se tting ✓✓ ✓ Empi rical study

Table

1

List

of

articles

for

data

extraction

for

citation

analysis

of

the

use

of

the

PARIHS

framework.

The

table

is

sorted

on

type

of

article,

type

of

use

of

the

PA

RIHS

framework,

author

and

year

of

publication

(Co

ntinued)

Autho rs Ref Year of pub l. Fu ll title Count ry(ies ) Se tting PARIH S used: Type of article To pla n/deli ver an interve ntion In the an alysis a In the eva luation o f finding s In any othe r way st udy: a qua litative an alysis from an exte rnal faci litators' perspective Houl e, Charroi s, et al. [ 76 ] 2017 A random ized cont rolled study o f prac tice faci litation to improve the provi sion of me dication manageme nt servic es in Alb erta com munit y pharm acies Canad a Co mmuni ty/ Soc ial care se tting ✓✓ ✓ Empi rical study Jang land and Gunn ingberg [ 77 ] 2017 Im proving patie nt part icipation in a challe nging cont ext: a 2-year eva luation st udy of an im plem entation proje ct Sw eden Ho spital se tting ✓✓ ✓ Empi rical study Lewis, Kitson , e t al. [ 78 ] 2016 Im proving oral health for older pe ople in the hom e care setting : A n exploratory im plem entation st udy Aus tralia Ho me-based car e ✓✓ ✓ Empi rical study Lindsay, Kauth , et al. [ 79 ] 2015 Im plem entation of Video Tele health to Im prove Ac cess to Evi dence-B ased Psycho therapy for Postt raumat ic Stress D isorder USA Mu ltiple se ttings ✓✓ ✓ Empi rical study Mekki , Øye, et al. [ 80 ] 2017 The inter-p lay betw een facilitat ion and contex t in the prom oting action on research im plem entation in health services fra mework : A qua litative exp loratory im plem entation st udy em bedded in a clus ter ran domized cont rolled trial to red uce restraint in nursing home s Norw ay Co mmuni ty/ Soc ial care se tting ✓✓ ✓ Empi rical study Parlour and McCormack [ 81 ] 2012 Blen ding critical realis t and emanc ipatory prac tice de velopm ent method ologi es: Maki ng criti cal real ism work in nurs ing res earch Ireland Co mmuni ty/ Soc ial care se tting ✓✓ ✓ Empi rical study Perss on, Ng a, et al. [ 82 ] 2013 Eff ect of Faci litation of Lo cal Mat ernal-and-Ne wborn Stak eholder Groups on Neonat al Mort ality: Clust er-Randomi zed Contr olled Trial Viet nam Pri mary health car e setting ✓✓ ✓ Empi rical study Rycro ft-Malone , Fontenl a, et al. [ 83 ] 2009 Prot ocol-bas ed care: The st andardisation of de cision-making? UK Ho spital se tting ✓✓ ✓ Empi rical study Rycro ft-Malone , Seer s, et al. [ 84 ] 2012 A pragmatic cluster random ised tri al eva luating thre e implem ent ation interve ntions UK Ho spital se tting ✓✓ ✓ Empi rical study Rycro ft-Malone , Seer s, et al. [ 85 ] 2013 The ro le of evide nce, cont ext, and facilitat ion in an im plement ation trial: Im plicati ons for the de velopm ent of the PARIH S fra mework UK Ho spital se tting ✓✓ ✓ Empi rical study Rycro ft-Malone , Seer s, et al. [ 86 ] 2018 A realis t proces s eva luation with in the Faci litat ing Im plem entation of Researc h Evidence (FIRE ) clus ter random ised cont rolled intern ational trial: An exem pla r Ireland, U K , Nethe rlands, Sw eden Co mmuni ty/ Soc ial care se tting ✓✓ ✓ Empi rical study

Table

1

List

of

articles

for

data

extraction

for

citation

analysis

of

the

use

of

the

PARIHS

framework.

The

table

is

sorted

on

type

of

article,

type

of

use

of

the

PA

RIHS

framework,

author

and

year

of

publication

(Co

ntinued)

Autho rs Ref Year of pub l. Fu ll title Count ry(ies ) Se tting PARIH S used: Type of article To pla n/deli ver an interve ntion In the an alysis a In the eva luation o f finding s In any othe r way Slaug hter and Estabro oks [ 87 ] 2013 O ptimizing the mob ility of resident s with de mentia: A pil ot study prom oting healthc are aide uptak e of a simpl e mob ility inn ovation in divers e nurs ing hom e setting s Canad a Co mmuni ty/ Soc ial care se tting ✓✓ ✓ Empi rical study Sving, Fre driksson, et al. [ 88 ] 2017 Getting evide nce-based pre ssure ulce r pre vention into practic e: a proc ess eva luati on of a mu ltifacet ed interven tion in a hos pital setting Sw eden Ho spital se tting ✓✓ ✓ Empi rical study Walsh, Ford, et al. [ 89 ] 2017 The D evelopme nt an d Implem ent ation of a Partic ipatory and Solution -Focused Fra mework for Clinical Researc h: A case exa mple Aus tralia Ho spital se tting ✓✓ ✓ Empi rical study Migno gna, Hund t, et al. [ 90 ] 2014 Im plem enting brief cog nitive be havioral the rapy in primary car e: A pilo t study USA Pri mary health car e setting ✓✓ ✓ Empi rical study Alke ma and Frey [ 91 ] 2006 Im plicati ons of translating research into practice: A medi cation managemen t interven tion USA Ho me-based car e ✓✓ Empi rical study Kilbourne , Abra ham, et al. [ 92 ] 2013 Clu ster random ized adap tive im plement ation trial com paring a standard vers us enhanc ed im plem entation interve ntion to impro ve uptake of an effective re-e ngagem ent progr am for pat ients with serious m e ntal illnes s USA Mu ltiple se ttings ✓✓ Empi rical study Migno gna, Marti n, et al. [ 93 ] 2018 I had to som ehow still be flex ible: explori ng adap tations during im plem entat ion of brief cog nitive be havioral the rapy in primary car e USA Pri mary health car e setting ✓✓ Empi rical study Wester gren [ 94 ] 2012 Ac tion-o riented study circles facilitat e effo rts in nurs ing hom es to go from feeding to serving : Con ceptual p e rspectives on knowle dge trans lation and workplace le arning Sw eden Co mmuni ty/ Soc ial care se tting ✓✓ Empi rical study Balo h, Zhu, et al. [ 95 ] 2018 Type s of intern al faci litation activ ities in hospi tals im plem enting evi dence-based interve ntions USA Ho spital se tting ✓✓ ✓ Empi rical study Snelg rove-Clarke, Davies, e t al. [ 96 ] 2015 Im plem enting a Feta l Hea lth Surve illance Gu ideline in Cli nical Pract ice: A Prag matic Rand omi zed Con trolled Trial of Action Lea rning Canad a Ho spital se tting ✓✓ ✓ Empi rical study Wallin, Ru dberg, et al. [ 97 ] 2005 Staf f exper iences in im plem enting gui delines for Kan garoo Mother Care -A qualitat ive study Sw eden Ho spital se tting ✓✓ ✓ Empi rical study Bidassie, Williams, et al. [ 98 ] 2015 Key com ponents of exte rnal faci litation in an acut e stro ke qua lity improve men t collaborative in the Veteran s Hea lth Admini strat ion USA Ho spital se tting ✓✓ Empi rical study Doran , Hayn es, et al. [ 99 ] 2012 The ro le of organizational cont ext and indi vidual nurs e char acte ristics in explain ing variation in Canad a Mu ltiple se ttings ✓✓ Empi rical study

Table

1

List

of

articles

for

data

extraction

for

citation

analysis

of

the

use

of

the

PARIHS

framework.

The

table

is

sorted

on

type

of

article,

type

of

use

of

the

PA

RIHS

framework,

author

and

year

of

publication

(Co

ntinued)

Autho rs Ref Year of pub l. Fu ll title Count ry(ies ) Se tting PARIH S used: Type of article To pla n/deli ver an interve ntion In the an alysis a In the eva luation o f finding s In any othe r way use of inf ormation technol ogies in evi dence bas ed pract ice Fortne y, Enderl e, et al. [ 100 ] 2012 Im plem entation out comes of eviden ce-based qua lity improve ment for depre ssion in VA com munit y based out patien t clinics USA Mu ltiple se ttings ✓✓ Empi rical study Foss, Kvig ne, et al. [ 101 ] 2014 A mod el (CMBP ) for col laboratio n betw een univ ersity college an d nurs ing prac tice to prom ote research ut ilization in students' clinical pla cem ents: A pil ot study Norw ay Ed ucation al se tting ✓✓ Empi rical study Johnson , Ostaszk iewicz, et al. [ 102 ] 2009 Movi ng beyond res istance to restraint mi nimization: A case st udy of change manage ment in aged care Aus tralia Co mmuni ty/ Soc ial care se tting ✓✓ Empi rical study Kavanagh, Stevens , et al. [ 103 ] 2010 Proc ess eva luati on of app reciative inquiry to trans late pai n managemen t eviden ce into pe diatric nursing practic e Canad a Ho spital se tting ✓✓ Empi rical study Kinley , Ston e, et al. [ 104 ] 2014 The eff ect of usin g high facilitat ion when im plem enting the Gol d Stan dards Framewo rk in Care Ho mes pro gram: A cluste r rando mized cont rolled trial UK Co mmuni ty/ Soc ial care se tting ✓✓ Empi rical study Lewis, Harve y, et al. [ 105 ] 2019 Can oral healthc are for older peo ple be em bedded into rout ine comm unity age d car e prac tice? A real ist eva luation using nor malizat ion proc ess theory Aus tralia Ho me-based car e ✓✓ Empi rical study McGilton, Sori n-Peters , et al. [ 106 ] 2018 The eff ects of an interp rofession al patie nt-cen tered comm unicat ion inte rvention for pat ients with com munication disorde rs Canad a Ho spital se tting ✓✓ Empi rical study McLe an, Torking ton, et al. [ 107 ] 2019 Deve lopme nt, Implem entat ion, an d Outcom es of Post-strok e Mood Ass essm ent Pathways: Im plicati ons for Social Worke rs Aus tralia Ho spital se tting ✓✓ Empi rical study O'Hall oran, Cran , et al. [ 108 ] 2007 Fact ors affe cting adhe rence to use of hip prot ector s among residents of nursing home s -A corr elation st udy UK Co mmuni ty/ Soc ial care se tting ✓✓ Empi rical study Pallangyo, Mbeke nga, et al. [ 109 ] 2017 “If really we are comm itted thing s can chang e, st arting from us ”: Hea lthcare provi ders ’ pe rceptions of postpartum care an d its potent ial for improve ment in low-i ncome suburbs in Dar es Salaam , Tanzan ia Tanzani a Mu ltiple se ttings ✓✓ Empi rical study Pallangyo, Mbeke nga, et al. [ 110 ] 2018 Im plem entation of a faci litation interve ntion to im prove postpartum care in a low-r esource sub urb of Dar es Salaam , Tanzani a Tanzani a Mu ltiple se ttings ✓✓ Empi rical study

Table

1

List

of

articles

for

data

extraction

for

citation

analysis

of

the

use

of

the

PARIHS

framework.

The

table

is

sorted

on

type

of

article,

type

of

use

of

the

PA

RIHS

framework,

author

and

year

of

publication

(Co

ntinued)

Autho rs Ref Year of pub l. Fu ll title Count ry(ies ) Se tting PARIH S used: Type of article To pla n/deli ver an interve ntion In the an alysis a In the eva luation o f finding s In any othe r way Russell -Babin and Miley [ 111 ] 2013 Im plem enting the be st available evide nce in earl y delirium iden tification in el derly hip sur gery pat ients USA Ho spital se tting ✓✓ Empi rical study Rycro ft-Malone , Wilkinson, et al. [ 112 ] 2013 Coll aborative action around implem ent ation in Coll aboration s for Lea dership in App lied Hea lth Re search an d Care: toward a progr am theory UK Mu ltiple se ttings ✓✓ Empi rical study Seer s, Rycroft-Malon e, et al. [ 113 ] 2018 Faci litating Implem entat ion of Rese arch Evi dence (FIRE ): An intern ational cluster ran domized cont rolled trial to evaluate tw o mod els of faci litation informe d by the Prom oting Ac tion on Rese arch Im plement ation in Hea lth Services (PAR IHS) frame work UK, Ireland, Nethe rlands, Sw eden Co mmuni ty/ Soc ial care se tting ✓✓ Empi rical study Sige l, K ramer, et al. [ 114 ] 2013 Stat ewide disse minatio n o f trauma-fo cused cog nitive -behavioral therapy (TF-CB T) USA Mu ltiple se ttings ✓✓ Empi rical study Stev ens, Yam ada, et al. [ 115 ] 2016 Pai n assessment and management after a know ledge trans lation booste r interven tion Canad a Ho spital se tting ✓✓ Empi rical study Sving, H ögman , et al. [ 116 ] 2016 Getting evide nce-based pre ssure ulce r pre vention into prac tice: a multi-fac eted unit -tailored interven tion in a hos pital setting Sw eden Ho spital se tting ✓✓ Empi rical study Tian, Yang, et al. [ 117 ] 2017 Im plem entation of eviden ce into practic e for cance r-re lated fatigue manage ment of hos pitalized adu lt patien ts using the PAR IHS fra mework China Ho spital se tting ✓✓ Empi rical study Tucke r, Bieb er, et al. [ 118 ] 2012 O utcome s and Challeng es in Implem enting Ho urly Rou nds to Redu ce Fal ls in Orthop ed ic Un its USA Ho spital se tting ✓✓ Empi rical study Weir, Brun ker, et al. [ 119 ] 2017 Maki ng cognit ive decision support work : Faci litating adoption, knowle dge and be havior chang e throu gh QI USA Pri mary health car e setting ✓✓ Empi rical study Williams, Wood by, et al. [ 120 ] 2014 Form ative Eva luation o f a Multi-C ompo nent, Ed ucation -Based Interve ntion to Improve Proc esses of End -of-Life Care USA Ho spital se tting ✓✓ Empi rical study Yurum ezoglu and Kocaman [ 121 ] 2012 Pilo t study for evide nce-based nursing manage ment: Improving the level s o f job sat isfaction, organizational com mitment , and inten t to le ave among nurses in Turkey Turk ey Ho spital se tting ✓✓ Empi rical study Bros ey an d Mar ch [ 122 ] 2015 Eff ectiven ess of Structure d Ho urly Nurse Rou nding on Patient Satisfaction an d Clin ical O utcome s USA Ho spital se tting ✓✓ Empi rical study

Table

1

List

of

articles

for

data

extraction

for

citation

analysis

of

the

use

of

the

PARIHS

framework.

The

table

is

sorted

on

type

of

article,

type

of

use

of

the

PA

RIHS

framework,

author

and

year

of

publication

(Co

ntinued)

Autho rs Ref Year of pub l. Fu ll title Count ry(ies ) Se tting PARIH S used: Type of article To pla n/deli ver an interve ntion In the an alysis a In the eva luation o f finding s In any othe r way Chinm an, Ac osta, et al. [ 123 ] 2013 Interve ning with Practition ers to Im prove the Q uality of Preven tion: One-Yea r Finding s from a Rand omi zed Trial of Assets-Getting To Out comes USA Co mmuni ty/ Soc ial care se tting ✓✓ Empi rical study Gleg g [ 124 ] 2010 Kn owledg e brokering as an interven tion in pae diatric rehab ilita tion pract ice Canad a Not rep orted ✓✓ Empi rical study Harve y, Oliv er, et al. [ 125 ] 2015 Im proving the iden tification and manage ment of chroni c kidney disease in primary car e: Les sons from a stage d improve men t col laborati ve UK Pri mary health car e setting ✓✓ Empi rical study Humph reys, Harve y, et al. [ 126 ] 2012 A collaborative project to improve ident ification an d manageme nt of pat ients with chron ic kidne y disea se in a primary care se tting in Great er Manch ester UK Not rep orted ✓✓ Empi rical study Kauth , Sullivan, et al. [ 127 ] 2010 Em ploying exte rnal faci litation to implem ent cog nitive be havioral the rapy in VA cl inics: A pilo t study USA Not rep orted ✓✓ Empi rical study Almbl ad, Siltbe rg, et al. [ 128 ] 2018 Im plem entation of Pediatri c Early War ning Sco re; Adhe rence to Guidelines and Influence of Con text Sw eden Ho spital se tting ✓ Empi rical study Ama ya-Jackson , Hagele , et al. [ 129 ] 2018 Pilo t to poli cy: statewi de dissemi natio n an d im plem entation of eviden ce-based treat ment for traumatized you th USA Co mmuni ty/ Soc ial care se tting ✓ Empi rical study Ande rson, Zlateva, et al. [ 130 ] 2016 Im proving pai n care throu gh implem entat ion of the steppe d car e mod el at a mu ltisite com munit y health center USA Pri mary health car e setting ✓ Empi rical study Baile y, Wi lliams, et al. [ 131 ] 2014 Interve ntion to Impro ve Care at Life's End in Inpatient Setting s: The BEACON Trial USA Ho spital se tting ✓ Empi rical study Bun ch, Leasure, et al. [ 132 ] 2016 Im plem entation of a rapi d che st pai n proto col in the emer gen cy de partment: A quality im provement projec t USA Ho spital se tting ✓ Empi rical study Gutman is, Sny der, et al. [ 133 ] 2015 Hea lth car e redes ign for res ponsive behaviours -The be haviou ral support s On tario exper ience: Les sons le arned and keys to success Canad a Mu ltiple se ttings ✓ Empi rical study McGilton, Roc hon, et al. [ 134 ] 2017 Can We Help Care Provi ders Co mmuni cate More Eff ective ly Wi th Person s Having Deme ntia Livi ng in Lon g-Term Care Home s? Canad a Co mmuni ty/ Soc ial care se tting ✓ Empi rical study Murphy , Gardn er, et al. [ 135 ] 2014 A theo ry-informed app roac h to men tal heal th car e capac ity build ing for pharmac ists Canad a Pharm acies ✓ Empi rical study

Table

1

List

of

articles

for

data

extraction

for

citation

analysis

of

the

use

of

the

PARIHS

framework.

The

table

is

sorted

on

type

of

article,

type

of

use

of

the

PA

RIHS

framework,

author

and

year

of

publication

(Co

ntinued)

Autho rs Ref Year of pub l. Fu ll title Count ry(ies ) Se tting PARIH S used: Type of article To pla n/deli ver an interve ntion In the an alysis a In the eva luation o f finding s In any othe r way Musant i, O'Keef e, et al. [ 136 ] 2012 Partn ers in car ing: An innovat ive nursing model of care de livery USA Ho spital se tting ✓ Empi rical study O'Bri en, Redley, et al. [ 137 ] 2018 STO PDVTs: Develop ment an d testing of a c lini cal ass essm ent tool to guide nurs ing ass essment of postope rative pat ients for Dee p Ve in Throm bosis Aus tralia Ho spital se tting ✓ Empi rical study Orsted , Rosent hal, et al. [ 138 ] 2009 Pre ssure ulcer aware ness and pre vention progr am: A quality im provement progr am throu gh the Canad ian ass ociatio n of wound car e Canad a Mu ltiple se ttings ✓ Empi rical study Rutled ge and Skelt on [ 139 ] 2011 Cli nical exp ert faci litato rs of evi dence-based prac tice: A comm unity hospi tal progr am USA Ho spital se tting ✓ Empi rical study Ryan, Barnet t, et al. [ 140 ] 2013 Geria trics, interp rofessional pract ice, an d intero rganizational collaboration : A know ledge -to-prac tice intervent ion for primary car e team s Canad a Pri mary health car e setting ✓ Empi rical study Sadasi vam, Hogan, et al. [ 141 ] 2013 Im plem enting point of care "e-referrals" in 137 clinic s to inc rease acce ss to a quit smokin g intern et sy stem: The Q uit-Prim o and Nation al Dent al PB RN H I-QUIT Stud ies USA Pri mary health car e setting ✓ Empi rical study Smith , Almirall, et al. [ 142 ] 2019 Chan ge in Pat ient O utcome s Af ter Aug menti ng a Low-l evel Im plem entation Strat egy in Comm unity Pract ices That Are Slo w to Adopt a Coll aborative Chro nic Care Mod el A Clust er Rand omi zed Im plement ation Trial USA Co mmuni ty/ Soc ial care se tting ✓ Empi rical study Stev ens, Yam ada, et al. [ 143 ] 2014 Pai n in hospi talize d chi ldren: Eff ect of a mu ltidimen sional know ledge translation strategy on pain proces s and clinical outcomes Canad a Ho spital se tting ✓ Empi rical study Tilson, Mi ckan, et al. [ 144 ] 2016 Prom oting phy sical therapists' use of res earch evi dence to inf orm cl inical pract ice: part 3-lon g term feasibi lity assessment of the PEAK progr am USA Mu ltiple se ttings ✓ Empi rical study Tistad, Pal mcrant z, et al. [ 145 ] 2016 Deve loping leade rship in manage rs to faci litate the im plem entation of nation al guide line reco mmend ations: A proces s eva luation o f feas ibili ty and useful ness Sw eden Mu ltiple se ttings ✓ Empi rical study Tool e, St ichler, et al. [ 146 ] 2013 Prom oting nurs es' know ledge in eviden ce-based prac tice: Do ed ucational method s mat ter? USA Ho spital se tting ✓ Empi rical study Wester gren , Axels son, et al. [ 147 ] 2009 Stud y circ les im prove the preci sion in nutrit ional car e in special accom mod ation s Sw eden Co mmuni ty/ Soc ial care se tting ✓ Empi rical study

Table

1

List

of

articles

for

data

extraction

for

citation

analysis

of

the

use

of

the

PARIHS

framework.

The

table

is

sorted

on

type

of

article,

type

of

use

of

the

PA

RIHS

framework,

author

and

year

of

publication

(Co

ntinued)

Autho rs Ref Year of pub l. Fu ll title Count ry(ies ) Se tting PARIH S used: Type of article To pla n/deli ver an interve ntion In the an alysis a In the eva luation o f finding s In any othe r way You ng, Banks, et al. [ 148 ] 2018 Im proving nut rition care an d inta ke for older hos pital patie nts through syst em-leve l diet ary an d mealt ime interve ntions Aus tralia Ho spital se tting ✓ Empi rical study Balbal e, Hill, et al. [ 149 ] 2015 Eva luating im plement ation of me thicilli n-resistant Staphy loco ccus aureus (MR SA) pre vention gui delines in spin al cord inju ry centers using the PAR IHS framework : A mixed method s study USA Ho spital se tting ✓✓ ✓ Empi rical study Bergs tröm, Peters on, et al. [ 150 ] 2012 Kn owledg e trans lation in Ugand a: A qua litative st udy of U gandan mi dwives' an d managers' pe rceived relevance of the sub-e lements of the cont ext cornerstone in the PARIH S frame work Ugand a Mu ltiple se ttings ✓✓ ✓ Empi rical study Boblin, Ireland, et al. [ 151 ] 2013 Usi ng Stake's Qual itative Cas e Stud y Appro ach to Explore Im plement ation of Evidence-Based Pract ice Canad a Ho spital se tting ✓✓ ✓ Empi rical study Camme r, Morg an, et al. [ 152 ] 2014 The hidd en com plexi ty of long-te rm care: Ho w cont ext mediates know ledge translation an d use of best pract ices Canad a Co mmuni ty/ Soc ial care se tting ✓✓ ✓ Empi rical study Cumm ings, Estabro oks, et al. [ 153 ] 2007 Inf luence of organizational char acte ristics and cont ext on research utiliz ation Canad a Ho spital se tting ✓✓ ✓ Empi rical study Estabro oks, Midodzi, et al. [ 154 ] 2007 Pre dicting res earch use in nurs ing organ izations: A mult ilevel analysis Canad a Ho spital se tting ✓✓ ✓ Empi rical study Estabro oks, Sq uires, et al. [ 155 ] 2009 Deve lopme nt and asses sment of the Alb erta Con text Tool Canad a Ho spital se tting ✓✓ ✓ Empi rical study Estabro oks, Sq uires, et al. [ 156 ] 2011 Adva ncin g the argu ment for validity of the Alb erta Co ntext Tool with healthcare aides in res idential long-te rm care Canad a Co mmuni ty/ Soc ial care se tting ✓✓ ✓ Empi rical study Gagli ardi, We bster, et al. [ 157 ] 2014 Ho w doe s cont ext inf luenc e collaborative de cision-making for health services pla nning, de livery and evaluation? Canad a Ho spital se tting ✓✓ ✓ Empi rical study Gibb [ 158 ] 2013 An envi ronme ntal scan of an aged care work place using the PARiH S mod el: Assessing pre paredne ss for chang e Aus tralia Co mmuni ty/ Soc ial care se tting ✓✓ ✓ Empi rical study Helfr ich, Li, et al. [ 159 ] 2009 O rganizational readine ss to chang e ass essment (OR CA): Develop men t o f an instrumen t based on the prom oting action on res earch in heal th se rvices (PARIHS ) framewo rk USA Mu ltiple se ttings ✓✓ ✓ Empi rical study Kriste nsen and Houns gaard [ 160 ] 2013 Im plem entation of cohere nt, eviden ce-ba sed pat hways in Dan ish rehab ilitation practic e Denm ark Mu ltiple se ttings ✓✓ ✓ Empi rical study

Table

1

List

of

articles

for

data

extraction

for

citation

analysis

of

the

use

of

the

PARIHS

framework.

The

table

is

sorted

on

type

of

article,

type

of

use

of

the

PA

RIHS

framework,

author

and

year

of

publication

(Co

ntinued)

Autho rs Ref Year of pub l. Fu ll title Count ry(ies ) Se tting PARIH S used: Type of article To pla n/deli ver an interve ntion In the an alysis a In the eva luation o f finding s In any othe r way Malte, Mc Fall, et al. [ 161 ] 2013 Su rvey of providers' attitud es tow ard integ rating sm oking cessation treatme nt into po sttraumatic st ress diso rder care USA Ho spital se tting ✓✓ ✓ Empi rical study McCormack , McCarthy, et al. [ 162 ] 2009 Deve lopme nt and testing of the Conte xt Ass essment Inde x (C AI) Ireland, Nort hern Ireland, U K Mu ltiple se ttings ✓✓ ✓ Empi rical study McCu llough, Cho u, et al. [ 163 ] 2015 The interp lay of cont extu al elem ents in im plem entation : A n ethno graphic case study USA Mu ltiple se ttings ✓✓ ✓ Empi rical study Palmcran tz, Tistad, et al. [ 164 ] 2015 Ass essing feas ibility and accept ability of st udy proc edure s: ge tting read y for im plement ation of na tional stroke guidelines in out-patie nt heal th car e Sw eden Pri mary health car e setting ✓✓ ✓ Empi rical study Schul tz and Kitson [ 165 ] 2010 Measuri ng the cont ext of care in an Aus tralian acut e car e hospi tal: A nurse survey Aus tralia Ho spital se tting ✓✓ ✓ Empi rical study Stolee, Stee ves, et al. [ 166 ] 2010 Hea lth info rmation use in home care: Brai nstormi ng barriers, faci litato rs, and reco mmend ations Canad a H o me-based car e ✓✓ ✓ Empi rical study Urquh art, Sar gean t, et al. [ 167 ] 2011 Fact ors rel ated to the implem entat ion and use of an innovat ion in cance r surgery Canad a Ho spital se tting ✓✓ ✓ Empi rical study Watt s, Shiner, et al. [ 168 ] 2014 Im plem entation of eviden ce-based psyc hothe rapies for post traumatic stress dis order in VA special ty clinic s USA Ho spital se tting ✓✓ ✓ Empi rical study Wente an d Kleibe r [ 169 ] 2013 An Explorati on of Con text and the Use of Evi dence-B ased Nonp harma cological Practices in Em ergency D epartme nts USA Ho spital se tting ✓✓ ✓ Empi rical study Zubkof f, Carp enter-Song , et al. [ 170 ] 2016 Cli nicians ’Perc eption of Patient Readin ess for Treat ment: An Emer ging The me in Im plem entation Scie nce? USA Pri mary health car e setting ✓✓ ✓ Empi rical study Arling, Doebbe ling, et al. [ 171 ] 2011 Im proving the im plement ation of eviden ce-bas ed pract ice and information sy stems in heal thcare : A social netwo rk approach Canad a Mu ltiple se ttings ✓✓ Empi rical study Bahtse vani, Willman , et al. [ 172 ] 2008 Deve loping an instrument for evaluating im plem entation of clinical pract ice gui delines: A test-re test study Sw eden Ho spital se tting ✓✓ Empi rical study Boaz, Bae za, et al. [ 173 ] 2016 Do es the "diffusion of innovat ions' mod el enri ch unde rstandi ng of research use? Case st udies of the imple menta tion of throm bolysi s se rvices for stroke UK and Swed en Ho spital se tting ✓✓ Empi rical study

Table

1

List

of

articles

for

data

extraction

for

citation

analysis

of

the

use

of

the

PARIHS

framework.

The

table

is

sorted

on

type

of

article,

type

of

use

of

the

PA

RIHS

framework,

author

and

year

of

publication

(Co

ntinued)

Autho rs Ref Year of pub l. Fu ll title Count ry(ies ) Se tting PARIH S used: Type of article To pla n/deli ver an interve ntion In the an alysis a In the eva luation o f finding s In any othe r way Boström , Wal lin, et al. [ 174 ] 2007 Evi dence-based pract ice and determ inant s o f res earch use in elde rly car e in Swed en Sw eden Co mmuni ty/ Soc ial care se tting ✓✓ Empi rical study Butow , Wi lliams, et al. [ 175 ] 2019 A psych ological interve ntion (C onquerF ear) for treat ing fear of cance r recurrenc e: Views of study the rapists regarding sus tainability Aus tralia Ho spital se tting ✓✓ Empi rical study Carlan , Kram er, et al. [ 176 ] 2012 Digg ing into constru ction: Social net works and the ir pot ential impac t on know ledge trans fer Canad a C o nstruction se tting ✓✓ Empi rical study Chou, Gra ber, et al. [ 177 ] 2018 Sp ecifying an implem entat ion framework for Ve terans Af fairs antimi crobial st ewards hip progr amm es: using a factor analysi s app roach USA Mu ltiple se ttings ✓✓ Empi rical study Conk lin and Stolee [ 178 ] 2008 A mod el for eva luating know ledge exchang e in a netwo rk contex t Canad a Co mmuni ty/ Soc ial care se tting ✓✓ Empi rical study Conk lin, Lusk, et al. [ 179 ] 2013 Kn owledg e brokers in a know ledge network : The cas e of Sen iors Hea lth Researc h Transfer Ne twork know ledge brok ers Canad a Not rep orted ✓✓ Empi rical study Cumm ings, Hutc hinson, et al. [ 180 ] 2010 The rel ationship betwee n char acte ristics of cont ext and res earch utilization in a pediatric se tting Canad a Ho spital se tting ✓✓ Empi rical study Eldh, Fre driksson, et al. [ 181 ] 2014 Faci litato rs and barriers to applying a n ational qua lity registry for quality im provement in stroke car e Sw eden Ho spital se tting ✓✓ Empi rical study Elnit sky, Powe ll-Cope, et al. [ 182 ] 2015 Im plem entation of Safe Patient Handl ing in the US Veterans Health Syst em: A Qualit ative Stud y of Internal Faci litato rs' Perc eptio ns USA Ho spital se tting ✓✓ Empi rical study Eriksson, Eriksson, et al. [ 183 ] 2019 O ccupation al therapists ’perce ptions of im plem enting a clien t-cen tered interven tion in close col laboration with researchers: A mixed me thods study Sw eden mu ltiple se ttings ✓✓ Empi rical study Forberg, Unbe ck, et al. [ 184 ] 2016 Eff ects of compu ter remind ers on compl ication s of peripheral venou s cathe ters an d nurs es' adhe rence to a guideline in paediatric care-a clus ter random ised study Sw eden Ho spital se tting ✓✓ Empi rical study Gifford, Tav akoli, et al. [ 185 ] 2015 Im plem entation of Smok ing Cessation Treat ment in VHA Su bstance Use Disorder Reside ntial Treat ment Programs USA Co mmuni ty/ Soc ial care se tting ✓✓ Empi rical study Hack, Ruet her, et al. [ 186 ] 2013 Prom oting cons ultation recording practic e in onco logy: Ident ificat ion of critical Canad a Ho spital se tting ✓✓ Empi rical study

Table

1

List

of

articles

for

data

extraction

for

citation

analysis

of

the

use

of

the

PARIHS

framework.

The

table

is

sorted

on

type

of

article,

type

of

use

of

the

PA

RIHS

framework,

author

and

year

of

publication

(Co

ntinued)

Autho rs Ref Year of pub l. Fu ll title Count ry(ies ) Se tting PARIH S used: Type of article To pla n/deli ver an interve ntion In the an alysis a In the eva luation o f finding s In any othe r way im plem entation fact ors an d dete rmination of pat ient be nefit Hill, Gu ihan, et al. [ 187 ] 2017 Use of the PARIH S Frame work for Re trospective an d Pros pective Implem ent ation Eva luations USA Mu ltiple se ttings ✓✓ Empi rical study Holt, Pankow, et al. [ 188 ] 2018 Fact ors ass ociated with using research evide nce in natio nal sport organ isations Canad a Not rep orted ✓✓ Empi rical study Hurtub ise, Rivard, et al. [ 189 ] 2016 Vir tual Kn owledg e Broke ring: Describing the Role s and Strateg ies Use d by Kno wledg e Broke rs in a Pediatri c Physio therapy Virtu al Comm unity of Practice Canad a Not rep orted ✓✓ Empi rical study Hølge-Ha zelt on, Bruun, et al. [ 190 ] 2019 Dan ish Tra nslation and Adap tation of the Con text Asses sment Index With Implication s for Evi dence-B ased Practice Dan mark Ho spital se tting ✓✓ Empi rical study Ismai l, Squires , et al. [ 191 ] 2018 The Inf luence of Conte xt on Utili zing Re search Evi dence for Pai n Management in Jord anian Pe diatric Inten sive Care U nits (PIC U) Jord ania Ho spital se tting ✓✓ Empi rical study Jans son an d Forsbe rg [ 192 ] 2016 Ho w d o nurs es and ward managers pe rceiv e that evi dence-based sour ces are obt ained to inf orm rel evant nursing interven tions? -An exp loratory st udy Sw eden Ho spital se tting ✓✓ Empi rical study Jans son, Pilham ar, et al. [ 193 ] 2011 Fact ors an d cond itions that have an im pact in rel ation to the succ essful im plem entation an d mai ntenan ce of individ ual care pla ns Sw eden Ho spital se tting ✓✓ Empi rical study Kram er, Wells, et al. [ 194 ] 2013 Did you have an im pact? A theo ry-based me thod for pla nning and evaluating know ledge -transfer and exch ange activ ities in occ upational heal th an d safe ty Canad a Mu ltiple se ttings ✓✓ Empi rical study Lo, Ho ben, et al. [ 195 ] 2018 Im portan ce of clinical ed ucators to res earch use an d sugge stions for better eff icien cy and eff ectiven ess: resul ts of a cross-sectional survey of care aid es in Can adian long-t erm car e faci lities Canad a Co mmuni ty/ Soc ial care se tting ✓✓ Empi rical study Lund ell, Tistad, et al. [ 196 ] 2017 Bu ilding COP D care on shaky ground: A mixed me thods study from Swed ish primary car e prof essional p e rspective Sw eden Pri mary health car e setting ✓✓ Empi rical study McCalman, Tsey, et al. [ 197 ] 2014 The char acte ristics, implem entat ion and eff ects of Aboriginal an d Torre s Strai t Islande r heal th prom otion tools: A system atic lite rature searc h Not rep orted Mu ltiple se ttings ✓✓ Empi rical study McKillop, Cris p, et al. [ 198 ] 2012 Barr iers and Enab lers to Imple menta tion of a Ne w Zeal and-Wide Guideline for Assessm ent New Zealan d Pri mary health car e setting ✓✓ Empi rical study

Table

1

List

of

articles

for

data

extraction

for

citation

analysis

of

the

use

of

the

PARIHS

framework.

The

table

is

sorted

on

type

of

article,

type

of

use

of

the

PA

RIHS

framework,

author

and

year

of

publication

(Co

ntinued)

Autho rs Ref Year of pub l. Fu ll title Count ry(ies ) Se tting PARIH S used: Type of article To pla n/deli ver an interve ntion In the an alysis a In the eva luation o f finding s In any othe r way an d Mana geme nt of Card iovas cular Risk in Pri mary H ealth Care : A Template Analysis Meher ali, Paul, et al. [ 199 ] 2017 Use of Researc h b y Undergradua te Nu rsing Stud ents: A Qualit ative Des criptive Stud y Canad a Not rep orted ✓✓ Empi rical study Naik , Lawren ce, et al. [ 200 ] 2015 Bu ilding a primary car e/research partn ership: Les sons le arned from a telehea lth interve ntion for diabete s and depression USA Pri mary health car e setting ✓✓ Empi rical study Nygårdh, Ahls tröm, et al. [ 201 ] 2016 Han dling a chal lenging cont ext: Exp erience s of faci litating eviden ce-based e lderly care Sw eden Co mmuni ty/ Soc ial care se tting ✓✓ Empi rical study Peirs on, Cil iska, et al. [ 202 ] 2012 Bu ilding cap acity for eviden ce inf ormed decision making in pub lic heal th: A case study o f or ganizational chang e Canad a Pri mary health car e setting ✓✓ Empi rical study Perry , Bellcham bers, et al. [ 203 ] 2011 Exa minati on of the utili ty of the Prom oting Ac tion on Re search Im plement ation in Hea lth Services framework for implem entat ion of evi dence bas ed practice in res ident ial aged car e setting s Aus tralia Co mmuni ty/ Soc ial care se tting ✓✓ Empi rical study Sandst röm, Willman , et al. [ 204 ] 2015 Pe rceptions of natio nal guide lines an d the ir (non) implem entat ion in men tal healthcare : A deduct ive and inductive content analysis Sw eden Mu ltiple se ttings ✓✓ Empi rical study Sharp, Pineros , et al. [ 205 ] 2004 A qualitat ive study to iden tify barri ers and faci litators to im plem entation of pilot interve ntions in the Veteran s Hea lth Adm inistra tion (VHA) North west net work USA Ho spital se tting ✓✓ Empi rical study Stetler, Legro, et al. [ 206 ] 2006 Role of "external facilitat ion" in im plement ation of research finding s: A qua litative eva luation o f faci litation exper ience s in the Veterans Healt h Adm inistra tion USA Not rep orted ✓✓ Empi rical study Stev ens, Ria hi, et al. [ 207 ] 2011 The Inf luence of Conte xt on Pain Pract ices in the NI CU: Percep tions of Hea lth Care Prof essionals Canad a Ho spital se tting ✓✓ Empi rical study Ullric h, Lave la, et al. [ 208 ] 2014 Ass ociatio ns be tween pe rceptions of evide nce an d adoption of H1N1 inf luenza infect ion pre vention strat egies among heal thcare wo rkers provi ding car e to pe rsons wit h spi nal cord injury USA Mu ltiple se ttings ✓✓ Empi rical study Ullric h, Sahay, et al. [ 209 ] 2014 Use of implem entat ion theory : A focus on PARIH S USA Mu ltiple se ttings ✓✓ Empi rical study