Keywords
implementation; implementation science; review; theory; evidence-based practice; literature review; protocol; knowledge translation
implementation; implementation science; review; theory; evidence-based practice; literature review; protocol; knowledge translation
Implementation strategies are methods or techniques used to facilitate the adoption of evidence-based interventions by healthcare providers, organizations and systems.1,2 These strategies must address the specific implementation context.2,3 Rigorous, systematic and context-specific design of implementation strategies is critical for informing the implementation of evidence-based interventions.4–6 Implementation strategy design is often guided by informal (or implicit) theory—i.e., an “understanding of the problem and its determinants gained through experience or tacit knowledge by the developers of the intervention.”4–6 While informal theory can be useful for developing strategies suited to the particular implementation context, there are downsides to using only informal theory in this context. These include lack of standardization of language/tools, failure to build on existing knowledge, and influence of personal preferences/biases.7 To overcome these limitations and inform implementation strategy design, implementation scientists and practitioners can select from a broad range of theories, models, and frameworks (TMFs), which can be classified as formal theory.8,9
Several methodological approaches can be used to support the application of formal theory to the design of implementation strategies.2,10 Typically, these approaches involve identifying which stakeholders need to do what differently, identifying barriers and enablers to change, articulating a pathway of change for the targeted behaviour change, and selecting implementation strategy components to overcome identified barriers and enhance enablers of change.4,5,10,11 For example, implementation researchers often select a TMF to inform interview guide development in studies assessing barriers and enablers to healthcare professional adherence to an evidence-based clinical practice guideline.8 Results can be used to inform stakeholders of areas necessitating intervention to enhance implementation outcomes. Table 1 presents French et al.,’s11 approach for the development of a theory-informed implementation strategy.
However, the sheer number of TMFs relevant to implementation strategies is staggering and they are not one-size-fits-all; several complexities must be considered.9,12 TMFs have different purposes, operate at different levels (e.g., individual, organization, community, system), contain constructs ranging from broad to operational, and the relationships between their constructs can vary (e.g., linear, cyclical, feedback) or be absent.13,14 TMFs vary in the extent to which there are methods for operationalizing them; some TMFs are associated with a wide range of resources that can be useful to guide implementation strategy design. Finally, the supporting evidence varies; some theories emerged from decades of research in psychology, while this is not the case for more recent TMFs.13,14 To help clarify TMF distinctions, Nilsen8 proposed a taxonomy identifying five categories of TMFs: process models, determinant frameworks, classic theories, implementation theories, and evaluation frameworks (see Table 2). Three types of TMFs are particularly useful for informing implementation strategy design. Determinant frameworks consolidate several theories and describe multilevel factors that are theoretically and/or empirically linked to implementation outcomes. Classic theories and implementation theories describe precise mechanisms of behaviour and behaviour change that can be targeted by implementation strategy components. These theories often describe how change in the behaviour of those involved in an implementation process (e.g., healthcare professionals, patients) is anticipated to occur.4,8
Theory, model or framework type | Description |
---|---|
Process models (e.g., Knowledge-to-Action Cycle) | |
Determinant frameworks | |
Classic theories | |
Implementation theories | |
Evaluation frameworks |
While there is a wide range of TMFs available to inform implementation strategy design, researchers have little guidance on the desirable attributes of TMFs for this purpose. Furthermore, there is little information on how to select TMFs for use in their specific context. Several papers have reported broad taxonomies intended to elucidate and identify attributes on which to select TMFs for use in implementation research, but none, to our knowledge, specifically focus on implementation strategy design. Tabak et al.,13 sought to classify, organize and synthesize models aiming to support dissemination and implementation and offered guidance on how to select a model to inform study design and execution. Davis et al.,15 developed a list of criteria to appraise the quality of theories of behaviour and behaviour change. Birken et al.,16,17 identified the criteria used by implementation scientists to select TMFs and developed a tool to help scientists and practitioners select appropriate TMFs to guide their implementation initiatives. Similar work was undertaken by Lynch et al.,18 who developed a pragmatic guide for TMF selection. More recently, Strifler et al.,12 conducted a qualitative study that aimed to explore barriers and facilitators to identifying and selecting TMFs.
Despite the breadth of work, current papers discussing TMF selection do not differentiate criteria as a function of how implementation scientists and practitioners intend to use them.16,17 As discussed by Nilsen,8,19 there are different overarching aims of the use of TMFs in implementation science, but the selection criteria have not yet been differentiated by function of their intended use (Figure 1). Criteria currently available remain the same whether implementation scientists and practitioners intend to use TMFs for guiding the process of translating research into practice, understanding what influences implementation outcomes (to guide implementation strategy design), or evaluating implementation.
The blue box corresponds to the use of TMFs for implementation strategy design.
We posit that classifications of attributes for TMF selection must be more distinctive and focus on their intended use. In the context of implementation strategy design, some criteria for TMF selection might be more relevant than others. Applicability—i.e., whether a particular method (e.g., interviews, surveys, focus groups) can be used with the TMF—is often critical. Furthermore, the extent to which the TMF provides an explanation of how included constructs influence implementation and/or one another is essential.16,17 Thus, the lack of clear criteria renders TMF selection, and therefore implementation strategy design, perplexing, particularly for neophyte implementation scientists.16,17 As implementation strategy design is a key focus of implementation research, we believe it is critical to clarify specifically the selection criteria of TMFs in this context. Therefore, it is of high interest to synthesize the literature reporting on the selection of TMFs for informing implementation strategy design.
This scoping review aims to identify literature reporting on the selection of TMFs for informing implementation strategy design in healthcare and understand the suggested use of TMFs in implementation strategy design. We found no similar review after a preliminary search in MEDLINE (Ovid) and the Cochrane Database of Systematic Reviews on 15th March 2022. The main review question is the following:
1. What are the desirable attributes/selection criteria of TMFs for implementation strategy design in healthcare?
In addition, we will explore the purposes and uses of TMFs for informing each step of implementation strategy design, and the suggested research methods (e.g., qualitative interviews) for use in this context.t
Scoping reviews are particularly useful to explore, identify, map and discuss characteristics of concepts across a wide range of evidence sources.20 The proposed scoping review will be conducted in accordance with the Joanna Briggs Institute (JBI) methodology for scoping reviews (which expands on the work of Arksey and O’Malley21 and Levac et al.22). It emphasizes appropriateness, feasibility, and meaningfulness of the literature and includes nine sequential steps. First, defining the scoping review objective(s) and question(s). Second, developing and aligning the inclusion criteria with the objective(s) and question(s). Third, specifying the approach to evidence searching, selection, data extraction, and presentation. The next four steps involve searching for, selecting, extracting and analysing the evidence. The eighth is the presentation of the results, while the ninth and last step is summarizing the evidence, making conclusions and noting implications of the findings.20
The eligibility criteria are presented in Table 3 and described in more detail below. We will include literature reporting on a) the desirable attributes or selection criteria of TMFs for informing implementation strategy design and/or on b) the use of TMFs in implementation strategy design (concept) within any healthcare setting (context) (Figure 2). We define ‘implementation strategy design’ as all steps described in Table 1, including a) the identification of which stakeholders need to do what differently, b) the identification of the barriers and enablers that need to be resolved, c) the selection of implementation strategy components and the identification of the hypothesized casual pathway (mediators), and c) the selection of appropriate implementation outcomes.11 We anticipate that the primary types of records will be methodological papers and expert opinion papers. In addition, systematic reviews that meet the inclusion criteria will also be considered, depending on the research question. Primary studies will be included only if they research the use of TMFs in implementation strategy design; studies aiming to design and evaluate implementation strategies will be excluded. Furthermore, we will consider other types of records if these meet the eligibility criteria regarding the concept and context of interest. After a preliminary search in the grey literature, we concluded that it does not provide a substantial addition to the academic literature. Thus, we decided to not search the grey literature for low relevance and feasibility reasons.
Information sources
The bibliographical databases to be searched include MEDLINE (Ovid), CINAHL (EBSCO), and Embase (Ovid). Additionally, we will hand-search relevant journals to identify additional records. Examples of journals may include: Implementation Science, Implementation Science Communications, BMC Health Services Research, Implementation Research and Practice, and Health Research Policy and Systems. We will screen the reference list of included records to identify additional records. Finally, we will identify a limited number of ‘core papers’ (e.g., 10) and perform a citation search.
Search strategy
The search strategy will aim to locate published papers in peer-reviewed journals. An initial limited search of MEDLINE and CINAHL was undertaken in April 2022 to identify articles on the topic. The text words contained in the titles and abstracts of relevant articles, and the index terms used to describe the articles, were used to develop and refine a full search strategy for MEDLINE (see Figure 1). We also adapted elements from the search strategies of three recent reviews in the field of implementation science, Colquhoun et al.,10 Walsh-Bailey et al.,14 and Esmail et al.,9 to fit our objectives. The full search strategy, including all identified keywords and index terms, will be adapted for CINAHL and Embase. The reference list of all included sources of evidence will be screened for additional papers. We will include papers published in English and French only. We will limit the search to 2002–2022 as implementation research has developed drastically over the last two decades. Limiting our search will ensure that information is relevant for use today.
Following the search, all identified citations will be collated and duplicates removed. Following a pilot test, titles and abstracts will be screened by two independent reviewers for assessment against the inclusion criteria for the review. The full text of selected citations will be assessed in detail against the inclusion criteria by two independent reviewers. Reasons for exclusion of sources of evidence during the full text review that do not meet the inclusion criteria will be recorded and reported in the scoping review. Any disagreements that arise between the reviewers at each stage of the selection process will be resolved through discussion, or with an additional reviewer. The results of the search and the study inclusion process will be reported in full in the final scoping review and presented in a Preferred Reporting Items for Systematic Reviews and Meta-analyses extension for scoping review (PRISMA-ScR) flow diagram.23
Data will be extracted from included records by two independent reviewers using a data extraction tool developed specifically for this review (see Table 4). The data extracted will include specific details about the concept, context, study methods and key findings relevant to the review question. Using the extraction tool, we will extract the following data from included records:
1. Descriptive data: year of publication, first author’s academic discipline, country of origin, article type (e.g., study, editorial, review, opinion paper) and aim.
2. Methodological data: study design (if applicable), population and sample size (if applicable), study setting, data collection and analysis methods (if applicable).
3. Data on TMFs:
a. Authors’ rationale regarding the purpose of TMFs:
b. Authors’ rationale regarding the desirable attributes, selection criteria and selection process of TMFs:
• Generally, in implementation research and practice
• Specifically for informing each of the four main steps of implementation strategy design: 1) identifying who needs to do what, differently; 2) identifying barriers and enablers and articulate a pathway of change; 3) selecting implementation strategy components; and 4) deciding how change in implementation will be measured.
c. Authors’ rationale regarding how TMFs should be used for implementation strategy design, according to the different types of theory use specified in the Theory Coding Scheme.24
d. The research methods (e.g., intervention mapping) that should be used to incorporate theory in implementation strategy design
4. Results data: reported results according to study outcomes (if applicable).
Two independent reviewers will pilot the form by extracting data from five publications and the tool will be revised iteratively. Modifications will be detailed in the scoping review. Any disagreements that arise between the reviewers will be resolved through discussion, or with an additional reviewer on our research team. If appropriate, authors of papers will be contacted to request missing or additional data, where required.
An inductive approach will be used to categorize the desirable attributes and selection criteria of TMFs by two researchers independently. This process will be iterative as each researcher will continue categorization until distinct groups are created. After categorizing, the two researchers will compare groupings. Discrepancies in the categories will be resolved in group discussions among the research team. The final categories will be summarized into attribute themes. The entire research team will review final attribute themes, and revisions will be made until all team members agree. Findings will be presented as a list of attributes on which to base TMF selection for guiding implementation strategy design. Descriptive data regarding the purpose, different types of TMF use and research methods in implementation strategy design will be synthesised graphically and in table format. Data will also be presented narratively.
Results of this scoping review can be used to develop a taxonomy based on attributes and criteria specific to TMF selection for implementation strategy design, a key focus of implementation research and practice. Using the results of this scoping review, we plan to classify existing TMFs according to the attributes identified. This will result in additional publications. We also plan on creating an accessible, online tool with which researchers can identify TMFs for use in implementation strategy design. Specifically, the tool will allow researchers to select their intended use for a TMF in implementation strategy design and provide TMFs that match the identified desired traits.
Views | Downloads | |
---|---|---|
F1000Research | - | - |
PubMed Central
Data from PMC are received and updated monthly.
|
- | - |
Is the rationale for, and objectives of, the study clearly described?
Partly
Is the study design appropriate for the research question?
Yes
Are sufficient details of the methods provided to allow replication by others?
Partly
Are the datasets clearly presented in a useable and accessible format?
Not applicable
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Behavioral science, Behavior change theories and frameworks, Implementation science
Is the rationale for, and objectives of, the study clearly described?
Yes
Is the study design appropriate for the research question?
Yes
Are sufficient details of the methods provided to allow replication by others?
Yes
Are the datasets clearly presented in a useable and accessible format?
Not applicable
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Implementation Science, Knowledge Translation and Medical Education.
Is the rationale for, and objectives of, the study clearly described?
Yes
Is the study design appropriate for the research question?
Yes
Are sufficient details of the methods provided to allow replication by others?
Yes
Are the datasets clearly presented in a useable and accessible format?
Not applicable
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Implementation science, clinical psychology, behavioral economics
Alongside their report, reviewers assign a status to the article:
Invited Reviewers | |||
---|---|---|---|
1 | 2 | 3 | |
Version 1 06 Sep 22 |
read | read | read |
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Already registered? Sign in
The email address should be the one you originally registered with F1000.
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Comments on this article Comments (0)