Table 2 Summary of quantitative implementation outcomes assessed during pilot testing. Numbers refer to the numerator and denominator as described in the measure column. For binary outcomes in the sustainability section such as “use of template”, 1 indicates use and 0 indicates non-use. Note: the blueprint is a strategy to present and track the other eight implementation strategies. N/a = not applicable
Strategy | Data Source | Measure | Across all sites | Site 1 | Site 2 | Site 3 | Site 4 |
|---|---|---|---|---|---|---|---|
Fidelity | |||||||
Blueprint | n/a | n/a | n/a | n/a | n/a | n/a | n/a |
Change record systems (template) | Chart abstraction | # of encounters that have all required components over # of all encounters | 218/270 (81%) | 13/16 (81%) | 36/57 (63%) | 116/123 (94%) | 53/74 (72%) |
Identify and prepare champions | Blueprint items in Sect. 2.4 | # of items checked vs # items planned | 33/44 (75%) | 8/11 (72%) | 11/11 (100%) | 3/11 (27%) | 11/11 (100%) |
Tailoring | Blueprint: items 1.4.2a and 1.4.2b | # of items checked vs # items planned | 8/8 (100%) | 2/2 (100%) | 2/2 (100%) | 2/2 (100%) | 2/2 (100%) |
Audit & Feedback | Blueprint items 1.4.5 and 1.4.15 | # of items checked vs # items planned | 7/8 (88%) | 1/2 (50%) | 2/2 (100%) | 2/2 (100%) | 2/2 (100%) |
Remind clinicians (Cheat sheet & Poster) | Reported by site in Blueprint items 3.4.1 thru 3.4.3 & 3.4.13 | # of items checked vs # items planned | 15/16 (94%) | 4/4 (100%) | 4/4 (100%) | 3/4 (75%) | 4/4 (100%) |
Educational meetings | Blueprint Sect. 2.4 | # of items checked vs # items planned | 29/32 (91%) | 7/8 (88%) | 8/8 (100%) | 6/8 (75%) | 8/8 (100%) |
Prepare patients to be active participants (Surveillance grid) | Provider self-report | # of encounters where surveillance grid was used | 176/269 (65%) | 57/66 (86%) | 45/60 (75%) | 43/84 (51%) | 31/59 (55%) |
Facilitation | Blueprint items 1.4.1 thru 1.4.16 | Proportion of the 16 activities that were documented as completed | 60/64 (94%) | 15/16 (94%) | 16/16 (100%) | 13/16 (81%) | 16/16 (100%) |
Sustainability | |||||||
Plan for sustainmenta | Blueprint | Number of strategies that site plans to sustain | 12/15 (80%) | Not collectedb | 5/5 (100%) | 2/5 (40%) | 5/5 (100%) |
Blueprint | Site self-report | Any further use of the blueprint 6 months after external facilitation end | 0 (0%) | Not collectedc | 0 | Not collectedc | 0 |
Change record systems (template) | Chart abstraction | Use of template 6 months after external facilitation end (definition: template has required components and is used by at least one provider) | 4/4 (100%) | 1 | 1 | 1 | 1 |
Champion | Site self-report | Identified and trained champion exists at site 6 months after external facilitation end | 3/4 (75%) | 1 | 1 | 0 | 1 |
Tailoring | Site self-report | Any further tailoring of strategies 6 months after external facilitation end | 1/3 (33%) | 1 | 0 | Unable to assess | 0 |
Cheat sheet | Site self-report | New providers receive the cheat sheet 6 months after external facilitation end | 1/3 (33%) | 1 | 0 | Unable to assess | 1 |
Poster | Site self-report | Poster still hanging 6 months after external facilitation end | 3/4 (75%) | 1 | 1 | 0 | 1 |
Educational meetings | Site self-report | Use of modules 6 months after external facilitation end (either for new staff or as a refresher) | 0/3 (0%) | 0 | 0 | Unable to assess | 0 |
Surveillance grid | Site self-report | Surveillance grid is still given to patients by at least one provider 6 months after external facilitation end | 1/3 (33%) | 1 | 0 | Unable to assess | 0 |