Skip to main content

Building knowledge translation competency in a community-based hospital: a practice-informed curriculum for healthcare providers, researchers, and leadership

Abstract

Background

Enacting knowledge translation (KT) in healthcare settings is a complex process that requires organizational facilitation. In addition to addressing organizational-level barriers, targeting individual-level factors such as KT competencies are a necessary component of this aim. While literature on KT competency training is rapidly growing, there has been little exploration of the potential benefits of training initiatives delivered from an intra-organizational perspective. Addressing this gap, we developed the Knowledge Translation Facilitator Network (KTFN) to meet the KT needs of individuals expected to use and produce knowledge (e.g., healthcare providers, research staff, managers, family advisors) within an academic health sciences center. The aim of this study is to describe the development, implementation, and evaluation of the KTFN curriculum.

Methods

An educational framework was used to guide creation of the KTFN curriculum. Stakeholder interviews, a literature review of KT competency, and environmental scan of capacity building initiatives plus adult learning principles were combined with in-house experience of KT practitioners to inform content and delivery. An evaluation strategy consisting of pre/post-test curriculum and post-session satisfaction surveys, as well as post-curriculum interviews assessed impact on participant knowledge and skills and captured perceived value of KFTN.

Results

The curriculum has been delivered three times over 3 years, with 30 individuals trained, representing healthcare providers, graduate level research trainees, managers, and family advisors. Using the New World Kirkpatrick Model as an analysis framework, we found that the KTFN curriculum was highly valued and shifted learners’ perceptions of KT. Participants identified enhanced knowledge and skills that could be applied to different facets of their work; increased confidence in their ability to execute KT tasks; and intention to use the content in future projects. Barriers to future use included time to plan and conduct KT activities.

Conclusion

KTFN was developed to enhance KT competency among organizational members. This initiative shows promise as a highly valued training program that meets both individual and organizational KT needs and speaks to the importance of investing in tailored KT competency initiatives as an essential building block to support moving evidence into practice.

Peer Review reports

Background

Knowledge translation (KT) in healthcare is a dynamic and iterative process aimed to put evidence into practice [1]. This umbrella term encompasses a number of interrelated activities such as gathering, synthesizing, sharing, and implementing research evidence, with the ultimate goal of improving health-related outcomes at the patient and/or system level [2]. Effective KT practice requires the active participation and collaboration of individuals who research, plan, implement, adopt, and benefit from evidence-based healthcare interventions [3,4,5]. These “knowledge users” may include researchers, operations managers, professional practice leaders, healthcare providers, patients, and families. It is widely acknowledged that successfully enacting KT within healthcare is a complex and challenging process [5] and much effort is being devoted to understand how to build KT capacity.

One area of exploration to advance effective KT practice relates to KT competency development [1, 6,7,8]. Recent work by Mallidou and colleagues [9] identified and formally categorized 16 KT competencies for general practice within the structure of knowledge, skills, and attitude. Examples of KT competencies include understanding KT processes (knowledge), using strategies to share knowledge (skill), and valuing teamwork (attitudes). Aligned with an emphasis on building KT competencies, there has been a growth in curriculum-based initiatives to foster KT practice among knowledge users [9]. The target audiences of these training initiatives vary; some have focused exclusively on a group with a shared background, such as researchers [10] or discipline-specific knowledge users (e.g., occupational therapists [11] or primary care providers [6]). Other initiatives have capitalized on potential benefits of inter-professional learning and collaboration with mixed backgrounds recruited as individuals or teams across healthcare organizations [12, 13].

In a call to action, Holmes et al. [5] highlight the importance of organizational facilitation of KT, speaking to the need for healthcare organizations to build internal capacity to enact KT activities. Capacity building can involve establishing organizational structures and processes [14]. Embedding KT-specific roles (e.g., knowledge brokers, KT specialists) to facilitate staff (i.e., knowledge users) in KT activities is one approach gaining footing [4, 15]. However, even in organizations with devoted KT roles/teams, the number and scope of projects often far exceed the resources available for support; only select KT activities may be undertaken and/or complex KT projects prioritized. Effective KT practice, however, requires the active participation of all those responsible for producing and using knowledge. In addition to organizational structures, efforts to build KT capacity at the individual level are crucial [5, 14]. Increasing the ability of individuals within existing roles to do “better KT” can enhance delivery of evidence-based healthcare overall [5, 14].

Context

Holland Bloorview Kids Rehabilitation Hospital is a large pediatric rehabilitative hospital for children with physical disabilities and complex needs in Toronto, Ontario. As an academic health sciences centre, the hospital recognizes the need to foster the integration of clinical care, research, and education in order to deliver evidence-based, high quality, and compassionate care in day-to-day practice [15, 16]. One key integration initiative aligned with this goal was development of the Centres for Leadership, a project-based funding program aimed at advancing collaborative and innovative solutions in clinical, research and education domains within the Hospital [17].

The Centres for Leadership program empowers multi-disciplinary teams of healthcare providers, researchers, graduate-level trainees, and family advisors to design, test, and implement solutions that will lead to a healthier future for children, youth, and families. To drive knowledge sharing and utilization, project teams are required to plan and execute KT activities with key audiences (typically families, healthcare providers, and researchers) as part of their peer-reviewed funding application. Historically, these KT plans often entailed narrow activities such as traditional peer-reviewed publications and presentations, focusing primarily on academic audiences. In cases where grander plans are proposed, the KT activities are often too ambitious or are pushed off beyond the funding timeframe (i.e., 12 months). Few applications leverage the opportunity to undertake or build a fulsome “KT” project focused on KT product development or planned implementation. There was thus a need for increased KT competency for individuals and teams to forecast additional phases of the work, apply KT frameworks or process models to inform projects, maximize integrated knowledge translation (iKT) principles, optimize awareness of outputs and findings with broad audiences, and produce theory-driven implementation and/or evaluation plans.

Aim

To address this need, provision of a tailored curriculum to foster better understanding and integration of KT into projects, as well as empowering individuals to purposefully seek KT expertise and support was identified. We posit that opportunities to build foundational working knowledge of KT across an organization have the potential to strengthen KT competencies among diverse knowledge users. This aim was strongly endorsed by senior decision makers within the Centres for Leadership and the Hospital’s dedicated KT hub, Evidence to Care (EtC), with a mandate to accelerate evidence-informed decision making through KT practice [15]. A partnership was thus forged to create the Knowledge Translation Facilitator Network (herein called KTFN). The term “facilitator network” was used purposely with a long-term vision of having a network of individuals with increased KT competency who could apply learnings to immediate Centres for Leadership projects, as well as other strategic hospital initiatives to generate impact. In this vein, a specialized KT curriculum focused on competency building was designed and evaluated to meet the needs of the organization’s knowledge users involved in integrated clinical, research and/or educational projects.

Method

This paper reports on curriculum development and results of a mixed-method evaluation. Specific evaluative aims were to (i) explore satisfaction with and perceived value of the curriculum, (ii) assess the impact on KT competencies (knowledge, skills, and attitude), and (iii) determine confidence and intention of the learners to practice KT. Reporting adheres to guidelines provided in the Template for Intervention Description and Replication (TIDieR) [18]; a completed TIDieR checklist is available as a supplementary file.

Evaluative design

A mixed-method, pre/post-test design was used for the first 3 years of delivery. The design was guided by The New World Kirkpatrick Model; a model suited to understanding if training programs deliver the “relevant knowledge and skills to the participants and the confidence to apply them on the job” ([19] , p. 5). This model comprised 4 levels. In the near and short-term, level 1: reaction addresses how favorably learners respond to the training; and level 2: learning focuses on the extent to which they acquire knowledge, skills, confidence, attitudes, and commitment. Level 3: behavior and level 4: results are focused on future behavior once they are back on the job and longer-term impact of their learning on organizational indicators, respectively [19]. As the evaluation was conducted during and immediately after KTFN curriculum delivery, evaluative activities focused on levels 1 and 2: reaction and learning. Appropriate to these levels, methodological triangulation tested the consistency of findings from three data sources: pre/post-test curriculum surveys, short post-curriculum interviews, and post-session satisfaction surveys [20].

Participants

Participants in KTFN were selected based on actively leading strategic or integrated clinical, research, and/or education projects suitable for practical application and a declared professional interest in development of KT competency. No limits were placed on role; all staff including healthcare providers, senior management, students and trainees, research, and family advisors within these project teams were eligible to apply. Interested individuals submitted applications identifying their profession/role within the organization, their Centres for Leadership project, interest in KT competencies, and anticipated application of learnings. Annually, 10 to 15 participants were selected from the 18 to 20 annually funded project teams (average team size ranged from five to 15 members) to foster a small group learning environment.

Curriculum resourcing

In addition to a Manager, Evidence to Care comprises a small team of KT practitioners (one × KT Specialist and two × Knowledge Brokers), all of whom are Masters’ trained in health related disciplines and hold advanced certification in KT practice. The KT Specialist led KTFN development, with additional support from the knowledge brokers around evaluation and session facilitation. Additional in-kind support was provided by the Centre for Leadership Manager, who was responsible for participant engagement and securing managerial approval including release time for clinical staff. Additional funding was provided annually to cover clinical release time, printing of materials, and session refreshments.

Curriculum development and delivery structure

KTFN development was guided by Kern’s (2009) Six-Step Approach for Curriculum Development for Medical Education [21]. Designed for use by curriculum developers responsible for the educational experiences of healthcare professionals, this step-wise approach was an appropriate model given the target audience and delivery context [21]. A detailed account of the steps taken to create the curriculum are provided below.

Step 1: problem identification and general needs assessment

Problem identification has already been articulated earlier in this paper (see “Context” section). From a needs assessment perspective, the following aims were identified: (i) advance KT knowledge and skills across multi-disciplinary teams; (ii) instill value of KT and confidence to foster the integration of KT in clinical care, research, and education initiatives; and (iii) provide opportunities to practice applying KT knowledge and skills.

Step 2: targeted needs assessment of desired KT competencies

Information was collected to better understand KT competency needs within the organization. Senior decision makers in leadershiproles within the Centres for Leadership took part in brief interviews led by the KT Specialist to capture their perspectives, including one physician director, one physician/senior clinical scientist, one scientist, and one clinical director (n = 4). Collectively, they each had been Centre for Leadership Co-Leads and accountable for integration of clinical care, research and education for three or more years. Questions focused on perceived level of understanding of KT among project team members, types of dissemination, and implementation strategies currently being used and intended impact of the new KT curriculum. Gaps identified from these discussions included the lack of awareness and use of KT models, theories, and frameworks in KT planning; the need to use creative dissemination activities to enhance knowledge sharing; the importance of fostering stakeholder engagement (e.g., family advisors, external healthcare providers) in KT planning, product development, and other related activities; and the ability to conduct KT practices beyond dissemination, such as implementation and sustainability initiatives.

To compliment the interviews, a brief literature review of KT competencies, KT mentorship, and knowledge brokering activities was conducted and key findings important to KT practice identified [1, 22,23,24,25] and key findings important to KT practice identified. To further inform curriculum content, an updated environmental scan of readily available curriculum for KT practitioners, KT focused journals, and websites was also completed. An overview of the environmental scan is presented in Table 1.

Table 1 Overview of environmental scan

During the analysis and synthesis of the interviews, literature, and scan, curriculum developers discussed emergent learnings and further identified competency needs based on their own KT practice and experience in the organization.

Step 3: goals and objectives

The overall goals and objectives for the KTFN curriculum were informed by the interviews with the senior decision makers of the Centres for Leadership, external information gathering (literature and scan), and EtC’s contextual expertise of KT competencies required to enact KT. Bloom’s Taxonomy [26] was used as a framework to articulate sessional learning objectives, which focused specifically on the cognitive processes of building KT knowledge and fostering the comprehension and application of KT knowledge. Table 2 provides a description of sessional learning objectives.

Table 2 Focus and learning objectives of KTFN sessions

Step 4: educational strategies

Curriculum delivery was group-based and delivered face-to-face. The KTFN learning environment was established as a collaborative space, wherein participants reflecting different disciplines were brought together to engage in active learning and discussion, critical-thinking, peer learning, reflection, and integration of new perspectives and beliefs related to KT. Table 3 provides a detailed list of the educational strategies informed by adult learning used. As part of curriculum delivery, participants received binders consisting of printed copies of lecture slides, reading lists of seminal papers, and worksheets.

Table 3 KTFN educational strategies

Step 5: implementation

Session delivery occurred in the spring and fall, with a summer break to accommodate scheduling needs of participants. Content was delivered across five to six sessions depending on modifications made annually based on prior cohort feedback. Facilitated by an EtC team member, each 3-h session was structured around three consistent components: (i) educational content delivered by KT practitioners, (ii) an expert guest lecturer in a related topic area, and (iii) active hands-on KT planning to advance participants’ projects. Throughout the sessions, participants applied KT knowledge and principles by working on their own project KT plan using a fillable template provided in curriculum materials. Expectations for active planning included identifying KT goals, determining target audiences, creating key messages, and identifying strategies to support dissemination or implementation initiatives. Each session provided dedicated time as an in-class activity to work through these planning steps. Application of knowledge was demonstrated by participants sharing these completed KT plans in a “showcase activity”; Centre for Leadership Co-Leads and other senior hospital staff engaged in the projects were also invited to this forum. A live KT simulation (designed to encourage participants to synthesize and apply their KT learnings in a realistic situation) offered participants mock opportunities to practice a “KT consult” with colleagues seeking KT guidance [29].

Step 6: evaluation and feedback

As part of evaluative activities, data from three sources were gathered to support triangulation of findings: pre/post-curriculum surveys, short post-curriculum interviews, and post-session satisfaction surveys [20]. Post-curriculum assessment was within 2–4 weeks of KTFN completion capturing application of KT knowledge and skills during the project window. Appropriate to the sample size, descriptive analyses were conducted. Likert scale responses were analyzed using frequency distributions. All data, including open-ended survey responses and interview data were organized and coded according to levels 1 and 2: reaction and learning of the New World Kirkpatrick Model [19], as previously outlined. These codes are presented in parentheses in the results section. Minor curriculum modifications were made annually to continue to enhance program delivery.

Measures

  1. 1.

    Pre/post-curriculum surveys: Participants completed a survey prior to and after the completion of the curriculum, consisting of 13 questions with 5-point Likert scale and open response options to assess changes in knowledge, skills, attitudes, confidence, and behavior. The surveys were developed based on the “retrospective pre/post rating” technique, intended to capture any “response shift” that can happen as a result of a change in understanding of the dimension being rated, that may impact the criteria by which respondents rate themselves in a traditional post-survey [30].

  2. 2.

    Post-curriculum interviews: Brief interviews were also completed after the conclusion of KTFN to gather detailed perspectives of participant experiences and recommendations for curriculum improvements.

  3. 3.

    Post-session satisfaction surveys: After each KTFN session, feedback was gathered using short anonymous satisfaction surveys (16 questions on a 5-point Likert scale with two open text questions) to assess the caliber of KTFN presenters and guest lecturers, session format, content utility, and delivery.

Results

Participants

The program was delivered annually to unique cohorts over a 3-year period, with eight participants enrolled in cohort 1, 12 participants enrolled in cohort 2, and 13 participants in cohort 3. The total sample of 33 participants comprised 19 clinical staff, six non-clinical staff (three managers, two researchers, and one Family Partnerships Specialist), two graduate level trainees and six family advisors. Attrition was very low, with two members in year 2 and one member in year 3 withdrawing for personal reasons; 30 participants completed the full curriculum. Participation in program evaluation activities was voluntary, yielding varied response rates across surveys, sessions, and years of delivery. Response rates were high across the three cohorts: 81.8% (n = 27/33) completed the pre-survey; 60% (n = 18/30) completed the post-survey; and 93.3% (n = 28/30) completed the short post-curriculum interviews. Table 4 offers KTFN cohort and evaluation response rate details.

Table 4 KTFN cohort and evaluation response details

Evaluative findings

New World Kirkpatrick model: level 1—reaction

Applying level 1 of the New World Kirkpatrick Model as a framing tool, data were organized according to how satisfactory (favorable), engaging, and relevant the participants found the training [19].

Satisfaction (favorable), engagement, and relevance

Across all three cohorts of post-session data, 99.3% of respondents “agreed or strongly agreed” that all KTFN sessions were relevant, and 95% of respondents “agreed or strongly agreed” that “the guest presenter and the EtC presenter made the subject matter compelling”; see Table 5 for relevance and presenter data details. One respondent stated in their post-session survey that “I truly enjoyed today as it stimulated my ideas and passion further about my project…[it] inspired me about how/who/when I need to roll it out successfully with sensitivity for for where people are at who are to be impacted.”

Table 5 Session relevance and presenter details

In the interviews, respondents indicated a preference for when guest speakers were closely aligned with the session topic; sessions that were more interactive than didactic; and when concrete, real-life examples were provided. One respondent commented that “the guest speaker allowed me to make connections between session content and practical application (i.e. use of examples) and feedback from others.” Respondents identified the need for more time to engage in discussions with other KTFN colleagues. They also expressed they needed more time to work on their own projects in session, as opportunities for these connections and time to complete their KT plan were limited due to competing work-related priorities.

Respondents indicated that KTFN created the opportunity for KT to become relevant to their funded projects in two ways. First by gradually introducing KT concepts, building their knowledge, and helping them to understand how KT was applicable to their project regardless of its stage of development. Second, KTFN encouraged practical applicability by reserving 1 h of each session for participants to work on their individual KT plans, supporting them to incorporate content learned in real-time. In the post-curriculum survey, 81% (n = 17/21) of respondents “agreed” or “strongly agreed” that the KTFN covered sufficient content to complete and execute a KT plan for their project.

Through the interviews, respondents highlighted that KTFN increased their access to and engagement with a variety of staff, students, and family advisors across the hospital. From an organizational perspective, this allowed them to learn about other projects taking place, with one respondent saying, “I liked the diversity of backgrounds in the program; we were able to learn from each other.” Additionally, KTFN created internal networking opportunities that may not have otherwise occurred, “it’s important for people in the organization to meet us and vice versa, this is a good way to increase face to face relationships with folks and create a learning organization.” The individual presentations in the final session of KTFN were highpoints for all three cohorts.

New World Kirkpatrick model: level 2—learning

In level 2 of the New World Kirkpatrick Model, evaluation efforts focus on participant learning; this was measured through changes in knowledge, skills, attitude, confidence, and intention to use (commitment) knowledge.

Changes in knowledge and skills

All three cohorts identified a positive shift, across pre/post-curriculum collection time points, in their awareness of KT literature and strategies (knowledge). As presented in Table 6, responses changed from “not at all” and “slightly aware” (85.2%, n = 23/27) to “moderately aware” and “extremely aware” (81%, n = 17/21). In open text responses, respondents described “being surprised” to learn that KT is a field underpinned by models, theories, frameworks, and a supporting body of research literature. Through their heightened awareness, they described a deeper appreciation for the potential complexity of KT planning and long-term nature of KT activities.

Table 6 Pre/post survey results from years 1, 2, and 3

After attending KTFN, respondents reported positive shifts in KT skills, stating that the program provided them with the necessary skills to use beyond their project. When asked to rank their KT skill level after attending KTFN, participants identified themselves as “competent” or an “advanced beginner” (95.2%, n = 20/21) versus 59.3% (n = 16/27) in the same categories prior to KTFN (see Table 6).

Respondents further identified that creating and using KT strategies (skills) was no longer viewed as “hard” (n = 0), but rather “neither easy nor hard” (57.9%, n = 11/19) or “easy” (31.6%, n = 6/219) (see Table 6). This was facilitated by having a greater understanding of the types of KT strategies to draw from; recognizing the importance of linking the strategy to the KT goal and needs of the target audience; and having access to resources among learners. One respondent commented that “the biggest change in my thinking has been to incorporate KT from the start of a project and the value of stakeholder partnership.” With another stating that, “KTFN is a hallmark of a learning organization.” Respondents did note that time to plan and conduct KT activities continued to be the biggest barriers and needs to enable future KT work.

Change in attitudes

When prompted to respond to the following statement, “using KT to implement and share findings from Centres for Leadership projects is important to me,” responses did not shift greatly across the pre/post collection time points. High value (attitudes) was already placed on KT prior to attending KTFN: pre-KTFN, 96.1% (n = 25/26) selected “very or extremely important” and post KTFN, this number remained constant at 95% (n = 20/21) (see Table 6). A shift was noted in the timing of KT activities, however. Prior to participating, respondents identified that they understood KT activities as occurring at the end of a project, primarily through end-of-grant (eKT) dissemination activities such as manuscripts and conferences. After KTFN, participants described that they now understood KT activities as a series of iKT processes that occur at the beginning of the project and not as a project “add-on”; further commenting that “before I only thought about eKT, now I think about iKT as soon as an idea is generated, I’m more explicit….”

Generally, respondents developed a heightened awareness of stakeholder engagement and agreed that involving stakeholders in the initial phases of project development was important. KT-oriented thinking shifted from considering KT as “one activity” and moving toward understanding it as a “collection of activities” and strategies that vary across projects. Participants highlighted a better connection with the in-house KT team after attending KTFN, commenting, “I think now I have a beginner's framework and a working relationship with the [EtC] team for consultation. Certainly, I’m beginning to understand what I don't understand, where I can find the information, and who might be able to help me refine ideas.”

Change in confidence

In the post-curriculum survey, respondents identified that the KTFN curriculum increased their confidence to effectively perform different KT tasks as part of their role on their project (see Table 6). Confidence was also captured in post-session surveys following the KT simulation (added in year 2 of curriculum delivery); 100% (n = 17/17) of respondents indicated that it gave them the confidence to apply KT concepts in practice, commenting that it helped them to “practice the [KT] language and how to talk to others,” and become a KT champion for their colleagues.

Intention to use KT information (commitment)

Prior to participating in KTFN, 11 out of 24 (45.8%) of respondents had experience using KT strategies and executing activities to put evidence into practice; notably, these were primarily dissemination focused activities (i.e., conference presentations, publishing, media outlets). Since attending KTFN, 90.5% (n = 19/21) of respondents have or plan to use a KT strategy (commitment) to move evidence into practice for their project (see Table 6). The simulation activity in session 6 was again noted as valuable to participants to help them understand “their role as a future KT champion” and how to handle potential “KT push back” from colleagues on future projects.

Curriculum improvements

Course content was reviewed annually utilizing the evaluative feedback and new literature in the KT field, and modified to reflect user needs. Modifications included removing homework after year 1; increasing the variety of interactive activities throughout the sessions; enlisting new guest speakers to better reflect session topics, adding yearly KT “knowledge burst” emails, and shifting relative emphasis of practical and theoretical aspects of the course.

Discussion

The Knowledge Translation Facilitator Network was designed to address an organizational need for enhanced KT competencies among staff. The results demonstrate that KTFN shows progress toward achieving this goal. Overall, KTFN was met with a high degree of satisfaction in curriculum delivery and overall perceived satisfaction. Though literature around KT competency has grown since the initial inception of this curriculum, many of KTFN’s competency goals parallel Mallidou et al.’s [9] recently formalized conceptualization of KT competencies and were similarly categorized into the areas of knowledge, skills, and attitude. More specifically, KTFN focused on KT knowledge, which fostered a shift in learners’ self-perceptions of being a KT “novice” to greater perceptions of confidence, with many moving to the level of an “advanced beginner” in their awareness and understanding of KT practice. Further to skill building, participation resulted in an enhanced appreciation of the importance of KT as part of their day-to-day work, as well as confidence in their ability to execute KT activities. Findings in this study align with existing literature on training initiatives focused on KT competency building where participants experienced positive changes in KT knowledge, skills, and attitudes [12, 13].

The delivery structure of KTFN was identified as a key element of its success. As suggested by Holmes et al. [31], creative, practical, and workshop-based approaches are better suited to meet KT training needs than didactic training alone. In this study, content experts and facilitators (e.g., KT specialist, knowledge brokers, and guest lecturers) helped bring the material to life through a pragmatic and context-specific lens using educational strategies such as KT planning exercises, think-pair-share, and case-scenarios. Simulation was also integrated into KTFN as previous literature demonstrates that it can drive knowledge uptake and support skill development within healthcare [32]. We found that simulation supported participant confidence to apply acquired KT knowledge and concepts, similar to other studies that examined the benefits of using this strategy to facilitate KT competency [33].

Furthermore, the requirement of KTFN participants to be engaged in an actively funded project and dedicated time within sessions to work on applying session content in real-time to these projects was an essential curriculum component. This is in line with other training initiatives that highlight the importance of facilitating connections between curriculum content and participants’ projects [12, 13]. An important caveat to note is that some participants found this challenging as their new knowledge led them to reconsider early project design decisions. In some cases, projects could be modified but in others, this was not viable, especially in the case of missed opportunities for stakeholder engagement at project onset, a fundamental aspect of KT. This learning further supports the need for organizational KT competency building to strengthen internal strategic projects moving forward.

KT capacity building within an organization is complex as there are dynamic and interrelated forces at play, including individual and contextual factors. From an organizational perspective, KT capacity can be supported by creating opportunities for its members to interact with KT theories, models, and frameworks. Promoting a culture of shared values and attitudes, enabling engagement in shared practices, and fostering the exchange of ideas and learnings among organizational members is also instrumental [4, 5, 14]. We found that KTFN contributed to these important mechanisms. Participants were oriented to and reflected on foundational KT knowledge (e.g., theories, models, frameworks, principles, strategies) and expressed intention to apply this information.

Additionally, the purposive selection of educational strategies that focused on articulating how KT (i) can be enacted successfully within the internal context and (ii) enables broader organizational goal attainment reflects this organizational capacity building approach. Bringing together a small cohort of learners representing healthcare providers, researchers, trainees, and family advisors allowed various perspectives and experiences to be shared and connections among related work identified. More specifically, participants were able to collaborate with organizational members outside of their typical teams, learn about other initiatives across the organization, and share experiences, challenges, and solutions related to their projects. KTFN also afforded increased interaction between EtC and other members of the organization. Participants reported increased intent to pursue more regular consultation with the in-house KT team moving forward with projects. This form of sustained expertise seeking and/or mentorship from the EtC team is purported as another potential mechanism for facilitating organizational capacity development [4].

Some unanticipated benefits of KTFN participation were also observed. Respondents also valued the opportunity to practice presentation skills in showcasing their projects. Participating in KTFN helped participants appreciate how they were already engaging in eKT activities in a variety of ways but previously did not recognize it as such. They also gained a broader understanding of iKT. This kind of realization, combined with enhanced knowledge and awareness of resources to support KT planning, implementation, and evaluation helped respondents take greater ownership in directing KT aspects of their current projects.

This evaluation does have some limitations. This was a relatively small cohort and though response rates were acceptable, participants may have been biased toward positive responses and there were few non-respondents. Participants were also a highly motivated group of learners intent on growing their competencies. Similar to the findings of Carlfjord et al. [34] in their evaluation of an annual course, participants may be “self-selected” and thus autonomously driven among a group with shared interests, leading to positive experiences. Data collected focused on levels 1 and 2 of the Kirkpatrick Model; longer-term evaluative activities could explore impact longitudinally to determine the extent to which learnings were integrated into future states of participant existing projects as well as new projects. While these data were used in annual accountability reporting and to support requests for renewed curriculum funding for ongoing organizational support, more in-depth follow-up interviews with Centre for Leadership Co-Leads may also yield insightful perspectives on tangible shifts in KT practice.

Conclusion

Investing in individual KT competency building is an important foundational step in institutionalizing KT within an organization. KTFN facilitated individual change and helped KT gain further momentum at an organizational level. Though we are moving in the right direction, the organization has not reached a point where KT practices are fully integrated and continued focus and energy is needed. Ongoing efforts include engaging the KTFN champions through monthly alumni email blasts to share seminal articles and resources on a given KT topic, hosting annual KT booster workshops for new knowledge and skill development, as well as opportunities to consolidate existing skills. With these ongoing efforts, we aim to continue to expand KT knowledge, skills, and practice across the organization to enhance the lives of children, youth, families, and staff at Holland Bloorview.

Availability of data and materials

Not applicable.

Abbreviations

KT:

Knowledge translation

KTFN:

Knowledge Translation Facilitator Network

EtC:

Evidence to care

eKT:

End-of-grant KT

iKT:

Integrated KT

References

  1. Straus SE, Brouwers M, Johnson D, Lavis JN, Légaré F, Majumdar SR, et al. Core competencies in the science and practice of knowledge translation: description of a Canadian strategic training initiative. Implement Sci. 2011;9(6): 127. Available from: https://0-doi-org.brum.beds.ac.uk/10.1186/1748-5908-6-127.

  2. Tricco AC, Ashoor HM, Cardoso R, MacDonald H, Cogo E, Kastner M, et al. Sustainability of knowledge translation interventions in healthcare decision-making: a scoping review. Implement Sci. 2016; 21(11):55. Available from: https://0-doi-org.brum.beds.ac.uk/10.1186/s13012-016-0421-7.

  3. Canadian Institute of Health Research. Guide to knowledge translation planning at CIHR: integrated and end-of-grant approaches. https://cihr-irsc.gc.ca/e/45321.html. [Accessed 25 Mar 2020].

  4. Kislov R, Waterman H, Harvey G, Boaden R. Rethinking capacity building for knowledge mobilization: developing multilevel capabilities in healthcare organisations. Implement Sci. 2014;9(166). Available from: https://0-doi-org.brum.beds.ac.uk/10.1186/s13012-014-0166-0.

  5. Holmes BJ, Davies A, Hunter H, Kelly D, Marshall M, Rycroft-Malone J. Mobilising knowledge in complex health systems: a call to action. Evidence & Policy. 2017;13(3):539-560. Available from: https://0-doi-org.brum.beds.ac.uk/10.1332/174426416X14712553750311.

  6. Greenhalgh T, Russell J. Promoting the skills of knowledge translation in an online master of science course in primary health care. J Contin Educ Heal Prof. 2006 Spring;26(2):100-108. Available from: https://0-doi-org.brum.beds.ac.uk/10.1002/chp.58.

  7. Meissner HI, Glasgow RE, Vinson CA, Chambers D, Brownson RC, Green LW, et al. The U.S. training institute for dissemination and implementation research in health. Implement Sci. 2013;8(12). Available from: https://0-doi-org.brum.beds.ac.uk/10.1186/1748-5908-8-12.

  8. Proctor EK, Landsverk J, Baumann AA, Mittman BS, Aarons GA, Brownson RC, et al. The implementation research institute: training mental health implementation researchers in the United States. Implement Sci. 2013; 8(10). Available from: https://0-doi-org.brum.beds.ac.uk/10.1186/1748-5908-8-105.

  9. Mallidou AA, Atherton P, Chan L, Frisch N, Glegg S, Scarrow G. Core knowledge translation competencies: a scoping review. BMC Health Serv Res. 2018;18(1): 502. Available from: https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-018-3314-4.

  10. Tait H, Williamson A. A literature review of knowledge translation and partnership research training programs for health researchers. Health Res Policy Sys. 2019;17:98. Available from: https://0-doi-org.brum.beds.ac.uk/10.1186/s12961-019-0497-z.

  11. Eames S, Bennett S, Whitehead M, Fleming J, Low SO, Mickan S, et al. A pre-post evaluation of a knowledge translation capacity-building intervention. Aust Occup Ther J. 2018:65(6):479-493. Available from: https://0-doi-org.brum.beds.ac.uk/10.1111/1440-1630.12483.

  12. Park JS, Moore JE, Saya R, Holmes BJ, Scarrow G, Graham ID, et al. Evaluation of the “foundations in knowledge translation” training initiative: preparing end users to practice KT. Implement Sci. 2018;13(63). Available from: https://0-doi-org.brum.beds.ac.uk/10.1186/s13012-018-0755-4.

  13. Moore J, Rashid S, Park J, Khan S, Straus S. Longitudinal evaluation of a course to build core competencies in implementation practice. Implement Sci. 2018;13. Available from: https://0-doi-org.brum.beds.ac.uk/10.1186/s13012-018-0800-3.

  14. Cherney A, Head B. Supporting the knowledge-to-action process: a systems-thinking approach. Evidence & Policy. 2011;7(4):471-488. Available from: https://0-doi-org.brum.beds.ac.uk/10.1332/174426411X603461.

  15. Kingsnorth S, Orava T, Parker K, Milo-Manson G. From knowledge translation theory to practice: developing an evidence to care hub in a pediatric rehabilitation setting. Disabil Rehabil. 2019;8:1-11. Available from: https://0-doi-org.brum.beds.ac.uk/10.1080/09638288.2018.1514075.

  16. King G, Thomson N, Rothstein M, Kingsnorth S, Parker K. Integrating research, clinical care, and education in academic health science centers: an organizational model of collaborative workplace learning. J Health Organ Manag. 2016;30(7):1140-1160. Available from: https://0-doi-org.brum.beds.ac.uk/10.1108/JHOM-11-2015-0177.

  17. King G, Parker K, Peacocke S, Curran CJ, McPherson AC, Chau T, et al. Centres for leadership: a strategy for academic integration. J Health Organ Manag. 2017;31(3): 302-16. Available from: https://0-doi-org.brum.beds.ac.uk/10.1108/JHOM-11-2016-0225.

  18. Hoffmann T, Glasziou P, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.

    Article  Google Scholar 

  19. Kirkpatick DJ, Kayser-Kirkpatrick W. Four levels of training evaluation. Virginia: ATD Press; 2016.

    Google Scholar 

  20. Better Evaluation. Triangulation. https://www.betterevaluation.org/en/evaluation-options/triangulation [Accessed 25 March 2020].

  21. Kern DE, Thomas PA, Hughes MT. Curriculum development for medical education: a six-step approach. 2nd ed. Baltimore: The John’s Hopkins University Press; 2009.

    Google Scholar 

  22. Glegg S. Knowledge brokering as an intervention in paediatric rehabilitation practice. Int J Ther Rehabil. 2010;17(4):203-211. Available from: https://0-doi-org.brum.beds.ac.uk/10.12968/ijtr.2010.17.4.47314.

  23. Bornbaum CC, Kornas K, Peirson L, Rosella LC. Exploring the function and effectiveness of knowledge brokers as facilitators of knowledge translation in health-related settings: a systematic review and thematic analysis. Implement Sci. 2015;20(10):162-171. Available from: https://0-doi-org.brum.beds.ac.uk/10.1186/s13012-015-0351-9.

  24. Gagliardi AR, Webster F, Straus SE. Designing a knowledge translation mentorship program to support the implementation of evidence-based innovations. BMC Health Serv Res. 2015;15:198. Available from: https://0-doi-org.brum.beds.ac.uk/10.1186/s12913-015-0863-7.

  25. Newman K, Van Eerd D, Powell BJ, Urquhart R, Cornelissen E, Chan V, et al. Identifying priorities in knowledge translation from the perspective of trainees: results from an online survey. Implement Sci. 2015;10:92. Available from: https://0-doi-org.brum.beds.ac.uk/10.1186/s13012-015-0282-5.

  26. Bloom BS. Taxonomy of educational objectives: cognitive domain. New York: Longman; 1984.

    Google Scholar 

  27. Kaddoura M. Think pair share: a teaching learning strategy to enhance students' critical thinking. Educ Res Q. 2013;36(4):3–24.

    Google Scholar 

  28. Ontario Centre of Excellence for Child and Youth Mental Health. Resource hub. https://www.cymh.ca/en/index.aspx. [Accessed 25 March 2020].

  29. Evidence to Care. Holland Bloorview Kids Rehabilitation Hospital. Knowledge Translation Simulations. https://www.hollandbloorview.ca/research-education/knowledge-translation-products/knowledge-translation-simulations. [Accessed 25 Mar 2020].

  30. Skeff MK, Stratos AG, Bergen RM. Evaluation of a medical development program. A comparison of traditional pre/post and retrospective pre/post self-assessment rating. Evaluation & The Health Professions. 1992;15(3):350-366. Available from: https://0-doi-org.brum.beds.ac.uk/10.1177/016327879201500307.

  31. Holmes BJ, Schellenberg M, Schell K, Scarrow G. How funding agencies can support research use in healthcare: an online province-wide survey to determine knowledge translation training needs. Implement Sci. 2014;9(71). Available from: doi.org/10.1186/1748-5908-9-71.

  32. Harder, B.N. Use of simulation in teaching and learning in health sciences: a systematic review. J Nurs Educ. 2010;49(1):23-28. Available from: https://0-doi-org.brum.beds.ac.uk/10.3928/01484834-20090828-08.

  33. Ungar M, Whitman S, Hart A, Phipps D. Simulation as a tool for developing knowledge mobilisation strategies: innovative knowledge transfer in youth services. International Journal of Community Research and Engagement. 2015;8(1):100-117. Available from: https://0-doi-org.brum.beds.ac.uk/10.5130/ijcre.v8i1.3676.

  34. Carlfjord S, Roback K, Nilsen P. Five years’ experience of an annual course on implementation science: an evaluation among course participants. Implement Sci. 2017;12. Available from: https://0-doi-org.brum.beds.ac.uk/10.1186/s13012-017-0618-4.

Download references

Acknowledgements

The authors acknowledge the support of former Evidence to Care member, Julia Schippke, for assistance in the development and delivery of the KTFN curriculum. We also thank Stacey Carey, an external KT expert for helping inform early curriculum development.

Funding

Funding for the KTFN initiative was provided by the Centres for Leadership and Evidence to Care with support from Holland Bloorview Kids Rehabilitation Hospital Foundation.

Author information

Authors and Affiliations

Authors

Contributions

CP, SP, and SK developed the funding proposal. CP conceptualized and designed the overarching curriculum. CP, AT, JW, and SK designed and delivered curriculum content. AT developed the evaluation strategy and administered, collected and analyzed evaluation data from surveys and interviews. CP, AT, JW, and SK were all major contributors in the manuscript. SP provided critical feedback on early drafts. All authors have read and approved the final manuscript.

Corresponding author

Correspondence to Christine Provvidenza.

Ethics declarations

Ethics approval and consent to participate

Ethics approval was not required to deliver and evaluate the educational curriculum.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

The TIDieR (Template for Intervention Description and Replication) Checklist*.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Provvidenza, C., Townley, A., Wincentak, J. et al. Building knowledge translation competency in a community-based hospital: a practice-informed curriculum for healthcare providers, researchers, and leadership. Implementation Sci 15, 54 (2020). https://0-doi-org.brum.beds.ac.uk/10.1186/s13012-020-01013-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s13012-020-01013-y

Keywords