Methods
Participants
Family Medicine residents (n = 22; out of 30 potential residents) and faculty (n = 7; out of 7 potential faculty) from a medium-sized, urban, midwestern program participated. Participants were recruited by email and from weekly didactics. Didactics are a required component of residency training; however, residents on inpatient service, postcall, vacation, away rotation, or those who are ill may not be in attendance.
Inclusion criteria included residents in attendance during sessions. Also, the program faculty roster was used to invite faculty participation. The following were excluded from the study: learners who were not Family Medicine faculty or residents (ie, medical students). The Family Medicine residency program agreed to participate in the project as a pilot study though individual participation was voluntary.
Electronic written consent was obtained from participants. On August 26, 2022, the Institutional Review Board at Wright State University, the ACGME sponsoring institution, found this research proposal (Study 7293) to protect the rights and welfare of human subjects and to meet the requirements of Wright State's Federal Wide Assurance (FWA 00002427) and the federal regulations for the protection of human subjects in research (eg, 2018 45 CFR 46.104).
Pre-existing curriculum
The Family Medicine residency program, which served as a pilot, provides an online patient safety curriculum completed during resident orientation. The program has a longitudinal wellness curriculum that involves the development of a personalized wellness plan (updated each year) and provides a wellness session specific to medical error (second year) as well as a dedicated didactic session on disclosure training (given once every 3 years). In addition, morbidity and mortality talks are given by the chief of service each month, which provides an opportunity to discuss medical errors. Local rotation sites have policies related to medical error and disclosure.
Presession
Residency faculty were approached for willingness to share a story of a personal medical error and its aftermath. Once a faculty presenter was identified, they were given guidance on the story's length and overall objectives. Preintervention survey was sent to residents to complete prior to session 1.
Sessions
During session 1, the faculty presenter shared their story with the residents. After the story was shared, the facilitator guided residents in reflection using the following prompts: Why did this happen? What did the physician feel/do? What would you do? Did the physician recover; how? Did the patient recover? Did anyone learn from the mistake? What surprised you? In addition, the facilitator presented a small amount of lecture material, facilitated small and large group discussions, and prompted timed self-reflection through writing. Session 2 used a discussion of key related professional values to stimulate interest in the topic of error and a sense of related culture norms as well as open discussion of related fears and barriers to impact confidence in error disclosure. The faculty presenter introduced safety culture, and residents had the opportunity to reflect on the strengths and weaknesses of the current practice culture. In session 3, the faculty presenter reviewed local institutional policies and procedures related to medical error. The residents practiced self-awareness, error disclosure, root cause analysis, and coping skills.
Each session was presented during resident didactic time and lasted one hour. Sessions were presented over 6 months: the first in August 2022, the second in November 2022, and the final in January 2023.
Survey tool and collection
Researchers developed a survey to assess resident knowledge, experience, beliefs, values, and behaviors in the context of medical error (see Supplementary Data for Survey). Survey tool responses included free text, Yes/No/Don’t know, and Likert scale (see Supplementary Data for Survey tools). The resident preintervention survey invitation was sent out prior to session 1 in August, and this survey closed at the start of session 3 (to capture responses from residents not present for previous sessions). The postintervention survey invitation was sent out after our final session and closed on February 10, 2023. Survey responses, including consent, were collected electronically using REDCap (Research Electronic Data Capture), a software toolset and workflow methodology for the electronic collection and management of research data. Anonymous responses were analyzed and compared.
Statistical analysis
We used count data as well as Wilcoxon signed-rank tests for numeric variables and McNemar's test for binary variables to compare presurvey and postsurvey responses. Sample size/power analysis was not calculated for this study. The data analysis for this article was generated using Excel and SAS software©. The reporting of this study conforms to the STROBE Cohort guidelines statement
47 (see Supplemental File for checklist).
Results
Response rate
Twenty-two (73%) residents completed the preintervention survey, and 15 (50%) completed the postintervention survey. Seven residents completed presurvey and postsurveys that were able to be matched. Of the 15 residents who completed a postintervention survey, 1 attended only 1 of the sessions, 5 attended 2, and 9 attended all 3. Additionally, 7 out of 7 faculty completed a preintervention faculty survey.
Results by count
Preintervention responses demonstrated strengths and opportunities for improvement in the pre-existing curriculum. Most residents reported having experienced errors (55%, n = 12 out of 22) and having had a mentor or peer share an error story with them (73%, n = 16 out of 22). Among those with an error experience (n = 12 out of 22 respondents), 10 (83%) reported the error was disclosed to the patient. Many residents with error experience reported that their team or organization learned from the error (75%, n = 9 out of 12), and error acknowledgement and debriefing by the team were common (92%, n = 11 out of 12 and 83%, n = 10 out of 12, respectively). When compared with residents, a higher percentage of faculty reported confidence with error disclosure (I can be honest about errors that I make as a doctor, 100%, n = 7 out of 7, faculty vs 83%, n = 19 out of 22, resident respondents). A higher percentage of faculty also reported confidence with personal recovery (I can recover after a medical error, 100%, n = 7 out of 7 faculty vs 78%, n = 18 out of 22 residents) and relationship recovery (patient-physician relationships can recover after a medical error, 100%, n = 7 out of 7 faculty vs 87%, n = 20 out of 22 residents).
Postintervention survey responses demonstrated an increase in several reported target factors: knowledge of local procedures, disclosure confidence, accessing support as an error response, faculty and peer story sharing and acknowledgement that mentors have made errors. Specifically, reported knowledge of local procedures (I know what to do at my institution when faced with a medical error) increased from 46% (n = 10 out of 22) to 93% (n = 14 out of 15; see
Figure 1).
While all participants (residents and faculty) reported good doctors should disclose error, disclosure self-efficacy among residents (I can be honest about errors) increased after intervention from 86% (n = 19 out of 22) to 93% (n = 14 out of 15 (
Figure 2).
Resident self-awareness (I acknowledge when I am at increased risk for error) increased after intervention from 77% (n = 17 out of 22) to 93% (n = 14 out of 15).
Postintervention survey responses also showed an increase in residents reporting reaching out to others as an error response, from 36% (n = 8 out of 22) to 87% (n = 13 out of 15). After intervention, rates of reported faculty and peer story sharing increased, and resident-reported awareness that mentors have experienced error increased from 68% (n = 15 out of 22) to 87% (n = 13 out of 15) (
Figure 3). Incidentally, all faculty respondents reported “I have made errors in my care for patients”.
Debriefing with the team remained common, but the rate of residents reporting “feeling bad about myself” as an error response increased from 41% (n = 9 out of 22) to 60% (n = 9 out of 15). Six residents out of 15 (40%) reported an emotionally difficult rating of 5 or greater for the curriculum. Overall, residents reported the training was helpful (
Figure 4).
Before the intervention, residents were most interested in further training through personal stories of mentor error (73%, n = 16 out of 22), and after the intervention, residents reported the most interest in additional training in legal and malpractice risk (73%, n = 11 out of 15).
Tests for statistical significance
While postintervention responses showed increased rates for several target beliefs and reported knowledge, results did not reach statistical significance (
Table 3).
Qualitative results
Free text responses describing resident approaches to processing error included “tried not to let the same error recur” and “stages of grief.” Residents also commented on the importance of patient harm (or lack thereof) for their response: “Dose was non-lethal and had no adverse effect, so not much was made of it. It could have been a huge deal.” One resident out of 22 described the process for disclosing to the patient: “privately with attending,” while others commented “not sure above me” or answered “don’t know.”
Discussion
Most residents reported having had experience with team or personal error, confirming the importance of medical error education and training. All residents (preintervention and postintervention) and faculty reported that good doctors should be honest about their errors, suggesting this belief may be a less important target for intervention. The literature has shown a disconnect between this belief, intent to disclose, and actual disclosure rates.
46 In a 2023 study of healthcare educators, Wawerski et al found that individual personalities, beliefs and perceptions of the organizational or team culture, as well as moral courage, impact decisions that healthcare workers make in terms of disclosing medical error.
48 Therefore, beyond resident attitudes and beliefs, resident and patient-oriented outcomes are an important next step in curriculum assessment (eg, resident milestones data, error reporting rates at primary rotation sites, institutional patient safety survey information, and objective assessment of resident skill with disclosure).
To provide patient-centered care, disclosing medical errors to patients and families should be timely, explicit, and empathetic.
32 Our study did not directly evaluate knowledge and skills of effective disclosure (instead using resident reports of knowledge and confidence), but this is a key area for future work. Barriers to fully disclosing an error include the culture of perfection in medicine, the psychological impact of facing mistakes and apologizing for them, ethical complexities (level of harm done), lack of formal training on disclosing medical error, and fear of malpractice litigation.
32,49In our study, residents requested further training in legal and malpractice concerns (postintervention). This shift in interest could indicate a deficiency in the curriculum, or a natural, next-step shift, but certainly highlights the importance of this topic for residents and a potential source of curriculum development in the future.
We hypothesized that residents would report higher self-efficacy on the postintervention questionnaire. While rates increased, we could not confirm this increase with statistical certainty. Surprisingly, the rate of residents who report feeling bad about themselves after an error also increased. Perhaps the act of addressing this subject as a group was emotionally charging. In their study of a longitudinal curricular intervention, Fox et al
15 found that the incorporation of frequent reporting and discussion of medical errors improves patient care and improves the safety and comfort of residents during their training process. Incorporating regular and routine error reporting and discussion may help better support residents during future curriculum iterations but will require faculty development and minor changes in basic practices like rounding.
Residents who recognize that they made a medical error experience a profound emotional response, leading to engagement in various coping strategies.
7 Emotional responses from residents can occur during involvement in harmful interactions, patient injury, and unexpected negative events, leading to self-blame.
50 This underscores the importance of including resident support resources during the sessions themselves, as well as ongoing venues for support and “talk” surrounding medical error. Few studies have explored what coping mechanisms medical residents use after a self-perceived medical error, which could prove to be a meaningful focus for future research.
Limitations of our study centered on the desire to develop a comprehensive curriculum and a limited sample size. Sample size/power analysis was not calculated for this study, limiting generalizability. The questionnaires used were not previously validated; however key targets were selected from the literature to develop questionnaire items, and face validity was considered. This study does not allow specific curricular components to be associated with changes in resident responses. Similarly, the complexity of error response and the scope and time for our study limited our ability to associate our curriculum with specific changes in rates of error reporting, disclosure, access to formal support, objective knowledge and skill measures, or patient-oriented outcomes like satisfaction with error disclosure or care relationship after error. The study's time frame allowed only for short-term reassessment of survey responses, which could differ from long-term impacts.
We plan to refine the curriculum based on outcomes from this project and consider outreach to residencies in other specialties for interdisciplinary didactics. Residents will benefit from an increase in the variety of actual cases to process together, and this curriculum will take time to strengthen behavioral norms around error. The medical community will benefit from further refining the model for error management and growth behaviors among residents.
Further work should also focus on the integration of curriculum into daily practice, which appears critical to fostering a growth response among physicians and better outcomes for patients. This can involve simple changes to patient rounds, like adding the question “were there any patient safety concerns overnight?”.
15 In addition, using every error as an opportunity to role model effective error management and recovery and to engage residents in this process will require faculty development in this area.
51 Efforts may be catalyzed by elevating error management and recovery as a seventh core competency for graduate medical education
52 and a re-emphasis on professional formation at all levels of medical education.
53