0
1
BRIEFREPORT   |    
Psychiatric Residents’ Self-Assessment of Teaching Knowledge and Skills Following a Brief “Psychiatric Residents-as-Teachers” Course: A Pilot Study
Tana A. Grady-Weliky, M.D.; Linda H. Chaudron, M.D., M.S.; Sue K. DiGiovanni, M.D.
Academic Psychiatry 2010;34:442-444. 0610076g
View Author and Article Information

Received June 1, 2009; revised September 1 and November 5, 2009; accepted November 8, 2009. Dr. Grady-Weliky is affiliated with the Department of Psychiatry at Oregon Health and Science University School of Medicine in Portland, Oregon; Dr. Chaudron is affiliated with the Department of Psychiatry at University of Rochester in Rochester, New York; Dr. DiGiovanni is affiliated with the Department of Psychiatry at University of Rochester Medical Center in Rochester. Address correspondence to Tana A. Grady-Weliky, Oregon Health and Science University, Department of Psychiatry, OHSU School of Medicine, 3181 SW Sam Jackson Park Rd., Portland, OR 97239; gradywel@ohsu.edu (e-mail).

Copyright © 2010 Academic Psychiatry

Abstract

Objective: Resident physicians have an important role in medical student teaching. There has been limited curriculum development in this area for general psychiatric residents. A 4-hour workshop for PGY-2 psychiatric residents was designed and implemented to improve residents’ self-assessment of their knowledge of the medical student curriculum and core teaching skills. Methods: Residents completed pre- and postcourse self-assessments of their knowledge, skills, attitudes, and values about teaching. Descriptive statistics were obtained on pre- and postcourse data and were analyzed using t tests assuming unequal variance. Results: Following course participation, there was statistically significant improvement in residents’ self-assessment of their knowledge of the medical student curriculum (p≤0.001), their self-assessment regarding perception of peers’ view of their teaching ability (p≤0.02), and their perceived knowledge of various teaching methods (p≤0.02). Conclusion: Our findings suggest that a brief workshop may enhance psychiatric residents’ self-assessment of teaching knowledge and skills.

Abstract Teaser
Figures in this Article

Teaching is a core component of being a physician. Physicians are responsible for teaching medical students, residents, and peers in addition to teaching patients and families. It has been demonstrated that resident physicians provide substantial medical student teaching, particularly in clinical settings (1). Therefore, a residents-as-teachers’ curriculum which incorporates learning objectives that address knowledge, skills, attitudes and values related to teaching is an essential component of residency education.

There has been limited work with regard to psychiatric resident-as-teacher program development (2, 3). The “Psychiatry Residents as Teachers” guide created by the APA Committee on Graduate Medical Education provides basic information on teaching and feedback along with a list of resources and references (4). The Association of American Medical Colleges (AAMC) Group on Resident Affairs (GRA) has also created web-based materials on developing teaching skills for residents from all medical specialties (5). The utilization of the APA guide or the AAMC-GRA program is unknown. The primary goals of this pilot study were to investigate whether participation in a brief psychiatric residents-as-teachers course improved junior psychiatric residents’ knowledge of the medical student curriculum and their perceived core teaching skills.

This interactive course is comprised of two 2-hour long sessions held in July of the PGY-2 year. Course learning objectives are describe the background and components of the medical student curriculum; describe key learning theories; identify practical teaching skills; distinguish feedback, evaluation, and assessment; and demonstrate how to give effective feedback.

An overview of the medical school curriculum at University of Rochester School of Medicine and Dentistry and a discussion of the important roles that residents have in medical student teaching comprise the initial hour of the workshop. The second hour is devoted to review of small- and large-group teaching and adult learning principles. A description of the one-minute preceptor clinical teaching method (6) and key feedback principles and methods, such as “RIME—Reporter, Interpreter, Manager, and Educator” (7), comprise the third hour of the workshop. The final hour is a detailed overview of the psychiatry clerkship. It includes the clerkship learning objectives as well as the resident roles and responsibilities for medical student teaching and evaluation. The workshop ends with the opportunities for residents to practice feedback using paper-based trigger cases.

Twelve PGY-2 general psychiatric residents participated in this 4-hour workshop over the course of three academic years (July 2002–July 2005). Ten residents completed a written precourse self-assessment survey, and all 12 residents completed a postcourse self-assessment survey. Completion of the survey demonstrated resident consent to participate in this educational study. As an educational pilot study it was exempt from institutional review board approval.

The 12-item Likert-type self-assessment instrument was modeled on one from the Department of Pediatrics (personal communication, Robert Swantz, M.D., 2002). A question regarding the resident’s understanding of the undergraduate medical school curriculum was added to the original survey. Residents anonymously responded to the statements about teaching shown in Table 1.

Descriptive summary statistics were obtained on pre- and postcourse survey data. These data were analyzed using t tests assuming unequal variance to ascertain if there was significant difference in residents’ self-assessment of their knowledge, attitudes, values, or skills about teaching after completion of the course (Table 1).

Nearly all residents agreed or strongly agreed that the development of teaching skills is important to professional development. Teaching as a core value was demonstrated by a precourse mean of 4.5 (SD=0.71) and a postcourse mean of 4.8 (SD=0.39) (p>0.05).

Statistically significant improvement following course participation was noted in specific domains of knowledge and perceived skills. Residents’ reported knowledge of the undergraduate medical school curriculum was markedly improved (p<0.001). Several items related to residents’ self-assessment of their teaching skills were improved following participation in the course: I can apply two different teaching methods (p<0.001); I can describe and evaluate my teaching techniques (p<0.002); and I have a plan for improving my teaching skills (p=0.016).

Resident attitudes regarding their level of comfort teaching students and peers and their perception of how others would evaluate their teaching skills also changed following course participation. There was significant improvement in residents’ assessment of their comfort level teaching medical students (p<0.04) and their perception of how interns or residents would evaluate their teaching (p<0.03).

Our findings suggest that residents’ knowledge, attitudes, and perceived skills about teaching, including their perceived knowledge of the undergraduate medical student curriculum, may improve after a brief workshop. It is possible that residents’ improved understanding of the medical student curriculum will enhance medical students’ experience since residents should be able to teach students at a more appropriate level. However, this requires further evaluation.

Additionally, our findings suggest that residents’ self-assessment of their teaching skills improved after course participation. This is consistent with a recent study examining the role of a 1-day residents-as-teachers workshop for first-year residents across multiple specialties (8). An examination of their actual ability to apply different teaching methods and to describe and evaluate teaching techniques is the necessary next step. Moreover, formal evaluation of the residents’ assessment of their increased ability to create a plan for improving teaching skills is necessary to know that participating residents will utilize course experiences for lifelong learning.

There are several limitations of this pilot study. Our findings are from a single institution in a small residency program (maximum of 16 residents across the 4 years). Moreover, the evaluation tool is a pre- and postcourse self-assessment and is not a validated instrument. There are no other correlations to verify that participation in the workshop led to the change in resident self-assessment of their teaching skills or knowledge. Plus, the study does not have benefit of a control group for comparison purposes.

Another significant limitation of this study is the absence of medical student feedback on resident teaching skills. Postclerkship surveys did not include specific questions regarding psychiatric resident teaching skills or knowledge. Thus, we do not have evidence that resident teaching practices changed after the intervention.

Direct observation of resident teaching by peers and/or faculty would enhance our findings. Objective standardized teaching examinations (OSTEs) to assess resident physician teaching skills would provide better outcome data on the effectiveness of this brief curriculum (1).

These preliminary findings are encouraging with regard to the apparent improvement of psychiatric residents’ self-assessment of their knowledge, attitudes, and skills about teaching following a brief didactic course. The development of more specific outcome measures such as including specific questions on resident teaching skills on postclerkship evaluations as well as direct observation and rating of clinical teaching is needed for future courses. Improved resident knowledge, skills, and attitudes about teaching can only improve the quality of psychiatric education for medical students and residents.

TABLE 1.  Psychiatric Resident Self-Assessment Tool of Teaching Knowledge, Skills, Attitudes, and Values: Pre- and Postcourse Results

At the time of submission, the authors reported no competing interests.

.
Morrison EH, Rucker L, Boker JR, et al: The effect of a 13-hour curriculum to improve residents’ teaching skills: a randomized trial. Ann Intern Med2004; 141:257–263
 
.
Dewey CM, Coverdale JH, Ismail NJ, et al: Residents-as-teachers programs in psychiatry: a systematic review. Can J Psychiatry 2008; 53:77–84
 
.
Ning A, Gottlieb D, Lamdan RM: The chief resident for education: description of a novel academic teaching position. Acad Psychiatry 2009; 33:163–165
 
.
American Psychiatric Association: American Psychiatric Association Committee on Graduate Education: 2001–2002. Psychiatric Residents as Teachers: A Practical Guide. Available at www.psych.org/MainMenu/EducationCareerDevelopment/ResidentsMembersinTraining/residentasteacher.aspx?FT=.pdf
 
.
Graduate Medical Education (GME) Committee of the Association of American Medical Colleges (AAMC): The Resident Teaching Skills Website. Bringing Education and Service Together (BEST). University of California–Irvine and Association of American Medical Colleges, Washington, DC. Available at http://www.ucimc.netouch.com
 
.
Neher JO, Stevens NG: The one-minute preceptor: shaping the teaching conversation. Fam Med 2003; 35:391–393
 
.
Pangaro L: A new vocabulary and other innovations for improving descriptive in-training evaluations. Acad Med 1999; 74:1203–1207
 
.
Aiyer M, Woods G, Lombard G, et al: Change in residents’ perceptions of teaching: following a one-day “Residents as Teachers” (RasT) workshop. Southern Med J 2008; 101:495–502
 
TABLE 1.  Psychiatric Resident Self-Assessment Tool of Teaching Knowledge, Skills, Attitudes, and Values: Pre- and Postcourse Results
+

References

.
Morrison EH, Rucker L, Boker JR, et al: The effect of a 13-hour curriculum to improve residents’ teaching skills: a randomized trial. Ann Intern Med2004; 141:257–263
 
.
Dewey CM, Coverdale JH, Ismail NJ, et al: Residents-as-teachers programs in psychiatry: a systematic review. Can J Psychiatry 2008; 53:77–84
 
.
Ning A, Gottlieb D, Lamdan RM: The chief resident for education: description of a novel academic teaching position. Acad Psychiatry 2009; 33:163–165
 
.
American Psychiatric Association: American Psychiatric Association Committee on Graduate Education: 2001–2002. Psychiatric Residents as Teachers: A Practical Guide. Available at www.psych.org/MainMenu/EducationCareerDevelopment/ResidentsMembersinTraining/residentasteacher.aspx?FT=.pdf
 
.
Graduate Medical Education (GME) Committee of the Association of American Medical Colleges (AAMC): The Resident Teaching Skills Website. Bringing Education and Service Together (BEST). University of California–Irvine and Association of American Medical Colleges, Washington, DC. Available at http://www.ucimc.netouch.com
 
.
Neher JO, Stevens NG: The one-minute preceptor: shaping the teaching conversation. Fam Med 2003; 35:391–393
 
.
Pangaro L: A new vocabulary and other innovations for improving descriptive in-training evaluations. Acad Med 1999; 74:1203–1207
 
.
Aiyer M, Woods G, Lombard G, et al: Change in residents’ perceptions of teaching: following a one-day “Residents as Teachers” (RasT) workshop. Southern Med J 2008; 101:495–502
 
+
+

CME Activity

There is currently no quiz available for this resource. Please click here to go to the CME page to find another.
Submit a Comments
Please read the other comments before you post yours. Contributors must reveal any conflict of interest.
Comments are moderated and will appear on the site at the discertion of APA editorial staff.

* = Required Field
(if multiple authors, separate names by comma)
Example: John Doe



Related Content
Articles
Books
The American Psychiatric Publishing Textbook of Geriatric Psychiatry, 4th Edition > Chapter 33.  >
Dulcan's Textbook of Child and Adolescent Psychiatry > Chapter 7.  >
Dulcan's Textbook of Child and Adolescent Psychiatry > Chapter 7.  >
Dulcan's Textbook of Child and Adolescent Psychiatry > Chapter 62.  >
Dulcan's Textbook of Child and Adolescent Psychiatry > Chapter 62.  >
Topic Collections
Psychiatric News
Read more at Psychiatric News >>
PubMed Articles
Association of resident fatigue and distress with perceived medical errors.
JAMA : the journal of the American Medical Association 2009 Sep 23
Association of resident fatigue and distress with perceived medical errors.
JAMA : the journal of the American Medical Association 2009 Sep 23