Academic Psychiatry
Journal Home Search Current Issue Past Issues Subscribe All APPI Journals Help Contact Us
 
Quicksearch
Advanced Search
Or Search All APPI Journals
This Article
* Full Text
* Full Text (PDF)
* Alert me when this article is cited
* Alert me if a correction is posted
* Citation Map
Services
* Email this article to a Colleague
* Similar articles in this journal
* Similar articles in PubMed
* Alert me to new issues of the journal
* Add to My Articles & Searches
* Download to citation manager
* reprints & permissions
Citing Articles
* Citing Articles via HighWire
* Citing Articles via Google Scholar
Google Scholar
* Articles by Sierles, F. S.
* Articles by Garfield, D. A.S.
* Search for Related Content
PubMed
* PubMed Citation
* Articles by Sierles, F. S.
* Articles by Garfield, D. A.S.
Related Collections
* Other Delivery of Care
Academic Psychiatry 25:214-222, December 2001
© 2001 Academic Psychiatry

Psychometric Properties of ABPN-Style Oral Examinations Administered Jointly by Two Psychiatry Residency Programs

Frederick S. Sierles, M.D., , Amin Daghestani, M.D., Cindy L. Weiner, Ph.D., , Robert deVito, M.D., Christopher G. Fichtner, M.D., and David A.S. Garfield, M.D.

Drs. Sierles, Daghestani, Weiner, Fichtner, and Garfield are at the Department of Psychiatry and Behavioral Sciences, Finch University of Health Sciences/The Chicago Medical School, Chicago, IL. Dr. de Vito is at the Department of Psychiatry, Stritch School of Medicine, Loyola University, Chicago, IL. Address correspondence to Dr. Sierles, 3333 Green Bay Road, North Chicago, IL 60064. E-mail: sierlesf{at}mis.finchcms.edu

The authors examined the reliability and validity of American Board of Psychiatry and Neurology–style oral exams (ASOs) given jointly by two schools. ASOs were given to 80 psychiatry residents from all four postgraduate years during the study period. Interrater reliability was near perfect for two years at one university, but it was much weaker at the second site. Test-retest reliability could not be demonstrated at either institution. Concurrent validity was demonstrated one year but was inconsistently demonstrated the second year. Likewise, predictive and construct validity were variable. International medical graduates were more apt to fail than American medical graduates. Although resident and faculty satisfaction with the examination was high, site-to-site variability in reliability and validity indicates the need to improve this ASO before using it for high-stakes evaluations.

Key Words: Examinations, ABPN-Style • Validity • Oral Examinations




This article has been cited by other articles:


Home page
Acad. PsychiatryHome page
J. A. Bourgeois and M. Servis
Clinical Habits and the Psychiatrist: An Adult Developmental Model Focusing on the Academic Psychiatrist
Acad Psychiatry, October 1, 2006; 30(5): 365 - 371.
[Abstract] [Full Text] [PDF]


Home page
Acad. PsychiatryHome page
B. J.B. Roman and J. Trevino
An Approach to Address Grade Inflation in a Psychiatry Clerkship
Acad Psychiatry, April 1, 2006; 30(2): 110 - 115.
[Abstract] [Full Text] [PDF]




Get information about faster international access.

Privacy Policy

Copyright © 2001 Academic Psychiatry. All rights reserved.

Home | Search | Current Issue | Past Issues | Subscribe | All APPI Journals | Help | Contact Us

American Psychiatric Publishing, Inc. American Association of Chairs of Departments of Psychiatry American Association of Directors of Psychiatric Residency Training Association of Directors of Medical Student Education in Psychiatry Association for Academic Psychiatry
1000 Wilson Boulevard, Suite 1825, Arlington, VA 22209-3901 * 800-368-5777 * appi at psych.org