This Article  • References  • Full text PDF  • Reply to article  • Send to a friend  • Save in My Folder  • Save to citation manager  • Permissions  Citing Articles  • Citation map  • Citing articles on HighWire  • Contact me when this article is cited  Related Content  • Similar articles in this journal  Social Bookmarking   What's this?

Theory and Practice

William M. Grove, MA; Nancy C. Andreasen, MD, PhD; Patricia McDonald-Scott, MA; Martin B. Keller, MD; Robert W. Shapiro

Arch Gen Psychiatry. 1981;38(4):408-413.

Abstract
• The existing literature on the reliability of psychiatric diagnosis falls into two periods, the earlier reporting low reliability and the latter reporting much higher figures. The reasons for this trend are examined in the context of a discussion of the design of diagnostic reliability studies. The problems of research design and execution in studies of diagnostic reliability are reviewed, and statistical problems are examined. Solutions to many of these problems are suggested, including recommendations of appropriate reliability coefficients and data analyses.

Author Affiliations
From the Department of Psychiatry, University of Iowa, Iowa City (Mr Grove and Dr Andreasen); New York State Psychiatric Institute, New York (Ms McDonald-Scott); and the Department of Psychiatry, Harvard University, Cambridge, Mass (Drs Keller and Shapiro).

Footnotes
Accepted for publication Oct 31, 1980.

Deceased.

Reprint requests to Department of Psychiatry, University of Iowa, 500 Newton Rd, Iowa City, IA 52242 (Dr Andreasen).

CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter     What's this?

THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES

Competing Definitions of Schizophrenia: What Can Be Learned From Polydiagnostic Studies?
Jansson and Parnas
Schizophr Bull 2007;33:1178-1200.
ABSTRACT | FULL TEXT  

Short-Term Stability of Diagnoses of Major and Minor Depression in Older Medical Inpatients
Cole et al.
Psychosomatics 2007;48:38-45.
ABSTRACT | FULL TEXT  

Including Omission Mistakes in the Calculation of Cohen's Kappa and an Analysis of the Coefficient's Paradox Features
Simon
Educational and Psychological Measurement 2006;66:765-777.
ABSTRACT  

A Refined Protocol for Coding Nursing Home Residents' Comments During Satisfaction Interviews
Levy-Storms et al.
Journals of Gerontology Series B: Psychological Sciences and Social Science 2005;60:S326-S330.
ABSTRACT | FULL TEXT  

An Ethnographically Derived Measure of Anxiety, Depression and Somatization: The Phan Vietnamese Psychiatric Scale
Phan et al.
Transcultural Psychiatry 2004;41:200-232.
ABSTRACT  

Impact of Structured Clinical Interviews on Physicians' Practices in Community Mental Health Settings
Kashner et al.
Psychiatr. Serv. 2003;54:712-718.
ABSTRACT | FULL TEXT  

Examining Diagnostic Tests: An Evidence-Based Perspective
Fritz and Wainner
ptjournal 2001;81:1546-1564.
ABSTRACT | FULL TEXT  

Methods to Improve Diagnostic Accuracy in a Community Mental Health Setting
Basco et al.
Am. J. Psychiatry 2000;157:1599-1605.
ABSTRACT | FULL TEXT  

Diagnosis of Nonpsychotic Patients in Community Clinics
Shear et al.
Am. J. Psychiatry 2000;157:581-587.
ABSTRACT | FULL TEXT  

Logistical and Methodological Challenges in Conducting a Mental Health Survey of Mount Pinatubo Disaster Victims
Howard et al.
Transcultural Psychiatry 2000;37:101-118.
ABSTRACT  

Stability and Change in Personality Disorder Features: The Longitudinal Study of Personality Disorders
Lenzenweger
Arch Gen Psychiatry 1999;56:1009-1015.
ABSTRACT | FULL TEXT  

Pulmonary Oligemia in Aortic Valve Disease
Bruno et al.
Radiology 1999;210:37-45.
ABSTRACT | FULL TEXT  

Monash Interview for Liaison Psychiatry (MILP): Development, Reliability, and Procedural Validity
Clarke et al.
Psychosomatics 1998;39:318-328.
ABSTRACT | FULL TEXT  

A Prospective 4- to 5-Year Study of DSM-III-R Hypochondriasis
Barsky et al.
Arch Gen Psychiatry 1998;55:737-744.
ABSTRACT | FULL TEXT  

Measurement reliability and agreement in psychiatry
Shrout
Stat Methods Med Res 1998;7:301-317.
ABSTRACT  

The Reliability of Peer Assessments: A Meta-Analysis
Goldman
Eval Health Prof 1994;17:3-21.
ABSTRACT  

The International Personality Disorder Examination: The World Health Organization/Alcohol, Drug Abuse, and Mental Health Administration International Pilot Study of Personality Disorders
Loranger et al.
Arch Gen Psychiatry 1994;51:215-224.
ABSTRACT  

Diagnosing Personality Disorders: A Review of Issues and Research Methods
Zimmerman
Arch Gen Psychiatry 1994;51:225-245.
ABSTRACT  

Progress Toward Achieving a Common Language in Psychiatry: Results From the Field Trial of the Clinical Guidelines Accompanying the WHO Classification of Mental and Behavioral Disorders in ICD-10
Sartorius et al.
Arch Gen Psychiatry 1993;50:115-124.
ABSTRACT  

The {kappa} Statistic-Reply
Goldman
JAMA 1992;268:2513-2514.
ABSTRACT  

Stability of Psychiatric Diagnoses: An Application to the Affective Disorders
Rice et al.
Arch Gen Psychiatry 1992;49:824-830.
ABSTRACT  

Review papers : Design and analysis of reliability studies
Dunn
Stat Methods Med Res 1992;1:123-157.
ABSTRACT  

Psychopathologic Precursors and Sociodemographic Risk Factors for the Schizophrenia Syndrome
Tien and Eaton
Arch Gen Psychiatry 1992;49:37-46.
ABSTRACT  

Mental Disorders in Adolescent Suicide: DSM-III-R Axes I and II Diagnoses in Suicides Among 13- to 19-Year-Olds in Finland
Marttunen et al.
Arch Gen Psychiatry 1991;48:834-839.
ABSTRACT  

Relation of Observer Agreement to Accuracy According to a Two-receiver Signal Detection Model of Diagnosis
Quinn
Med Decis Making 1989;9:196-206.
ABSTRACT  

An Empirical Study of Defense Mechanisms: I. Clinical Interview and Life Vignette Ratings
Perry and Cooper
Arch Gen Psychiatry 1989;46:444-452.
ABSTRACT  

Reliability of the Telephone Interview in Diagnosing Anxiety Disorders
Paulsen et al.
Arch Gen Psychiatry 1988;45:62-63.
ABSTRACT  

Y's, k'S, p's and q's
Carey
Arch Gen Psychiatry 1987;44:1027-1027.
ABSTRACT  

The Spanish Diagnostic Interview Schedule: Reliability and Concordance With Clinical Diagnoses in Puerto Rico
Canino et al.
Arch Gen Psychiatry 1987;44:720-726.
ABSTRACT  

The Longitudinal Interval Follow-up Evaluation: A Comprehensive Method for Assessing Outcome in Prospective Longitudinal Studies
Keller et al.
Arch Gen Psychiatry 1987;44:540-548.
ABSTRACT  

Familial Rates of Affective Disorder: A Report From the National Institute of Mental Health Collaborative Study
Andreasen et al.
Arch Gen Psychiatry 1987;44:461-469.
ABSTRACT  

Quantification of Agreement in Psychiatric Diagnosis Revisited
Shrout et al.
Arch Gen Psychiatry 1987;44:172-177.
ABSTRACT  

DSM-III and Clinically Identified Problems as a Guide to Treatment
Longabaugh et al.
Arch Gen Psychiatry 1986;43:1097-1103.
ABSTRACT  

Long-term Reliability of Diagnosing Lifetime Major Depression in a Community Sample
Bromet et al.
Arch Gen Psychiatry 1986;43:435-440.
ABSTRACT  

The Validation of the Concept of Endogenous Depression: A Family Study Approach
Andreasen et al.
Arch Gen Psychiatry 1986;43:246-251.
ABSTRACT  

Epidemiology: Reflections on Testing the Validity of Psychiatric Interviews
Robins
Arch Gen Psychiatry 1985;42:918-924.
ABSTRACT  

A Comparison of Clinical and Diagnostic Interview Schedule Diagnoses: Physician Reexamination of Lay-Interviewed Cases in the General Population
Helzer et al.
Arch Gen Psychiatry 1985;42:657-666.
ABSTRACT  

A Comparison of Two Diagnostic Methods: Clinical ICD Diagnoses vs DSM-III and Research Diagnostic Criteria Using the Diagnostic Interview Schedule (Version 2)
Wittchen et al.
Arch Gen Psychiatry 1985;42:677-684.
ABSTRACT  

A Proposed Solution to the Base Rate Problem in the Kappa Statistic
Spitznagel and Helzer
Arch Gen Psychiatry 1985;42:725-728.
ABSTRACT  

Structured Interviews and Borderline Personality Disorder
Loranger et al.
Arch Gen Psychiatry 1984;41:565-568.
ABSTRACT  

Familial Transmission of DSM-III Borderline Personality Disorder
Loranger et al.
Arch Gen Psychiatry 1982;39:795-799.
ABSTRACT