Shortening self-report mental health symptom measures through optimal test assembly methods: Development and validation of the Patient Health Questionnaire-Depression-4

Miyabi Ishihara; Daphna Harel; Brooke Levis; Alexander W Levis; Kira E Riehm; Nazanin Saadat; Marleine Azar; Danielle B Rice; Tatiana A Sanchez; Matthew J Chiovitti; Pim Cuijpers; Simon Gilbody; John P A Ioannidis; Lorie A Kloda; Dean McMillan; Scott B Patten; Ian Shrier; Bruce Arroll; Charles H Bombardier; Peter Butterworth; Gregory Carter; Kerrie Clover; Yeates Conwell; Felicity Goodyear-Smith; Catherine G Greeno; John Hambridge; Patricia A Harrison; Marie Hudson; Nathalie Jetté; Kim M Kiely; Anthony McGuire; Brian W Pence; Alasdair G Rooney; Abbey Sidebottom; Adam Simning; Alyna Turner; Jennifer White; Mary A Whooley; Kirsty Winkley; Andrea Benedetti; Brett D Thombs

doi:10.1002/da.22841

Shortening self-report mental health symptom measures through optimal test assembly methods: Development and validation of the Patient Health Questionnaire-Depression-4

Depress Anxiety. 2019 Jan;36(1):82-92. doi: 10.1002/da.22841. Epub 2018 Sep 20.

Authors

Miyabi Ishihara^{1

2

3}, Daphna Harel^{2

3}, Brooke Levis^{4

5}, Alexander W Levis^{4

5}, Kira E Riehm⁴, Nazanin Saadat⁴, Marleine Azar^{4

5}, Danielle B Rice^{4

6}, Tatiana A Sanchez⁴, Matthew J Chiovitti⁴, Pim Cuijpers⁷, Simon Gilbody⁸, John P A Ioannidis^{9

10

11

12}, Lorie A Kloda¹³, Dean McMillan⁸, Scott B Patten^{14

15

16}, Ian Shrier^{4

5}, Bruce Arroll¹⁷, Charles H Bombardier¹⁸, Peter Butterworth^{19

20

21}, Gregory Carter²², Kerrie Clover^{22

23}, Yeates Conwell²⁴, Felicity Goodyear-Smith¹⁷, Catherine G Greeno²⁵, John Hambridge²⁶, Patricia A Harrison²⁷, Marie Hudson^{4

28}, Nathalie Jetté^{14

15

16

29}, Kim M Kiely¹⁹, Anthony McGuire³⁰, Brian W Pence³¹, Alasdair G Rooney³², Abbey Sidebottom³³, Adam Simning²⁵, Alyna Turner^{34

35}, Jennifer White³⁶, Mary A Whooley^{37

38

39}, Kirsty Winkley²⁹, Andrea Benedetti^{5

28

40}, Brett D Thombs^{4

5

6

28

41

42}

Affiliations

¹ Department of Statistics, University of California, Berkeley, California.
² PRIISM Applied Statistics Center, New York University, New York, New York.
³ Department of Applied Statistics, Social Science, and Humanities, New York University, New York, New York.
⁴ Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada.
⁵ Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada.
⁶ Department of Psychology, McGill University, Montréal, Québec, Canada.
⁷ Department of Clinical, Neuro and Developmental Psychology, EMGO Institute, VU University, Amsterdam, The Netherlands.
⁸ Department of Health Sciences, Hull York Medical School, University of York, Heslington, York, UK.
⁹ Department of Medicine, Stanford University, Stanford, California.
¹⁰ Department of Health Research and Policy, Stanford University, Stanford, California.
¹¹ Department of Biomedical Data Science, Stanford University, Stanford, California.
¹² Department of Statistics, Stanford University, Stanford, California.
¹³ Library, Concordia University, Montréal, Québec, Canada.
¹⁴ Department of Community Health Sciences, University of Calgary, Calgary, Alberta, Canada.
¹⁵ Hotchkiss Brain Institute, University of Calgary, Calgary, Alberta, Canada.
¹⁶ O'Brien Institute for Public Health, University of Calgary, Calgary, Alberta, Canada.
¹⁷ Department of General Practice and Primary Health Care, University of Auckland, New Zealand.
¹⁸ Department of Rehabilitation Medicine, University of Washington, Seattle, Washington.
¹⁹ Centre for Research on Ageing, Health and Wellbeing, Research School of Population Health, Australian National University, Canberra, Australia.
²⁰ Centre for Mental Health, Melbourne School of Population and Global Health, The University of Melbourne, Melbourne, Australia.
²¹ Melbourne Institute of Applied Economic and Social Research, The University of Melbourne, Melbourne, Australia.
²² Centre for Translational Neuroscience and Mental Health, University of Newcastle, New South Wales, Australia.
²³ Psycho-Oncology Service, Calvary Mater Newcastle, New South Wales, Australia.
²⁴ Department of Psychiatry, University of Rochester Medical Center, Rochester, New York.
²⁵ School of Social Work, University of Pittsburgh, Pittsburgh, Pennsylvania.
²⁶ Liaison Psychiatry Department, John Hunter Hospital, Newcastle, Australia.
²⁷ Minneapolis Health Department, Minneapolis, Minnesota.
²⁸ Department of Medicine, McGill University, Montréal, Québec, Canada.
²⁹ Department of Clinical Neurosciences, University of Calgary, Calgary, Alberta, Canada.
³⁰ Department of Nursing, St. Joseph's College, Standish, Maine.
³¹ Department of Epidemiology, Gillings School of Global Public Health, The University of North Carolina at Chapel Hill, Chapel Hill, North Carolina.
³² Division of Psychiatry, Royal Edinburgh Hospital, University of Edinburgh, Edinburgh, Scotland, UK.
³³ Allina Health, Minneapolis, Minnesota.
³⁴ School of Medicine and Public Health, University of Newcastle, New South Wales, Newcastle, Australia.
³⁵ IMPACT Strategic Research Centre, School of Medicine, Deakin University, Geelong, Victoria, Australia.
³⁶ Monash University, Melbourne, Australia.
³⁷ Department of Epidemiology and Biostatistics, University of California, San Francisco, California.
³⁸ Department of Medicine, Veterans Affairs Medical Center, San Francisco, California.
³⁹ Department of Medicine, University of California, San Francisco, California.
⁴⁰ Respiratory Epidemiology and Clinical Research Unit, McGill University Health Centre, Montréal, Québec, Canada.
⁴¹ Department of Psychiatry, McGill University, Montréal, Québec, Canada.
⁴² Department of Educational and Counselling Psychology, McGill University, Montréal, Québec, Canada.

Abstract

Background: The objective of this study was to develop and validate a short form of the Patient Health Questionnaire-9 (PHQ-9), a self-report questionnaire for assessing depressive symptomatology, using objective criteria.

Methods: Responses on the PHQ-9 were obtained from 7,850 English-speaking participants enrolled in 20 primary diagnostic test accuracy studies. PHQ unidimensionality was verified using confirmatory factor analysis, and an item response theory model was fit. Optimal test assembly (OTA) methods identified a maximally precise short form for each possible length between one and eight items, including and excluding the ninth item. The final short form was selected based on prespecified validity, reliability, and diagnostic accuracy criteria.

Results: A four-item short form of the PHQ (PHQ-Dep-4) was selected. The PHQ-Dep-4 had a Cronbach's alpha of 0.805. Sensitivity and specificity of the PHQ-Dep-4 were 0.788 and 0.837, respectively, and were statistically equivalent to the PHQ-9 (sensitivity = 0.761, specificity = 0.866). The correlation of total scores with the full PHQ-9 was high (r = 0.919).

Conclusion: The PHQ-Dep-4 is a valid short form with minimal loss of information of scores when compared to the full-length PHQ-9. Although OTA methods have been used to shorten patient-reported outcome measures based on objective, prespecified criteria, further studies are required to validate this general procedure for broader use in health research. Furthermore, due to unexamined heterogeneity, there is a need to replicate the results of this study in different patient populations.

Keywords: Patient Health Questionnaire; depression; patient outcome assessment; psychometrics.

Publication types

Research Support, N.I.H., Extramural
Research Support, Non-U.S. Gov't
Research Support, U.S. Gov't, Non-P.H.S.
Research Support, U.S. Gov't, P.H.S.
Validation Study

MeSH terms

Depression / diagnosis*
Depression / psychology*
Depressive Disorder / diagnosis
Depressive Disorder / psychology
Factor Analysis, Statistical
Female
Humans
Male
Mental Health
Middle Aged
Patient Health Questionnaire / standards*
Psychometrics
Reproducibility of Results
Self Report*
Sensitivity and Specificity

Abstract

Publication types

MeSH terms

Grants and funding