Clinical assessments of the presence and severity of psychopathology are often collected by health care professionals in mental health services or clinical researchers trained to use semi-structured interviews. Clustering by interviewer or rater needs to be considered when performing psychometric analyses such as factor analysis or item response modelling as non-independence of observations arises in these situations. We apply more suitable multilevel methods to analyse ordinally scored Positive and Negative Syndrome Scale (PANSS) items. Our aim is to highlight the differences in results that occur when the data are analysed using a hierarchically sensitive approach rather than using a traditional (aggregated) analysis. Our sample (n = 507) consisted of patients diagnosed with schizophrenia who participated in a multi-centre randomized control clinical trial, the DIALOG study. Analyses reported and compared include an exploratory factor analysis as well as several recently published multifactor models re-estimated within a confirmatory analysis framework. Our results show that the fit of the model and the parsimony of the exploratory factor analysis (EFA) models indicated by the number of factors necessary to explain the inter-correlation among PANSS items improved significantly when data clustering is taken into account through multilevel analysis. Our modeling results support the pentagonal PANSS model first proposed by White et al. (1997). Copyright © 2014 John Wiley & Sons, Ltd.
Keywords: psychometrics; psychoses; scale validation.
Copyright © 2014 John Wiley & Sons, Ltd.