The risk of bias and sample size of trials of spinal manipulative therapy for low back and neck pain: analysis and recommendations

Sidney M Rubinstein; Rik van Eekelen; Teddy Oosterhuis; Michiel R de Boer; Raymond W J G Ostelo; Maurits W van Tulder

doi:10.1016/j.jmpt.2014.07.007

The risk of bias and sample size of trials of spinal manipulative therapy for low back and neck pain: analysis and recommendations

J Manipulative Physiol Ther. 2014 Oct;37(8):523-41. doi: 10.1016/j.jmpt.2014.07.007. Epub 2014 Sep 5.

Authors

Sidney M Rubinstein¹, Rik van Eekelen², Teddy Oosterhuis³, Michiel R de Boer⁴, Raymond W J G Ostelo⁵, Maurits W van Tulder⁵

Affiliations

¹ Senior Researcher, Department of Health Sciences, VU University, Amsterdam, The Netherlands. Electronic address: S.M.Rubinstein@VU.nl.
² MSc Student, Amsterdam, The Netherlands.
³ PhD Student, Department of Health Sciences, VU University, Amsterdam, The Netherlands.
⁴ Assistant Professor, Department of Health Sciences, VU University, Amsterdam, The Netherlands.
⁵ Professor, Department of Health Sciences, VU University & Department of Epidemiology and Biostatistics, EMGO-Institute, VU University Medical Centre, Amsterdam, The Netherlands.

PMID: 25194968
DOI: 10.1016/j.jmpt.2014.07.007

Abstract

Objective: The purpose of this study was to evaluate changes in methodological quality and sample size in randomized controlled trials (RCTs) of spinal manipulative therapy (SMT) for neck and low back pain over a specified period. A secondary purpose was to make recommendations for improvement for future SMT trials based upon our findings.

Methods: Randomized controlled trials that examined the effect of SMT in adults with neck and/or low back pain and reported at least 1 patient-reported outcome measure were included. Studies were identified from recent Cochrane reviews of SMT, and an update of the literature was conducted (March 2013). Risk of bias was assessed using the 12-item criteria recommended by the Cochrane Back Review Group. In addition, sample size was examined. The relationship between the overall risk of bias and sample size over time was evaluated using regression analyses, and RCTs were grouped into periods (epochs) of approximately 5 years.

Results: In total, 105 RCTs were included, of which 41 (39%) were considered to have a low risk of bias. There is significant improvement in the mean risk of bias over time (P < .05), which is the most profound for items related to selection bias and, to a lesser extent, attrition and selective outcome reporting bias. Furthermore, although there is no significant increase in sample size over time (overall P = .8), the proportion of studies that performed an a priori sample size calculation is increasing statistically (odds ratio, 2.1; confidence interval, 1.5-3.0). Sensitivity analyses suggest no appreciable difference between studies for neck or low back pain for risk of bias or sample size.

Conclusion: Methodological quality of RCTs of SMT for neck and low back pain is improving, whereas overall sample size has shown only small and nonsignificant increases. There is an increasing trend among studies to conduct sample size calculations, which relate to statistical power. Based upon these findings, 7 areas of improvement for future SMT trials are suggested.

Keywords: Low Back Pain; Manipulation; Methodology; Neck Pain; Research; Sample Size; Spinal.

MeSH terms

Bias
Humans
Low Back Pain / therapy*
Manipulation, Spinal / statistics & numerical data*
Neck Pain / therapy*
Randomized Controlled Trials as Topic / standards*
Risk
Sample Size