The web-based "Right Review" tool asks reviewers simple questions to suggest methods from 41 knowledge synthesis methods

Abstract

Objectives: To develop a web-based decision support tool that guides users through a series of simple questions for recommending knowledge synthesis methods suitable for their research question.

Study design and setting: We used findings from previous work to structure a set of questions along key dimensions of different knowledge synthesis methods. We developed the tool using four steps: (1) designing the tool, (2) conducting usability testing, (3) disseminating the tool, and (4) evaluating its real-world use. Steps 1-3 were conducted iteratively, and the tool was evaluated using the RE-AIM framework.

Results: The "Right Review" tool separates quantitative reviews and qualitative evidence synthesis (QES). Five questions are asked to select from among 26 methods for quantitative reviews, and 10 questions to select methods from among 15 QES. Conduct/reporting guidance and open-access examples are provided for each recommended method. The tool was disseminated to >4,600 users worldwide within 12 months. Evaluation results showed that the tool was fit-for-purpose and easy to use.

Conclusion: The proliferation of knowledge synthesis methods makes it challenging for reviewers to select the "right" method. "Right Review" is a free, practical decision support tool that helps reviewers choose an appropriate method from 41 alternatives.

Keywords: Evidence based practice; Knowledge synthesis; Qualitative evidence synthesis; Research methods; Systematic reviews; Web-based decision tool.