Software Tools for Systematic Review Literature Screening and Data Extraction: Qualitative User Experiences from Succinct Formal Tests

Abstract

Systematic reviews (SRs) contribute to implementing the 3Rs in preclinical research. With the ever-increasing amount of scientific literature, SRs require increasing time investment. Thus, using the most efficient review tools is essential. Most available software tools aid the screening process; tools for data extraction and/or multiple review phases are relatively scarce. Using a single platform for all review phases allows auto-transfer of references from one phase to the next and enables work on multiple phases at the same time. We performed succinct formal tests of four multiphase review tools that are free or relatively affordable: Covidence, Eppi, SRDR+ and SYRF. Our tests comprised full-text screening, sham data extraction, and discrepancy resolution in the context of parts of a systematic review. Screening was performed as per protocol. Sham data extraction comprised free text, numerical and categorial data. Both reviewers logged their experiences with the platforms throughout. These logs were qualitatively summarized and supplemented with further user experiences. We show value of all tested tools in the SR process. Which tool is optimal depends on multiple factors, comprising previous experience with the tool but also review type, review questions, and review team member enthusiasm.