Large language models, updates, and evaluation of automation tools for systematic reviews: a summary of significant discussions at the eighth meeting of the International Collaboration for the Automation of Systematic Reviews (ICASR)

Publication date

2024-11-27

Authors

O’Connor, Annette M.
Clark, Justin
Thomas, James
Spijker, René
Kusa, Wojciech
Walker, Vickie R.
Bond, Melissa

Editors

Advisors

Supervisors

Document Type

Comment

Collections

Open Access logo

License

cc_by_nc_nd

Abstract

The eighth meeting of the International Collaboration for the Automation of Systematic Reviews (ICASR) was held on September 7 and 8, 2023, at the University College London, London, England. ICASR is an interdisciplinary group whose goal is to maximize the use of technology for conducting rapid, accurate, and efficient evidence synthesis, e.g., systematic reviews, evidence maps, and scoping reviews of scientific evidence. In 2023, the major themes discussed were understanding the benefits and harms of automation tools that have become available in recent years, the advantages and disadvantages of large language models in evidence synthesis, and approaches to ensuring the validity of tools for the proposed task.

Keywords

Automation tools, ChatGPT, Evidence synthesis, Large language models, Systematic reviews, Medicine (miscellaneous)

Citation

O’Connor, A M, Clark, J, Thomas, J, Spijker, R, Kusa, W, Walker, V R & Bond, M 2024, 'Large language models, updates, and evaluation of automation tools for systematic reviews : a summary of significant discussions at the eighth meeting of the International Collaboration for the Automation of Systematic Reviews (ICASR)', Systematic Reviews, vol. 13, no. 1, 290. https://doi.org/10.1186/s13643-024-02666-2