Fighting the COVID-19 Infodemic with a Holistic BERT Ensemble

Publication date

2021-06

Authors

Tziafas, Georgios
Kogkalidis, KonstantinosISNI 000000049283049X
Caselli, Tommaso

Editors

Advisors

Supervisors

Document Type

Part of book
Open Access logo

License

cc_by

Abstract

This paper describes the TOKOFOU system, an ensemble model for misinformation detection tasks based on six different transformer-based pre-trained encoders, implemented in the context of the COVID-19 Infodemic Shared Task for English. We fine tune each model on each of the task’s questions and aggregate their prediction scores using a majority voting approach. TOKOFOU obtains an overall F1 score of 89.7%, ranking first.

Keywords

Citation

Tziafas, G, Kogkalidis, K & Caselli, T 2021, Fighting the COVID-19 Infodemic with a Holistic BERT Ensemble. in Proceedings of the Fourth Workshop on NLP for Internet Freedom: Censorship, Disinformation, and Propaganda. Association for Computational Linguistics, pp. 119-124, The Fourth Workshop on NLP for Internet Freedom: Censorship, Disinformation, and Propaganda, 6/06/21. https://doi.org/10.18653/v1/2021.nlp4if-1.18, workshop