VaxxStance@IberLEF 2021:Overview of the Task on Going Beyond Text in Cross-Lingual Stance Detection

  1. Agerri Gascón, Rodrigo
  2. Centeno, Roberto
  3. Espinosa, María
  4. Fernandez de Landa, Joseba
  5. Rodrigo Yuste, Álvaro
Revue:
Procesamiento del lenguaje natural

ISSN: 1135-5948

Année de publication: 2021

Número: 67

Pages: 173-181

Type: Article

DIALNET GOOGLE SCHOLAR lock_openRUA editor

D'autres publications dans: Procesamiento del lenguaje natural

Résumé

This paper describes the VaxxStance task at IberLEF 2021. The task proposes to detect stance in Tweets referring to vaccines, a relevant and controversial topic in the current pandemia. The task is proposed in a multilingual setting, providing data for Basque and Spanish languages. The objective is to explore crosslingual approaches which also complement textual information with contextual features obtained from the social network. The results demonstrate that contextual information is crucial to obtain competitive results, especially across languages.

Références bibliographiques

  • Akbik, A., D. Blythe, and R. Vollgraf. 2018. Contextual string embeddings for sequence. In Proceedings of the 27th International Conference on Computational Linguistics, pages 1638–1649, Santa Fe, New Mexico, USA.
  • Baly, R., M. Mohtarami, J. Glass, L. Márquez, A. Moschitti, and P. Nakov. 2018. Integrating Stance Detection and Fact Checking in a Unified Corpus. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pages 21–27, New Orleans, Louisiana, June. Association for Computational Linguistics.
  • Basile, V., C. Bosco, E. Fersini, D. Nozza, V. Patti, F. M. Rangel Pardo, P. Rosso, and M. Sanguinetti. 2019. SemEval2019 task 5: Multilingual detection of hate speech against immigrants and women in Twitter. In Proceedings of the 13th International Workshop on Semantic Evaluation, pages 54–63, Minneapolis, Minnesota, USA, June. Association for Computational Linguistics.
  • Bojanowski, P., E. Grave, A. Joulin, and T. Mikolov. 2017. Enriching word vectors with subword information. TACL, 5:135– 146.
  • Calleja, J. and A. Méndez. 2021. Sqyqp@vaxxstance: Stance detection for the antivaxxers movement. In Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2021), CEUR Workshop Proceedings.
  • Cignarella, A. T., M. Lai, C. Bosco, V. Patti, and P. Rosso. 2020. SardiStance@EVALITA2020: Overview of the Task on Stance Detection in Italian Tweets. In V. Basile, D. Croce, M. Di Maro, and L. C. Passaro, editors, Proceedings of the 7th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian (EVALITA 2020). CEUR-WS.org.
  • Derczynski, L., K. Bontcheva, M. Liakata, R. Procter, G. Wong Sak Hoi, and A. Zubiaga. 2017. SemEval-2017 task 8: RumourEval: Determining rumour veracity and support for rumours. In Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017), pages 69–76, Vancouver, Canada, August. Association for Computational Linguistics.
  • Espinosa, M. S., R. Agerri, A. Rodrigo, and R. Centeno. 2020. Deepreading @ sardistance 2020: Combining textual, social and emotional features. In V. Basile, D. Croce, M. D. Maro, and L. C. Passaro, editors, Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2020), Online event, December 17th, 2020, volume 2765 of CEUR Workshop Proceedings. CEURWS.org.
  • Evrard, M., R. Uro, N. Hervé, and B. Mazoyer. 2020. French Tweet Corpus for Automatic Stance Detection. In Proceedings of The 12th Language Resources and Evaluation Conference, pages 6317–6322, Marseille, France, May. European Language Resources Association.
  • Gonzalez-Dios, I. and K. Bengoetxea. 2021. Multiaztertest@vaxxstance-iberlef 2021: Identifying stances with language models and linguistic features. In Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2021), CEUR Workshop Proceedings.
  • Gorrell, G., E. Kochkina, M. Liakata, A. Aker, A. Zubiaga, K. Bontcheva, and L. Derczynski. 2019. SemEval-2019 task 7: RumourEval, determining rumour veracity and support for rumours. In Proceedings of the 13th International Workshop on Semantic Evaluation, pages 845–854, Minneapolis, Minnesota, USA, June. Association for Computational Linguistics.
  • Hercig, T., P. Krejzl, B. Hourová, J. Steinberger, and L. Lenc. 2017. Detecting stance in czech news commentaries. In Proceedings of the 17th ITAT: Slovenskoˇcesk´y NLP workshop (SloNLP 2017), volume 1885 of CEUR Workshop Proceedings, pages 176–180, Bratislava, Slovakia. Comenius University in Bratislava, Faculty of Mathematics, Physics and Informatics, CreateSpace Independent Publishing Platform.
  • Kiesel, J., M. Mestre, R. Shukla, E. Vincent, P. Adineh, D. Corney, B. Stein, and M. Potthast. 2019. SemEval-2019 task 4: Hyperpartisan news detection. In Proceedings of the 13th International Workshop on Semantic Evaluation, pages 829– 839, Minneapolis, Minnesota, USA, June. Association for Computational Linguistics.
  • Lai, M., A. Cignarella, D. Hernandez Farias, C. Bosco, V. Patti, and P. Rosso. 2020. Multilingual Stance Detection in Social Media Political Debates. Computer Speech & Language, 02.
  • Lai, M., A. T. Cignarella, L. Finos, and A. Sciandra. 2021. Wordup! at vaxxstance 2021: Combining contextual information with textual and dependencybased syntactic features for stance detection. In Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2021), CEUR Workshop Proceedings.
  • Mohammad, S., S. Kiritchenko, P. Sobhani, X. Zhu, and C. Cherry. 2016. SemEval2016 task 6: Detecting stance in tweets. In SemEval-2016), pages 31–41.
  • Montes, M., P. Rosso, J. Gonzalo, E. Aragón, R. Agerri, M. Angel Alvarez Carmona, E. Alvarez Mellado, J. C. de Albornoz, L. Chiruzzo, L. Freitas, H. G. Adorno, Y. Gutiérrez, S. M. J. Zafra, S. Lima, F. M. P. de Arco, and M. T. (eds.). 2021. Proceedings of the iberian languages evaluation forum (iberlef 2021). CEUR Workshop Proceedings.
  • Taulé, M., F. M. R. Pardo, M. A. Martí, and P. Rosso. 2018. Overview of the Task on Multimodal Stance Detection in Tweets on Catalan# 1oct Referendum. In IberEval@ SEPLN, pages 149–166.
  • Thorne, J., A. Vlachos, C. Christodoulopoulos, and A. Mittal. 2018. FEVER: a large-scale dataset for fact extraction and VERification. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pages 809–819, New Orleans, Louisiana, June. Association for Computational Linguistics.
  • Vychegzhanin, S. V. Kotelnikov, E. V. 2019. Stance Detection Based on Ensembles of Classifiers. Programming and Computer Software, pages 228–240, January.
  • Zotova, E., R. Agerri, and G. Rigau. 2021. Semi-automatic generation of multilingual datasets for stance detection in Twitter. Expert Systems with Applications, 170:114547.
La source de données: Dialnet