Resumen de TESTLINK en IberLEF 2023Creación de relaciones entre análisis de laboratorio y mediciones clínicas y sus resultados

  1. Zanoli, Roberto
  2. Karunakaran, Goutham
  3. Altuna Díaz, Begoña
  4. Agerri Gascón, Rodrigo
  5. Salas Espejo, Lidia
  6. Saiz, José Javier
  7. Lavelli, Alberto
  8. Magnini, Bernardo
  9. Speranza, Manuela
Journal:
Procesamiento del lenguaje natural

ISSN: 1135-5948

Year of publication: 2023

Issue: 71

Pages: 313-320

Type: Article

DIALNET GOOGLE SCHOLAR lock_openRUA editor

More publications in: Procesamiento del lenguaje natural

Abstract

The TESTLINK task conducted at IberLEF2023 focuses on relation extraction from clinical cases in Spanish and Basque. The task consists in identifying clinical results and measures and linking them to the tests and measurements from which they were obtained. Three teams took part in the task and various (supervised) deep learning models were evaluated; interestingly, none of the teams explored the use of few-shot learning. The evaluation shows that in-domain fine-tuning and larger training datasets improve the results. In fact, the fact that supervised models significantly outperformed the baseline based on few-shot learning shows the crucial role still played by the availability of annotated training data.

Bibliographic References

  • Agerri, R., I. San Vicente, J. A. Campos, A. Barrena, X. Saralegi, A. Soroa, and E. Agirre. 2020. Give your text representation models some love: the case for Basque. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 4781–4788, Marseille, France, May. European Language Resources Association.
  • Alfattni, G., N. Peek, and G. Nenadic. 2020. Extraction of temporal relations from clinical free text: A systematic review of current approaches. Journal of Biomedical Informatics, 108:103488.
  • Altuna, B., G. Karunakaran, A. Lavelli, B. Magnini, M. Speranza, and R. Zanoli. 2023. CLinkaRT at EVALITA 2023: Overview of the Task on Linking a Lab Result to its Test Event in the Clinical Domain. In Proceedings of the Eighth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2023), Parma, Italy, September. CEUR.org.
  • Carrino, C. P., J. Armengol-Estape, A. Gutierrez-Fandiño, J. Llop-Palao, M. P`amies, A. Gonzalez-Agirre, and M. Villegas. 2021. Biomedical and Clinical Language Models for Spanish: On the Benefits of Domain-Specific Pretraining in a Mid-Resource Scenario.
  • Carrino, C. P., J. Llop, M. P`amies, A. Gutierrez-Fandiño, J. Armengol- Estape, J. Silveira-Ocampo, A. Valencia, A. Gonzalez-Agirre, and M. Villegas. 2022. Pretrained Biomedical Language Models for Clinical NLP in Spanish. In Proceedings of the 21st Workshop on Biomedical Language Processing, pages 193–199, Dublin, Ireland, May. Association for Computational Linguistics.
  • Cañete, J., G. Chaperon, R. Fuentes, J.-H. Ho, H. Kang, and J. Perez. 2020. Spanish Pre-Trained BERT Model and Evaluation Data. In PML4DC at ICLR 2020.
  • Hao, T., H. Liu, and C. Weng. 2016. Valx: A System for Extracting and Structuring Numeric Lab Test Comparison Statements from Text. Methods of information in medicine, 55:266–75.
  • Jain, K. and V. Prajapati. 2021. NLP/Deep Learning Techniques in Healthcare for Decision Making. Primary Health Care, 11.
  • Jimenez-Zafra, S. M., F. Rangel, and M. Montes-y Gomez. 2023. Overview of IberLEF 2023: Natural Language Processing Challenges for Spanish and other Iberian Languages. In Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2023), co-located with the 39th Conference of the Spanish Society for Natural Language Processing (SEPLN 2023), CEUR-WS.org.
  • Johnson, A. E., T. J. Pollard, L. Shen, L.- w. H. Lehman, M. Feng, M. Ghassemi, B. Moody, P. Szolovits, L. Anthony Celi, and R. G. Mark. 2016. MIMIC-III, a freely accessible critical care database. Scientific Data, 3.
  • Magnini, B., B. Altuna, A. Lavelli, A.- L. Minard, M. Speranza, and R. Zanoli. 2022. European Clinical Case Corpus. In G. Rehm, editor, European Language Grid. Springer, Cham, Switzerland, 1 edition, November, chapter 17, pages 283– 288.
  • Newman-Griffis, D., G. Divita, B. Desmet, A. Zirikly, C. P. Rose, and E. Fosler- Lussier. 2020. Ambiguity in medical concept normalization: An analysis of types and coverage in electronic health record datasets. Journal of the American Medical Informatics Association, 28(3):516– 532, 12.
  • Percha, B. 2021. Modern Clinical Text Mining: A Guide and Review. Annual Review of Biomedical Data Science, 4(1):165–187. PMID: 34465177.
  • Pustejovsky, J., J. M. Castaño, R. Ingria, R. Saurı, R. J. Gaizauskas, A. Setzer, G. Katz, and D. R. Radev. 2003. TimeML: Robust Specification of Event and Temporal Expressions in Text. New directions in question answering, 3:28–34.
  • Sankoh, O. and P. Byass. 2014. Causespecific mortality at INDEPTH Health and Demographic Surveillance System Sites in Africa and Asia: concluding synthesis. Global health action, 7.
  • Santiso, S., A. Perez, and A. Casillas. 2021. Adverse Drug Reaction extraction: Tolerance to entity recognition errors and subdomain variants. Computer Methods and Programs in Biomedicine, 199:105891.
  • Schweter, S. and A. Akbik. 2020. FLERT: Document-Level Features for Named Entity Recognition. CoRR, abs/2011.06993.
  • Styler, W. F., S. Bethard, S. Finan, M. Palmer, S. Pradhan, P. C. de Groen, B. Erickson, T. Miller, C. Lin, G. Savova, et al. 2014. Temporal Annotation in the Clinical Domain. Transactions of the Association for Computational Linguistics, 2:143–154.
  • Trigueros, O., A. Blanco, N. Lebeña, A. Casillas, and A. Perez. 2022. Explainable ICD multi-label classification of EHRs in Spanish with convolutional attention. International Journal of Medical Informatics, 157:104615.
Data source: Dialnet