From human to automatic summary grading
- Ana Arruarte Lasa Directeur/trice
- Jon Ander Elorriaga Arandia Directeur/trice
Université de défendre: Universidad del País Vasco - Euskal Herriko Unibertsitatea
Fecha de defensa: 16 décembre 2011
- María Isabel Fernández de Castro President
- Basilio Sierra Araujo Secrétaire
- Peter Mark Hastings Rapporteur
- Dietrich Albert Rapporteur
- Philippe Lopistéguy Poutz Rapporteur
Type: Thèses
Résumé
One of the goals remaining in Artificial Intelligence in Education is to create applications to evaluate open-ended text in a human-like manner. This dissertation describes the design and develompent of a summary evaluation environment based on human performance. Based on previous research in psychology, critical summarization ability development contexts have been analysed to significantly reflect human summary grading decision making. An empirical study has been carried out to identify underlying processes in overall summary decision grading. As a result, overall grades are computed by applying a Bayesian network based model. The discourse grades involved in the global score are cohesion, coherence, use of language, comprehension and adequacy. Semantic information is comprehended by means of Latent Semantic Analysis, and syntactic information by means of Natural Language Processing tools. The resulting automatic discourse grades have proved to significantly reflect human decisions.