Archive ouverte UNIGE

Search for a publication

Proceedings chapter

Open access

English

Linguistic Corpus Annotation for Automatic Text Simplification Evaluation

Contributors Cardon , Rémi ; Bibal , Adrien ; Wilkens , Rodrigo ; Alfter , David ; Norré , Magali ; Müller , Adeline ; Watrin , Patrick ; François , Thomas

Published in Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing , p. 1842-1866

Presented at Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, United Arab Emirates, 7-11 Décember 2022

Publisher Association for Computational Linguistics

Publication date 2022-12

Abstract

Evaluating automatic text simplification (ATS) systems is a difficult task that is either performed by automatic metrics or user-based evaluations. However, from a linguistic point-of-view, it is not always clear on what bases these evaluations operate. In this paper, we propose annotations of the ASSET corpus that can be used to shed more light on ATS evaluation. In addition to contributing with this resource, we show how it can be used to analyze SARI’s behavior and to re-evaluate existing ATS systems. We present our insights as a step to improve ATS evaluation protocols in the future.

Affiliation

Faculté de traduction et d'interprétation / Département de traitement informatique multilingue

Citation (ISO format)

CARDON, Rémi et al. Linguistic Corpus Annotation for Automatic Text Simplification Evaluation. In: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing . Abu Dhabi, United Arab Emirates . [s.l.] : Association for Computational Linguistics, 2022. p. 1842–1866. doi: 10.18653/v1/2022.emnlp-main.121

Main files (1)

Proceedings chapter (Published version)

CC BY-4.0

Identifiers

PID : unige:171633
DOI : 10.18653/v1/2022.emnlp-main.121

Commercial URL https://aclanthology.org/2022.emnlp-main.121

Datasets

https://github.com/remicardon/assetann

42 views

8 downloads

Technical informations

Creation 2023/09/23 11:06:21

First validation 2023/09/25 08:02:23

Update time 2023/09/25 08:02:23

Status update 2023/09/25 08:02:23

Last indexation 2024/01/18 00:56:36