Comparing Probabilistic, Distributional and Transformer-Based Models on Logical Metonymy Interpretation - Laboratoire Parole et Langage Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

Comparing Probabilistic, Distributional and Transformer-Based Models on Logical Metonymy Interpretation

Giulia Rambelli
Emmanuele Chersoni
  • Fonction : Auteur
  • PersonId : 999663
Alessandro Lenci
  • Fonction : Auteur
  • PersonId : 999664
Philippe Blache
Chu-Ren Huang
  • Fonction : Auteur
  • PersonId : 1084548

Résumé

In linguistics and cognitive science, Logical metonymies are defined as type clashes between an event-selecting verb and an entitydenoting noun (e.g. The editor finished the article), which are typically interpreted by inferring a hidden event (e.g. reading) on the basis of contextual cues. This paper tackles the problem of logical metonymy interpretation, that is, the retrieval of the covert event via computational methods. We compare different types of models, including the probabilistic and the distributional ones previously introduced in the literature on the topic. For the first time, we also tested on this task some of the recent Transformer-based models, such as BERT, RoBERTa, XLNet, and GPT-2. Our results show a complex scenario, in which the best Transformer-based models and some traditional distributional models perform very similarly. However, the low performance on some of the testing datasets suggests that logical metonymy is still a challenging phenomenon for computational modeling.
Fichier principal
Vignette du fichier
Rambelli_AACL.pdf (377.81 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03042410 , version 1 (21-12-2020)

Identifiants

  • HAL Id : hal-03042410 , version 1

Citer

Giulia Rambelli, Emmanuele Chersoni, Alessandro Lenci, Philippe Blache, Chu-Ren Huang. Comparing Probabilistic, Distributional and Transformer-Based Models on Logical Metonymy Interpretation. Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing (AACL-IJCNLP), Dec 2020, Suzhou, China. ⟨hal-03042410⟩
140 Consultations
159 Téléchargements

Partager

Gmail Facebook X LinkedIn More