Evaluation of word embeddings against cognitive processes: primed reaction times in lexical decision and naming tasks

Jeremy Auguste; Arnaud Rey; Benoit Favre

Evaluation of word embeddings against cognitive processes: primed reaction times in lexical decision and naming tasks

Jeremy Auguste ¹ Arnaud Rey ² Benoit Favre ^{1, 3}

1 TALEP - Traitement Automatique du Langage Ecrit et Parlé

LIS - Laboratoire d'Informatique et Systèmes

2 LPC - Laboratoire de psychologie cognitive

3 LIF - Laboratoire d'informatique Fondamentale de Marseille

Abstract : This work presents a framework for word similarity evaluation grounded on cogni-tive sciences experimental data. Word pair similarities are compared to reaction times of subjects in large scale lexical decision and naming tasks under semantic priming. Results show that GloVe embeddings lead to significantly higher correlation with experimental measurements than other controlled and off-the-shelf embeddings, and that the choice of a training corpus is less important than that of the algorithm. Comparison of rankings with other datasets shows that the cognitive phenomenon covers more aspects than simply word related-ness or similarity.

Document type :

Conference papers

Domain :

Computer Science [cs] / Computation and Language [cs.CL]

Computer Science [cs] / Machine Learning [cs.LG]

Computer Science [cs] / Document and Text Processing

Computer Science [cs] / Signal and Image Processing

Complete list of metadatas

Cited literature [24 references] Display Hide Download

https://hal-amu.archives-ouvertes.fr/hal-01773220
Contributor : Benoit Favre <>
Submitted on : Tuesday, April 24, 2018 - 1:32:59 PM
Last modification on : Monday, March 4, 2019 - 2:04:14 PM
Long-term archiving on : Tuesday, September 18, 2018 - 5:42:29 PM

favre_repeval2017.pdf

Publisher files allowed on an open archive

Evaluation of word embeddings against cognitive processes: primed reaction times in lexical decision and naming tasks

File

Identifiers

Collections

Citation

Export

Metrics

159

123

Contact

Evaluation of word embeddings against cognitive processes: primed reaction times in lexical decision and naming tasks

File

Identifiers

Collections

Citation

Export

Share

Metrics

159

123

Contact