1 Search Results for "Harrando, Ismail"

Document

DOI: 10.4230/OASIcs.LDK.2021.17

Explainable Zero-Shot Topic Extraction Using a Common-Sense Knowledge Graph

Authors: Ismail Harrando and Raphaël Troncy

Published in: OASIcs, Volume 93, 3rd Conference on Language, Data and Knowledge (LDK 2021)

Abstract

Pre-trained word embeddings constitute an essential building block for many NLP systems and applications, notably when labeled data is scarce. However, since they compress word meanings into a fixed-dimensional representation, their use usually lack interpretability beyond a measure of similarity and linear analogies that do not always reflect real-world word relatedness, which can be important for many NLP applications. In this paper, we propose a model which extracts topics from text documents based on the common-sense knowledge available in ConceptNet [Speer et al., 2017] - a semantic concept graph that explicitly encodes real-world relations between words - and without any human supervision. When combining both ConceptNet’s knowledge graph and graph embeddings, our approach outperforms other baselines in the zero-shot setting, while generating a human-understandable explanation for its predictions through the knowledge graph. We study the importance of some modeling choices and criteria for designing the model, and we demonstrate that it can be used to label data for a supervised classifier to achieve an even better performance without relying on any humanly-annotated training data. We publish the code of our approach at https://github.com/D2KLab/ZeSTE and we provide a user friendly demo at https://zeste.tools.eurecom.fr/.

Cite as

Ismail Harrando and Raphaël Troncy. Explainable Zero-Shot Topic Extraction Using a Common-Sense Knowledge Graph. In 3rd Conference on Language, Data and Knowledge (LDK 2021). Open Access Series in Informatics (OASIcs), Volume 93, pp. 17:1-17:15, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2021)

Copy BibTex To Clipboard

@InProceedings{harrando_et_al:OASIcs.LDK.2021.17,
  author =	{Harrando, Ismail and Troncy, Rapha\"{e}l},
  title =	{{Explainable Zero-Shot Topic Extraction Using a Common-Sense Knowledge Graph}},
  booktitle =	{3rd Conference on Language, Data and Knowledge (LDK 2021)},
  pages =	{17:1--17:15},
  series =	{Open Access Series in Informatics (OASIcs)},
  ISBN =	{978-3-95977-199-3},
  ISSN =	{2190-6807},
  year =	{2021},
  volume =	{93},
  editor =	{Gromann, Dagmar and S\'{e}rasset, Gilles and Declerck, Thierry and McCrae, John P. and Gracia, Jorge and Bosque-Gil, Julia and Bobillo, Fernando and Heinisch, Barbara},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops-dev.dagstuhl.de/entities/document/10.4230/OASIcs.LDK.2021.17},
  URN =		{urn:nbn:de:0030-drops-145532},
  doi =		{10.4230/OASIcs.LDK.2021.17},
  annote =	{Keywords: Topic Extraction, Zero-Shot Classification, Explainable NLP, Knowledge Graph}
}

Refine by Author
1 Harrando, Ismail
1 Troncy, Raphaël

Refine by Classification
1 Computing methodologies → Information extraction

Refine by Keyword
1 Explainable NLP
1 Knowledge Graph
1 Topic Extraction
1 Zero-Shot Classification

Refine by Type
1 document

Refine by Publication Year
1 2021

1 Search Results for "Harrando, Ismail"

Explainable Zero-Shot Topic Extraction Using a Common-Sense Knowledge Graph

Abstract

Cite as

Thanks for your feedback!

Could not send message