DROPS

Document

DOI: 10.4230/OASIcs.LDK.2021.30

Improving Intent Detection Accuracy Through Token Level Labeling

Authors: Michał Lew, Aleksander Obuchowski, and Monika Kutyła

Published in: OASIcs, Volume 93, 3rd Conference on Language, Data and Knowledge (LDK 2021)

Abstract

Intent detection is traditionally modeled as a sequence classification task where the role of the models is to map the users' utterances to their class. In this paper, however, we show that the classification accuracy can be improved with the use of token level intent annotations and introducing new annotation guidelines for labeling sentences in the intent detection task. What is more, we introduce a method for training the network to predict joint sentence level and token level annotations. We also test the effects of different annotation schemes (BIO, binary, sentence intent) on the model’s accuracy.

Cite as

Michał Lew, Aleksander Obuchowski, and Monika Kutyła. Improving Intent Detection Accuracy Through Token Level Labeling. In 3rd Conference on Language, Data and Knowledge (LDK 2021). Open Access Series in Informatics (OASIcs), Volume 93, pp. 30:1-30:11, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2021)

Copy BibTex To Clipboard

@InProceedings{lew_et_al:OASIcs.LDK.2021.30,
  author =	{Lew, Micha{\l} and Obuchowski, Aleksander and Kuty{\l}a, Monika},
  title =	{{Improving Intent Detection Accuracy Through Token Level Labeling}},
  booktitle =	{3rd Conference on Language, Data and Knowledge (LDK 2021)},
  pages =	{30:1--30:11},
  series =	{Open Access Series in Informatics (OASIcs)},
  ISBN =	{978-3-95977-199-3},
  ISSN =	{2190-6807},
  year =	{2021},
  volume =	{93},
  editor =	{Gromann, Dagmar and S\'{e}rasset, Gilles and Declerck, Thierry and McCrae, John P. and Gracia, Jorge and Bosque-Gil, Julia and Bobillo, Fernando and Heinisch, Barbara},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops.dagstuhl.de/entities/document/10.4230/OASIcs.LDK.2021.30},
  URN =		{urn:nbn:de:0030-drops-145662},
  doi =		{10.4230/OASIcs.LDK.2021.30},
  annote =	{Keywords: Intent Detection, Annotation, NLP, Chatbots}
}

Search Results

Documents authored by Obuchowski, Aleksander

Improving Intent Detection Accuracy Through Token Level Labeling

Abstract

Cite as

Thanks for your feedback!

Could not send message