Search Results

Documents authored by Benitez Cortes, Ailin


Document
Short Paper
Conceptual Vagueness in Human and LLM Representations: Evidence from Migration Distance Categorization (Short Paper)

Authors: Songlin Wang, Krzysztof Janowicz, Ailin Benitez Cortes, Marion Borderon, Yingjing Huang, Mina Karimi, Zilong Liu, Annika Süß, and Patrick Sakdapolrak

Published in: LIPIcs, Volume 393, 17th International Conference on Spatial Information Theory (COSIT 2026)


Abstract
Conceptual vagueness is a fundamental characteristic of many geographic categories. The varied definitions of "long-distance" and "short-distance" in migration studies provides a typical example. Although interpretations of these categories are inherently context-dependent and heterogeneous, they remain widely used in domain research. This study investigates the extent to which different individuals reach a consensus on conceptualizing these categories. With a migration related corpus where "long" and "short" are generally not explicitly mentioned, we elicit human and LLM judgments in classifying each article into these two categories. Both human-human and human-LLM agreements are quantified. Our results show that human agreements are only moderate, confirming substantial conceptual variability among informed readers. LLM outputs exhibit a comparable level of variability, failing to converge on a stable category boundary. This disagreement arises from multiple sources, from detection of implicit signals to their interpretations. These findings demonstrate the feasibility of using LLMs as probes to characterize conceptual vagueness in geography at scale. Returning to migration distance, we highlight that they should not be treated as universally shared categories in knowledge organization and representation. In contrast, resolving such vagueness requires richer contextual information or additional semantic signals.

Cite as

Songlin Wang, Krzysztof Janowicz, Ailin Benitez Cortes, Marion Borderon, Yingjing Huang, Mina Karimi, Zilong Liu, Annika Süß, and Patrick Sakdapolrak. Conceptual Vagueness in Human and LLM Representations: Evidence from Migration Distance Categorization (Short Paper). In 17th International Conference on Spatial Information Theory (COSIT 2026). Leibniz International Proceedings in Informatics (LIPIcs), Volume 393, pp. 21:1-21:9, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2026)


Copy BibTex To Clipboard

@InProceedings{wang_et_al:LIPIcs.COSIT.2026.21,
  author =	{Wang, Songlin and Janowicz, Krzysztof and Benitez Cortes, Ailin and Borderon, Marion and Huang, Yingjing and Karimi, Mina and Liu, Zilong and S\"{u}{\ss}, Annika and Sakdapolrak, Patrick},
  title =	{{Conceptual Vagueness in Human and LLM Representations: Evidence from Migration Distance Categorization}},
  booktitle =	{17th International Conference on Spatial Information Theory (COSIT 2026)},
  pages =	{21:1--21:9},
  series =	{Leibniz International Proceedings in Informatics (LIPIcs)},
  ISBN =	{978-3-95977-438-3},
  ISSN =	{1868-8969},
  year =	{2026},
  volume =	{393},
  editor =	{Timpf, Sabine and Filomena, Gabriele and Kapaj, Armand and Zhu, Rui and Giudice, Nicholas A. and Manley, Ed},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops.dagstuhl.de/entities/document/10.4230/LIPIcs.COSIT.2026.21},
  URN =		{urn:nbn:de:0030-drops-275652},
  doi =		{10.4230/LIPIcs.COSIT.2026.21},
  annote =	{Keywords: qualitative categories, conceptual vagueness, human migration, large language models, agreement}
}

Any Issues?
X

Feedback on the Current Page

CAPTCHA

Thanks for your feedback!

Feedback submitted to Dagstuhl Publishing

Could not send message

Please try again later or send an E-mail