Search Results

Documents authored by Chaves-Fraga, David

Document
Resource
DOI: 10.4230/TGDK.4.2.9
BLINKG: A Benchmark for LLM-Integrated Knowledge Graph Generation

Authors: Carla Castedo, Enrique Iglesias, Manuel Lama, Alberto Bugarín-Diz, Maria-Esther Vidal, and David Chaves-Fraga

Published in: TGDK, Volume 4, Issue 2 (2024): Special Issue on Data Management for (Knowledge) Graphs. Transactions on Graph Data and Knowledge, Volume 4, Issue 2

Abstract
Generating Knowledge Graphs (KGs) remains one of the most time-consuming and labor-intensive tasks for knowledge engineers, as they need to identify semantic equivalences between input data sources and ontology terms. While declarative solutions (e.g., RML, SPARQL-Anything) have helped to generalize this process, aligning input schema elements with ontology terms still involves intricate transformations and requires considerable manual effort. With the advent of Large Language Models (LLMs), there is growing interest in leveraging their capabilities to assist KG engineers. Although some studies have explored using LLMs to automate KG construction, there is still no standardized framework for assessing how effectively they establish correspondences between data schemes and ontology concepts. Therefore, in this paper, we propose BLINKG, a benchmark designed to evaluate the mapping capabilities of LLMs in constructing KGs from heterogeneous data sources. The benchmark includes a set of scenarios with increasing complexity, based on real-world use cases. We conduct an extensive experimental evaluation of several state-of-the-art LLMs using BLINK and observe that they already offer promising solutions. However, their performance remains limited in complex scenarios. Thanks to this benchmark we can already asses the current capabilities of LLMs for KG construction. Additionally, we define a set of requirements for achieving (semi)automated (LLM-driven) KG construction, opening new research lines in this area.
Cite as

Carla Castedo, Enrique Iglesias, Manuel Lama, Alberto Bugarín-Diz, Maria-Esther Vidal, and David Chaves-Fraga. BLINKG: A Benchmark for LLM-Integrated Knowledge Graph Generation. In Special Issue on Data Management for (Knowledge) Graphs. Transactions on Graph Data and Knowledge (TGDK), Volume 4, Issue 2, pp. 9:1-9:35, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2026)

Copy BibTex To Clipboard

@Article{castedo_et_al:TGDK.4.2.9,
  author =	{Castedo, Carla and Iglesias, Enrique and Lama, Manuel and Bugar{\'\i}n-Diz, Alberto and Vidal, Maria-Esther and Chaves-Fraga, David},
  title =	{{BLINKG: A Benchmark for LLM-Integrated Knowledge Graph Generation}},
  journal =	{Transactions on Graph Data and Knowledge},
  pages =	{9:1--9:35},
  ISSN =	{2942-7517},
  year =	{2026},
  volume =	{4},
  number =	{2},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops.dagstuhl.de/entities/document/10.4230/TGDK.4.2.9},
  URN =		{urn:nbn:de:0030-drops-275901},
  doi =		{10.4230/TGDK.4.2.9},
  annote =	{Keywords: Knowledge Graph Construction, Benchmarking, Mapping Languages, Large Language Models}
}
Document
DOI: 10.4230/DagRep.14.2.1
Are Knowledge Graphs Ready for the Real World? Challenges and Perspective (Dagstuhl Seminar 24061)

Authors: David Chaves-Fraga, Oscar Corcho, Anastasia Dimou, Maria-Esther Vidal, Ana Iglesias-Molina, and Dylan Van Assche

Published in: Dagstuhl Reports, Volume 14, Issue 2 (2024)

Abstract
This report documents the program and results of the Dagstuhl Seminar 24061 "Are Knowledge Graphs Ready for the Real World? Challenges and Perspectives". The seminar focused on gaining a better understanding of the open challenges required for the development of Knowledge Graph ecosystems. The seminar focused on four different topics: access control and privacy in decentralized knowledge graphs, knowledge graph construction lifecycle, software methods for improving KG implementation, and a new wave of knowledge engineers and their expected skills. By focusing on these relevant research topics, the seminar aimed to reflect on KGs from a more fundamental computer science perspective. It brought together interdisciplinary researchers from academia and industry to discuss foundations, concepts, and implementations that will pave the way for the next generation of KGs ready for real-world use.
Cite as

David Chaves-Fraga, Oscar Corcho, Anastasia Dimou, Maria-Esther Vidal, Ana Iglesias-Molina, and Dylan Van Assche. Are Knowledge Graphs Ready for the Real World? Challenges and Perspective (Dagstuhl Seminar 24061). In Dagstuhl Reports, Volume 14, Issue 2, pp. 1-70, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2024)

Copy BibTex To Clipboard

@Article{chavesfraga_et_al:DagRep.14.2.1,
  author =	{Chaves-Fraga, David and Corcho, Oscar and Dimou, Anastasia and Vidal, Maria-Esther and Iglesias-Molina, Ana and Van Assche, Dylan},
  title =	{{Are Knowledge Graphs Ready for the Real World? Challenges and Perspective (Dagstuhl Seminar 24061)}},
  pages =	{1--70},
  journal =	{Dagstuhl Reports},
  ISSN =	{2192-5283},
  year =	{2024},
  volume =	{14},
  number =	{2},
  editor =	{Chaves-Fraga, David and Corcho, Oscar and Dimou, Anastasia and Vidal, Maria-Esther and Iglesias-Molina, Ana and Van Assche, Dylan},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops.dagstuhl.de/entities/document/10.4230/DagRep.14.2.1},
  URN =		{urn:nbn:de:0030-drops-204983},
  doi =		{10.4230/DagRep.14.2.1},
  annote =	{Keywords: access control and privacy, federated query processing, intelligent knowledge graph management, programming paradigms for knowledge graphs, semantic data integration}
}

Any Issues?
X

Feedback on the Current Page

CAPTCHA

Thanks for your feedback!

Feedback submitted to Dagstuhl Publishing

Could not send message

Please try again later or send an E-mail
© 2023-2026 Schloss Dagstuhl – LZI GmbH Schloss Dagstuhl – LZI GmbH About DROPS Imprint Privacy Contact