Document Open Access Logo

Querying Relational Databases with Speech-Recognition Driven by Contextual Knowledge

Authors Dietmar Seipel, Benjamin Förster, Magnus Liebl, Marcel Waleska, Salvador Abreu

PDF
Thumbnail PDF

File

OASIcs.SLATE.2023.6.pdf
  • Filesize: 0.6 MB
  • 15 pages

Document Identifiers

Author Details

Dietmar Seipel
  • Department of Computer Science, Universität Würzburg, Germany
Benjamin Förster
  • Department of Computer Science, Universität Würzburg, Germany
Magnus Liebl
  • Department of Computer Science, Universität Würzburg, Germany
Marcel Waleska
  • Department of Computer Science, Universität Würzburg, Germany
Salvador Abreu
  • Nova-Lincs, University of Évora, Portugal

Cite AsGet BibTex

Dietmar Seipel, Benjamin Förster, Magnus Liebl, Marcel Waleska, and Salvador Abreu. Querying Relational Databases with Speech-Recognition Driven by Contextual Knowledge. In 12th Symposium on Languages, Applications and Technologies (SLATE 2023). Open Access Series in Informatics (OASIcs), Volume 113, pp. 6:1-6:15, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2023)
https://doi.org/10.4230/OASIcs.SLATE.2023.6

Abstract

We are extending the keyword-based query interface DdQl for relational databases which is based on contextual background knowledge such as suitable join conditions and which was proposed in [{Dietmar Seipel, 2021]. In the previous paper, join conditions were extracted from existing referential integrity (foreign key) constraints of the database schema, or they could be learned from other, previous database queries. In this paper, we describe a speech-to-text component for entering the query keywords based on the system Whisper. Keywords, which have been recognized wrongly by Whisper can be corrected to similarly sounding words. Again, the context of the database schema can help here. For users with a limited knowledge of the schema and the contents of the database, the approach of DdQl can help to provide useful suggestions for query implementations in Sql or Datalog, from which the user can choose one. Our tool DdQl can be run in a docker image; it yields the possible queries in Sql and a special domain specific rule language that extends Datalog. The Datalog variant allows for additional user-defined aggregation functions which are not possible in Sql.

Subject Classification

ACM Subject Classification
  • Information systems → Relational database query languages
  • Information systems → Relational database model
Keywords
  • Knowledge Bases
  • Natural Language Interface
  • Logic Programming
  • Definite Clause Grammars
  • Referential Integrity Constraints
  • Speech-to-Text

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads
    0
    Metadata Views

Supplementary Materials

References

  1. Katrin Affolter, Kurt Stockinger, and Abraham Bernstein. A Comparative Survey of Recent Nlis for Databases. VLDB J., 28(5):793-819, 2019. URL: https://doi.org/10.1007/s00778-019-00567-8.
  2. Alec Radford, Jong Wook Kim, Tao Xu, Greg Brockman, Christine McLeavey, Ilya Sutskever. Robust Speech Recognition via Large-Scale Weak Supervision, 2022. arXiv preprint arXiv:2212.04356. URL: https://arxiv.org/pdf/2212.04356.pdf.
  3. Lukas Blunschi, Claudio Jossen, Donald Kossmann, Magdalini Mori, and Kurt Stockinger. Soda: Generating Sql for Business Users. Proc. VLDB Endowment, 5(10):932-943, 2012. URL: https://doi.org/10.14778/2336664.2336667.
  4. Ivan Bratko. Prolog Programming for AI. Addison-Wesley Longman, 4th edition, 2011. Google Scholar
  5. Gerhard Brewka, Thomas Eiter, and Mirek Truszczynski. Answer Set Programming at a Glance. Communications of the ACM, 54(12):92-103, 2011. Google Scholar
  6. Ceri, Stefano and Gottlob, Georg and Tanca, Laetitia. Logic Programming and Databases. Springer, 1990. Google Scholar
  7. Christian Schneiker, Dietmar Seipel. Declarative Web Programming with Prolog and XUL. In Proc. 26th Workshop on Logic Programming (WLP), 2012. Google Scholar
  8. William Clocksin and Christopher S. Mellish. Programming in Prolog. Springer Science & Business Media, 2003. Google Scholar
  9. Danica Damljanovic, Milan Agatonovic, and Hamish Cunningham. Nlis to Ontologies: Combining Syntactic Analysis and Ontology-based Lookup through the User Interaction. In Extended Semantic Web Conf., pages 106-120. Springer, 2010. Google Scholar
  10. Dietmar Seipel, Daniel Weidner, Salvador Abreu. Intelligent Query Answering with Contextual Knowledge for Relational Databases. 10th Symposium on Languages, Applications and Technologies (SLATE), 2021. Google Scholar
  11. Ramez Elmasri and Shamkant B. Navathe. Fundamentals of Database Systems, 3rd Edition. Addison-Wesley Longman, 2000. Google Scholar
  12. Ben Goertzel. Perception Processing for General Intelligence: Bridging the Symbolic/Subsymbolic Gap. In International Conference on Artificial General Intelligence, pages 79-88. Springer, 2012. Google Scholar
  13. Awni Hannun, Carl Case, Jared Casper, Bryan Catanzaro, Greg Diamos, Erich Elsen, Ryan Prenger, Sanjeev Satheesh, Shubho Sengupta, Adam Coates, et al. Deep Speech: Scaling up End-to-End Speech Recognition. arXiv preprint arXiv:1412.5567, 2014. Google Scholar
  14. Lawrence Philips. Hanging on the Metaphone, Computer Language, Vol.7, No.12, 1990. Google Scholar
  15. Fei Li and H. V. Jagadish. Understanding Natural Language Queries over Relational Databases. SIGMOD Rec., 45(1):6-13, 2016. URL: https://doi.org/10.1145/2949741.2949744.
  16. Matthew MacDonald. Html 5: The Missing Manual, 2nd Edition. O'Reilly Media, Inc, 2011. Google Scholar
  17. Falco Nogatz, Julia Kübert, Dietmar Seipel, and Salvador Abreu. Alexa, How Can I Reason with Prolog? (Short Paper). In Proc. 8th Symposium on Languages, Applications and Technologies (SLATE 2019), 2019. Google Scholar
  18. OpenAI. Introducing ChatGPT and Whisper APIs. URL: https://openai.com/blog/introducing-chatgpt-and-whisper-apis.
  19. Christian Schneiker, Dietmar Seipel, Werner Wegstein, and Klaus Prätor. Declarative Parsing and Annotation of Electronic Dictionaries. In Proc. 6th International Workshop on Natural Language Processing and Cognitive Science (NLPCS 2009), 2009. Google Scholar
  20. Dietmar Seipel. Declare - A Declarative Toolkit for Knowledge-Based Systems and Logic Programming. URL: http://www1.pub.informatik.uni-wuerzburg.de/databases/research.html.
  21. Dietmar Seipel. Processing Xml-Documents in Prolog. In Workshop on Logic Programming (WLP 2002), 2002. Google Scholar
  22. Kurt Stockinger. The Rise of Natural Language Interfaces to Databases. ACM SIGMOD Blog, 2019. URL: https://blog.zhaw.ch/datascience/the-rise-of-natural-language-interfaces-to-databases/.
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail
© 2023-2024 Schloss Dagstuhl – LZI GmbH Imprint Privacy Contact