Document Open Access Logo

Learning Commonsense Knowledge Through Interactive Dialogue

Authors Benjamin Wu, Alessandra Russo, Mark Law, Katsumi Inoue

PDF
Thumbnail PDF

File

OASIcs.ICLP.2018.12.pdf
  • Filesize: 484 kB
  • 19 pages

Document Identifiers

Author Details

Benjamin Wu
  • Imperial College London, Department of Computing, Imperial College London, SW7 2AZ, UK
Alessandra Russo
  • Imperial College London, Department of Computing, Imperial College London, SW7 2AZ, UK
Mark Law
  • Imperial College London, Department of Computing, Imperial College London, SW7 2AZ, UK
Katsumi Inoue
  • National Institute of Informatics, 2 Chome-1-2 Hitotsubashi, Chiyoda, Tokyo

Cite AsGet BibTex

Benjamin Wu, Alessandra Russo, Mark Law, and Katsumi Inoue. Learning Commonsense Knowledge Through Interactive Dialogue. In Technical Communications of the 34th International Conference on Logic Programming (ICLP 2018). Open Access Series in Informatics (OASIcs), Volume 64, pp. 12:1-12:19, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2018)
https://doi.org/10.4230/OASIcs.ICLP.2018.12

Abstract

One of the most difficult problems in Artificial Intelligence is related to acquiring commonsense knowledge - to create a collection of facts and information that an ordinary person should know. In this work, we present a system that, from a limited background knowledge, is able to learn to form simple concepts through interactive dialogue with a user. We approach the problem using a syntactic parser, along with a mechanism to check for synonymy, to translate sentences into logical formulas represented in Event Calculus using Answer Set Programming (ASP). Reasoning and learning tasks are then automatically generated for the translated text, with learning being initiated through question and answering. The system is capable of learning with no contextual knowledge prior to the dialogue. The system has been evaluated on stories inspired by the Facebook's bAbI's question-answering tasks, and through appropriate question and answering is able to respond accurately to these dialogues.

Subject Classification

ACM Subject Classification
  • Computing methodologies → Knowledge representation and reasoning
Keywords
  • Commonsense Reasoning
  • Answer Set Programming
  • Event Calculus
  • Inductive Logic Programming

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads
    0
    Metadata Views

References

  1. Laura Banarescu, Claire Bonial, Shu Cai, Madalina Georgescu, Kira Griffitt, Ulf Hermjakob, Kevin Knight, Philipp Koehn, Martha Palmer, and Nathan Schneider. Abstract Meaning Representation for Sembanking. In Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discourse, pages 178-186, Sofia, Bulgaria, August 2013. Association for Computational Linguistics. URL: http://www.aclweb.org/anthology/W13-2322.
  2. Chita Baral, Juraj Dzifcak, and Tran Cao Son. Using Answer Set Programming and Lambda Calculus to Characterize Natural Language Sentences with Normatives and Exceptions. In Proceedings of the 23rd National Conference on Artificial Intelligence - Volume 2, AAAI'08, pages 818-823. AAAI Press, 2008. URL: http://dl.acm.org/citation.cfm?id=1620163.1620199.
  3. Piotr Chabierski, Alessandra Russo, Mark Law, and Krysia Broda. Machine Comprehension of Text Using Combinatory Categorial Grammar and Answer Set Programs. In COMMONSENSE, 2017. Google Scholar
  4. Devendra Singh Chaplot and Ruslan Salakhutdinov. Knowledge-based Word Sense Disambiguation using Topic Models. CoRR, abs/1801.01900, 2018. URL: http://arxiv.org/abs/1801.01900.
  5. John Cook. Dialogue in Learning: Implications for the Design of Computer-based Educational Systems. In ICCE, pages 987-991, 2002. URL: http://dx.doi.org/10.1109/CIE.2002.1186131.
  6. Ernest Davis and Gary Marcus. Commonsense reasoning and commonsense knowledge in artificial intelligence. Communications of the ACM, 58(9):92-103, September 2015. URL: http://dx.doi.org/10.1145/2701413.
  7. Jeffrey Flanigan, Sam Thomson, Jaime Carbonell, Chris Dyer, and Noah A. Smith. A Discriminative Graph-Based Parser for the Abstract Meaning Representation. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1426-1436, Baltimore, Maryland, June 2014. Association for Computational Linguistics. URL: http://www.aclweb.org/anthology/P14-1134.
  8. M. Gebser, R. Kaminski, B. Kaufmann, and T. Schaub. Clingo = ASP + Control: Preliminary Report. In M. Leuschel and T. Schrijvers, editors, Technical Communications of the Thirtieth International Conference on Logic Programming (ICLP'14), volume 14 (4-5), 2014. Theory and Practice of Logic Programming, Online Supplement. URL: http://arxiv.org/abs/1405.3694v1.
  9. M. Gelfond and V. Lifschitz. The Stable Model Semantics for Logic Programming. In ICLP '88, pages 1070-1080, Cambridge, Massachusetts, 1988. MIT Press. Google Scholar
  10. Julia Hirschberg and Christopher D. Manning. Advances in natural language processing. Science, 349(6245):261-266, 2015. URL: http://dx.doi.org/10.1126/science.aaa8685.
  11. Matthew Honnibal and Mark Johnson. An Improved Non-monotonic Transition System for Dependency Parsing. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pages 1373-1378, Lisbon, Portugal, September 2015. Association for Computational Linguistics. URL: https://aclweb.org/anthology/D/D15/D15-1162.
  12. Theo M. V. Janssen. Montague Semantics. In Edward N. Zalta, editor, The Stanford Encyclopedia of Philosophy. Metaphysics Research Lab, Stanford University, spring 2017 edition, 2017. Google Scholar
  13. Nikos Katzouris, Alexander Artikis, and Georgios Paliouras. Incremental learning of event definitions with Inductive Logic Programming. Machine Learning, 100(2-3):555-585, 2015. URL: http://dx.doi.org/10.1007/s10994-015-5512-1.
  14. Robert Kowalski and Marek Sergot. A Logic-Based Calculus of Events. New Generation Computing, 4:67-95, 1986. Google Scholar
  15. Mark Law, Alessandra Russo, and Krysia Broda. Inductive Learning of Answer Set Programs. In Eduardo Fermé and João Leite, editors, JELIA, volume 8761 of Lecture Notes in Computer Science, pages 311-325. Springer, 2014. URL: http://dx.doi.org/10.1007/978-3-319-11558-0_22.
  16. Mark Law, Alessandra Russo, and Krysia Broda. Learning weak constraints in answer set programming. TPLP, 15(4-5):511-525, 2015. URL: http://dx.doi.org/10.1017/S1471068415000198.
  17. Mark Law, Alessandra Russo, and Krysia Broda. Iterative Learning of Answer Set Programs from Context Dependent Examples. TPLP, 16(5-6):834-848, 2016. URL: http://dx.doi.org/10.1017/S1471068416000351.
  18. Xiang Li, Aynaz Taheri, Lifu Tu, and Kevin Gimpel. Commonsense Knowledge Base Completion. In ACL (1). The Association for Computer Linguistics, 2016. URL: http://aclweb.org/anthology/P/P16/P16-1137.pdf.
  19. Xiang Li, Luke Vilnis, and Andrew McCallum. Improved Representation Learning for Predicting Commonsense Ontologies. CoRR, abs/1708.00549, 2017. URL: http://arxiv.org/abs/1708.00549.
  20. Vladimir Lifschitz. What is answer set programming? In 23rd AAAI Press Conference on Artificial Intelligence (AAAI 2008), pages 1594-1597, Menlo Park, CA, USA, 2008. AAAI Press. URL: http://www.cs.utexas.edu/~vl/papers/wiasp.pdf.
  21. H. Liu and P. Singh. ConceptNet &Mdash; A Practical Commonsense Reasoning Tool-Kit. BT Technology Journal, 22(4):211-226, October 2004. URL: http://dx.doi.org/10.1023/B:BTTJ.0000047600.45421.6d.
  22. J. McCarthy and P. Hayes. Some Philosophical Problems from the Standpoint of Artificial Intelligence. Machine Intelligence, 4:463-502, 1969. Google Scholar
  23. George Miller. WordNet A Lexical Database for English. Communications of ACM, 38(11):39-41, 1995. Google Scholar
  24. Arindam Mitra and Chitta Baral. Addressing a Question Answering Challenge by Combining Statistical Methods with Inductive Rule Learning and Reasoning. In Dale Schuurmans and Michael P. Wellman, editors, AAAI, pages 2779-2785. AAAI Press, 2016. URL: http://www.aaai.org/ocs/index.php/AAAI/AAAI16/paper/view/12345.
  25. Oliver Ray. Nonmonotonic abductive inductive learning. Journal of Applied Logic, 7(3), September 2009. Other identifier: 2001069. URL: http://dx.doi.org/10.1016/j.jal.2008.10.007.
  26. D. Singh Chaplot and R. Salakhutdinov. Knowledge-based Word Sense Disambiguation using Topic Models. ArXiv e-prints, January 2018. URL: http://arxiv.org/abs/1801.01900.
  27. Mark Steedman. The Syntactic Process. MIT Press, Cambridge, MA, USA, 2000. Google Scholar
  28. Ramakrishna Vedantam, Xiao Lin, Tanmay Batra, C. Lawrence Zitnick, and Devi Parikh. Learning Common Sense through Visual Abstraction. In ICCV, pages 2542-2550. IEEE Computer Society, 2015. URL: http://dx.doi.org/10.1109/ICCV.2015.292.
  29. Jason Weston, Antoine Bordes, Sumit Chopra, and Tomas Mikolov. Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks. CoRR, abs/1502.05698, 2015. URL: http://arxiv.org/abs/1502.05698.
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail
© 2023-2024 Schloss Dagstuhl – LZI GmbH Imprint Privacy Contact