Document Open Access Logo

Gathering Background Knowledge for Story Understanding through Crowdsourcing

Authors Christos T. Rodosthenous, Loizos Michael

PDF
Thumbnail PDF

File

OASIcs.CMN.2014.154.pdf
  • Filesize: 0.95 MB
  • 10 pages

Document Identifiers

Author Details

Christos T. Rodosthenous
Loizos Michael

Cite AsGet BibTex

Christos T. Rodosthenous and Loizos Michael. Gathering Background Knowledge for Story Understanding through Crowdsourcing. In 2014 Workshop on Computational Models of Narrative. Open Access Series in Informatics (OASIcs), Volume 41, pp. 154-163, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2014)
https://doi.org/10.4230/OASIcs.CMN.2014.154

Abstract

Successfully comprehending stories involves integration of the story information with the reader's own background knowledge. A prerequisite, then, of building automated story understanding systems is the availability of such background knowledge. We take the approach that knowledge appropriate for story understanding can be gathered by sourcing the task to the crowd. Our methodology centers on breaking this task into a sequence of more specific tasks, so that human participants not only identify relevant knowledge, but also convert it into a machine-readable form, generalize it, and evaluate its appropriateness. These individual tasks are presented to human participants as missions in an online game, offering them, in this manner, an incentive for their participation. We report on an initial deployment of the game, and discuss our ongoing work for integrating the knowledge gathering task into a full-fledged story understanding engine.
Keywords
  • story understanding
  • knowledge representation
  • crowdsourcing
  • reasoning

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads
    0
    Metadata Views

References

  1. Philip E. Agre and David Chapman. Pengi: An Implementation of a Theory of Activity. In Proceedings of the 6th National Conference on Artificial Intelligence (AAAI'87), pages 286-272, Seattle, Washington, USA, 1987. Google Scholar
  2. Sue Atkins, Michael Rundell, and Hiroaki Sato. The Contribution of FrameNet to Practical Lexicography. International Journal of Lexicography, 16.3:333-357, 2003. Google Scholar
  3. Kristof Van Belleghem, Marc Denecker, and Danny De Schreye. On the Relation Between Situation Calculus and Event Calculus. The Journal of Logic Programming, 31(1-3):3-37, 1997. Google Scholar
  4. Eugene Charniak. Toward a Model of Children’s Story Comprehension. Technical Report AITR-266, Massachusetts Institute of Technology, Cambridge, MA, USA, 1972. Google Scholar
  5. Eugene Charniak. Ms. Malaprop, a Language Comprehension Program. Institut pour les Etudes Sémantiques et Cognitives Genève: Working papers. Fond. Dalle Molle, 1976. Google Scholar
  6. Peter Clark and Phil Harrison. Large-scale Extraction and Use of Knowledge from Text. In Proceedings of the 5th International Conference on Knowledge Capture (K-CAP'09), pages 153-160, New York, NY, USA, 2009. Google Scholar
  7. Irene-Anna Diakidoy, Antonis Kakas, Loizos Michael, and Rob Miller. Narrative Text Comprehension: From Psychology to AI. In Proceedings of the 11th International Symposium on Logical Formalizations of Commonsense Reasoning (Commonsense'13), Ayia Napa, Cyprus, 2013. Google Scholar
  8. Irene-Anna Diakidoy, Antonis Kakas, Loizos Michael, and Rob Miller. Story Comprehension through Argumentation. In Proceedings of the 5th International Conference on Computational Models of Argument (COMMA'14), Scottish Highlands, UK, 2014. Google Scholar
  9. Christiane Fellbaum. WordNet. In Roberto Poli, Michael Healy, and Achilles Kameas, editors, Theory and Applications of Ontology: Computer Applications, pages 231-243. Springer Netherlands, 2010. Google Scholar
  10. Rosemary Garris, Robert Ahlers, and James E. Driskell. Games, Motivation, and Learning: A Research and Practice Model. Simulation &Gaming, 33(4):441-467, 2002. Google Scholar
  11. Jonathan Gordon and Lenhart K. Schubert. Discovering Commonsense Entailment Rules Implicit in Sentences. In Proceedings of the EMNLP 2011 Workshop on Textual Entailment (TextInfer'11), Edinburgh, Scotland, UK, 2011. Google Scholar
  12. Kenneth Haase. FramerD: Representing Knowledge in the Large. IBM Systems Journal, 35(3.4):381-397, 1996. Google Scholar
  13. Lynette Hirschman, Marc Light, Eric Breck, and John D. Burger. Deep Read: A Reading Comprehension System. In Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics (ACL'99), pages 325-332, Stroudsburg, PA, USA, 1999. Google Scholar
  14. Jerry R. Hobbs, Mark E. Stickel, Douglas E. Appelt, and Paul Martin. Interpretation as Abduction. Artificial Intelligence, 63(1–2):69-142, 1993. Google Scholar
  15. Hamari Juho and Eranti Veikko. Framework for Designing and Evaluating Game Achievements. In Proceedings of the 5th International Conference of the Digital Research Association (DIGRA'11), Utrecht, Netherlands, January 2011. Google Scholar
  16. Paul Kingsbury and Martha Palmer. From Treebank to Propbank. In Proceedings of the 3rd International Conference on Language, Resources and Evaluation (LREC'02), Las Palmas, Canary Islands, Spain, 2002. Google Scholar
  17. Walter Kintsch. The Role of Knowledge in Discourse Comprehension: A Construction-Integration Model. Psychological Review, 95(2):163, 1988. Google Scholar
  18. Boyang Li, Stephen Lee-Urban, George Johnston, and Mark Riedl. Story Generation with Crowdsourced Plot Graphs. In Proceedings of the 27th AAAI Conference on Artificial Intelligence (AAAI'13), Bellevue, Washington, USA, 2013. Google Scholar
  19. Henry Lieberman, Dustin A. Smith, and Alea Teeters. Common Consensus: A Web-Based Game for Collecting Commonsense Goals. In Proceedings of the Workshop on Common Sense and Intelligent User Interfaces, Honolulu, Hawaii, USA, 2007. Google Scholar
  20. Hugo Liu and Push Singh. ConceptNet - A Practical Commonsense Reasoning Tool-Kit. BT Technology Journal, 22(4):211-226, 2004. Google Scholar
  21. Danielle S. McNamara and Joe Magliano. Toward a Comprehensive Model of Comprehension. Psychology of Learning and Motivation, 51:297-384, 2009. Google Scholar
  22. Loizos Michael. Computability of Narrative. In Proceedings of the 2nd Symposium on Computational Models of Narrative (CMN'10), Arlington, Virginia, USA, 2010. Google Scholar
  23. Loizos Michael. Story Understanding... Calculemus. In Proceedings of the 11th International Symposium on Logical Formalizations of Commonsense Reasoning (Commonsense'13), Ayia Napa, Cyprus, 2013. Google Scholar
  24. Christian Monch, Gisle Grimen, and Roger Midtstraum. Protecting Online Games Against Cheating. In Proceedings of the 5th ACM SIGCOMM Workshop on Network and System Support for Games (NetGames'06), New York, NY, USA, 2006. Google Scholar
  25. Erik T. Mueller. Understanding Script-Based Stories Using Commonsense Reasoning. Cognitive Systems Research, 5(4):307-340, 2004. Google Scholar
  26. Erik T. Mueller. Modelling Space and Time in Narratives About Restaurants. Literary and Linguistic Computing, 22(1):67-84, 2007. Google Scholar
  27. Peter Norvig. A Unified Theory of Inference for Text Understanding. PhD thesis, EECS Department, University of California, Berkeley, January 1987. Google Scholar
  28. Jeff Orkin and Deb Roy. The Restaurant Game: Learning Social Behavior and Language from Thousands of Players Online. Journal of Game Development, 3(1):39-60, 2007. Google Scholar
  29. Roger C. Schank and Robert P. Abelson. Scripts, Plans, Goals, and Understanding: An Inquiry Into Human Knowledge Structures. Artificial Intelligence Series. Psychology Press, 1977. Google Scholar
  30. Murray Shanahan. The Event Calculus Explained. In Michael J. Wooldridge and Manuela Veloso, editors, Artificial Intelligence Today, volume 1600 of Lecture Notes in Computer Science, pages 409-430. Springer Berlin Heidelberg, 1999. Google Scholar
  31. Push Singh. The Public Acquisition of Commonsense Knowledge. In Proceedings of the AAAI Spring Symposium on Acquiring (and Using) Linguistic (and World) Knowledge for Information Access, Palo Alto, California, USA, 2002. Google Scholar
  32. Pat Ronson Stewart. Aesop’s Fables. Dover Children’s Thrift Classics. Dover Publications, 1994. Google Scholar
  33. Luis von Ahn and Laura Dabbish. Labeling Images with a Computer Game. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'04), pages 319-326, New York, NY, USA, 2004. Google Scholar
  34. Luis von Ahn and Laura Dabbish. Designing Games with a Purpose. Communications of the ACM, 51(8):58-67, August 2008. Google Scholar
  35. Luis von Ahn, Mihir Kedia, and Manuel Blum. Verbosity: A Game for Collecting Common-Sense Facts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'06), pages 75-78, New York, NY, USA, 2006. Google Scholar
  36. Aobo Wang, Cong Duy Vu Hoang, and Min-Yen Kan. Perspectives on Crowdsourcing Annotations for Natural Language Processing. Language Resources and Evaluation, 47(1):9-31, 2013. Google Scholar
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail
© 2023-2024 Schloss Dagstuhl – LZI GmbH Imprint Privacy Contact