Generalized, Inaccurate, Incomplete: How to Comprehensively Analyze Sketch Maps Beyond Their Metric Correctness

Authors Angela Schwering , Jakub Krukar, Charu Manivannan, Malumbo Chipofya, Sahib Jan

Thumbnail PDF


  • Filesize: 3.17 MB
  • 15 pages

Document Identifiers

Author Details

Angela Schwering
  • Institute for Geoinformatics, Universität Münster, Germany
Jakub Krukar
  • Institute for Geoinformatics, Universität Münster, Germany
Charu Manivannan
  • Institute for Geoinformatics, Universität Münster, Germany
Malumbo Chipofya
  • ITC, University of Twente, Enschede, The Netherlands
Sahib Jan
  • Independent Researcher, Munich, Germany


We thank all supporters of the Sketchmapia project over the last ten years.

Cite AsGet BibTex

Angela Schwering, Jakub Krukar, Charu Manivannan, Malumbo Chipofya, and Sahib Jan. Generalized, Inaccurate, Incomplete: How to Comprehensively Analyze Sketch Maps Beyond Their Metric Correctness. In 15th International Conference on Spatial Information Theory (COSIT 2022). Leibniz International Proceedings in Informatics (LIPIcs), Volume 240, pp. 8:1-8:15, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2022)


Sketch mapping is a method to investigate a person’s spatial perception and knowledge about the surrounding environment. While cartographic maps can be easily evaluated with respect to the represented features, map scale, and spatial accuracy, there still does not exist a comprehensive method to evaluate sketch maps. This paper aims to overcome this gap and proposes a sketch map analysis method that allows for analyzing the completeness, generalization and (qualitative) spatial accuracy of the sketched information in a three-step process. After describing the method, we illustrate how our computer-supported method performs in a use case with three sketch maps. Our approach may assist researchers in geography, psychology, and education to evaluate spatial knowledge in a systematic way independent of specific research questions and experimental scenarios.

Subject Classification

ACM Subject Classification
  • Applied computing → Psychology
  • sketch map analysis
  • spatial knowledge evaluation
  • cognitive map


  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    PDF Downloads


  1. M. Billinghurst and S. Weghorst. The use of sketch maps to measure cognitive maps of virtual environments. In Proceedings Virtual Reality Annual International Symposium '95, pages 40-47, 1995. URL:
  2. Mark Blades. The reliability of data collected from sketch maps. Journal of Environmental Psychology, 10(4):327-339, 1990. Google Scholar
  3. Andreas D. Blaser. A study of people’s sketching habits in GIS. Spatial Cognition & Computation, 2(4):393-419, 2000. URL:
  4. Malumbo Chipofya, Carl Schultz, and Angela Schwering. A metaheuristic approach for efficient and effective sketch-to-metric map alignment. International Journal of Geographical Information Science, 30(2):405-425, 2016. URL:
  5. Roger M. Downs and David Stea. Cognitive maps and spatial behavior: Process and products, pages 8-26. Aldine Press, Chicago, USA, 1970. Google Scholar
  6. Alinda Friedman and Bernd Kohler. Bidimensional regression: assessing the configural similarity and accuracy of cognitive maps and other two-dimensional data sets. Psychological methods, 8(4):468, 2003. Google Scholar
  7. Kevin A. Hallgren. Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial. Tutorials in quantitative methods for psychology, 8(1):23-34, 2012. Google Scholar
  8. Kateřina Hátlová and Martin Hanus. A systematic review into factors influencing sketch map quality. ISPRS International Journal of Geo-Information, 9(4), 2020. URL:
  9. Keith J Holyoak and Wesley A Mah. Cognitive reference points in judgments of symbolic magnitude. Cognitive Psychology, 14(3):328-352, July 1982. URL:
  10. Sahib Jan, Angela Schwering, Carl Schultz, and Malumbo Chaka Chipofya. Cognitively plausible representations for the alignment of sketch and geo-referenced maps. Journal of Spatial Information Science, 14:31-59, June 2017. Google Scholar
  11. K Lynch. The Image of the City. MIT Press, 1960. Google Scholar
  12. Charu Manivannan, Jakub Krukar, and Angela Schwering. Generalisation in Sketch Maps - A Systematic Classification of Different Generalization Types for Sketch Map Analysis. Journal of Environmental Psychology, under review. Google Scholar
  13. Charu Manivannan, Angela Schwering, Malumbo Chipofya, and Sahib Jan. Categorization of generalization in sketch maps. In Poster at the 14th International Conference on Spatial Information Theory, Regensburg, Germany, 2019. Google Scholar
  14. Timothy P. Mcnamara and Vaibhav A. Diwadkar. Symmetry and Asymmetry of Human Spatial Memory. Cognitive Psychology, 34(2):160-190, November 1997. URL:
  15. Daniel R. Montello. Behavioral Methods for Spatial Cognition Research. In Research Methods for Environmental Psychology, chapter 9, pages 161-181. John Wiley & Sons, Ltd, 2016. URL:
  16. Stefan Münzer, Hubert D. Zimmer, and Jörg Baus. Navigation assistance: A trade-off between wayfinding support and configural learning support. Journal of Experimental Psychology: Applied, 18(1):18-37, 2012. URL:
  17. Konstantinos A. Nedas. Semantic Similarity of Spatial Scenes. PhD thesis, The University of Maine, 2006. Google Scholar
  18. Konstantinos A Nedas and Max J Egenhofer. Spatial-Scene Similarity Queries. Transactions in GIS, 12(6):661-681, 2008. URL:
  19. Thomas Saarinen, Michael Parton, and Roy Billberg. Relative Size of Continents on World Sketch Maps. Cartographica: The International Journal for Geographic Information and Geovisualization, 33(2):37-48, June 1996. URL:
  20. Edward K. Sadalla and Stephen G. Magel. The Perception of Traversed Distance. Environment and Behavior, 12(1):65-79, March 1980. URL:
  21. Angela Schwering, Sahib Jan, Jakub Krukar, and Malumbo Chipofya. Evaluating Sketch Maps Qualitatively: A new Software-Supported Method. In Poster at the International Conference on Spatial Cognition, September 2019, Freiburg, Germany., 2019. Google Scholar
  22. Angela Schwering, Jia Wang, Malumbo Chipofya, Sahib Jan, Rui Li, and Klaus Broelemann. SketchMapia: Qualitative Representations for the Alignment of Sketch and Metric Maps. Spatial Cognition & Computation, 14(3):220-254, July 2014. URL:
  23. Alexander W. Siegel and Sheldon H. White. The Development of Spatial Representations of Large-Scale Environments. In Hayne W. Reese, editor, Advances in Child Development and Behavior, volume 10, pages 9-55. JAI, January 1975. URL:
  24. Albert Stevens and Patty Coupe. Distortions in judged spatial relations. Cognitive Psychology, 10(4):422-437, October 1978. URL:
  25. Perry W Thorndyke. Distance estimation from cognitive maps. Cognitive psychology, 13(4):526-550, 1981. Google Scholar
  26. Barbara Tversky. Distortions in memory for maps. Cognitive Psychology, 13(3):407-433, July 1981. URL:
  27. Barbara Tversky. Cognitive maps, cognitive collages, and spatial mental models. In Andrew U. Frank and Irene Campari, editors, Spatial Information Theory A Theoretical Basis for GIS, Lecture Notes in Computer Science, pages 14-24, Berlin, Heidelberg, 1993. Springer. URL:
  28. Jia Wang and Angela Schwering. Invariant spatial information in sketch maps - A study of survey sketch maps of urban areas. Journal of Spatial Information Science, 11, 2015. URL: