Propagation of Uncertainty for Volunteered Geographic Information in Machine Learning (Short Paper)

Authors Jin Xing , Renee E. Sieber

Thumbnail PDF


  • Filesize: 248 kB
  • 6 pages

Document Identifiers

Author Details

Jin Xing
  • Centre for Research in Geomatics, Laval University, Quebec City, Canada
Renee E. Sieber
  • Department of Geography, McGill University, Montreal, Canada

Cite AsGet BibTex

Jin Xing and Renee E. Sieber. Propagation of Uncertainty for Volunteered Geographic Information in Machine Learning (Short Paper). In 10th International Conference on Geographic Information Science (GIScience 2018). Leibniz International Proceedings in Informatics (LIPIcs), Volume 114, pp. 66:1-66:6, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2018)


Although crowdsourcing drives much of the interest in Machine Learning (ML) in Geographic Information Science (GIScience), the impact of uncertainty of Volunteered Geographic Information (VGI) on ML has been insufficiently studied. This significantly hampers the application of ML in GIScience. In this paper, we briefly delineate five common stages of employing VGI in ML processes, introduce some examples, and then describe propagation of uncertainty of VGI.

Subject Classification

ACM Subject Classification
  • Information systems → Uncertainty
  • Uncertainty
  • Machine Learning
  • Volunteered Geographic Information
  • Uncertainty Propagation


  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    PDF Downloads


  1. Julia Angwin. Make algorithms accountable. The New York Times, 1, 2016. Google Scholar
  2. Tolga Bolukbasi, Kai-Wei Chang, James Y Zou, Venkatesh Saligrama, and Adam T Kalai. Man is to computer programmer as woman is to homemaker? debiasing word embeddings. In Advances in Neural Information Processing Systems, pages 4349-4357, 2016. Google Scholar
  3. Kumar Chellapilla and Patrice Y Simard. Using machine learning to break visual human interaction proofs (hips). In Advances in neural information processing systems, pages 265-272, 2005. Google Scholar
  4. Cheng-Tao Chu, Sang K Kim, Yi-An Lin, YuanYuan Yu, Gary Bradski, Kunle Olukotun, and Andrew Y Ng. Map-reduce for machine learning on multicore. In Advances in neural information processing systems, pages 281-288, 2007. Google Scholar
  5. Joao Porto De Albuquerque, Benjamin Herfort, Alexander Brenning, and Alexander Zipf. A geographic approach for combining social media and authoritative data towards identifying useful information for disaster management. International Journal of Geographical Information Science, 29(4):667-689, 2015. Google Scholar
  6. Shengyong Ding, Liang Lin, Guangrun Wang, and Hongyang Chao. Deep feature learning with relative distance comparison for person re-identification. Pattern Recognition, 48(10):2993-3003, 2015. Google Scholar
  7. Pedro F Felzenszwalb, Ross B Girshick, David McAllester, and Deva Ramanan. Object detection with discriminatively trained part-based models. IEEE transactions on pattern analysis and machine intelligence, 32(9):1627-1645, 2010. Google Scholar
  8. Andrew J Flanagin and Miriam J Metzger. The credibility of volunteered geographic information. GeoJournal, 72(3-4):137-148, 2008. Google Scholar
  9. Noah W Garfinkle, Lucas Selig, Timothy K Perkins, and George W Calfas. Geoparsing text for characterizing urban operational environments through machine learning techniques. In Geospatial Informatics, Fusion, and Motion Video Analytics VII, volume 10199, page 101990C. International Society for Optics and Photonics, 2017. Google Scholar
  10. Michael F Goodchild. Citizens as sensors: the world of volunteered geography. GeoJournal, 69(4):211-221, 2007. Google Scholar
  11. Michael F Goodchild. Commentary: whither vgi? GeoJournal, 72(3-4):239-244, 2008. Google Scholar
  12. Michael F Goodchild and J Alan Glennon. Crowdsourcing geographic information for disaster response: a research frontier. International Journal of Digital Earth, 3(3):231-241, 2010. Google Scholar
  13. Michael F Goodchild and Linna Li. Assuring the quality of volunteered geographic information. Spatial statistics, 1:110-120, 2012. Google Scholar
  14. Joel Grira, Yvan Bédard, and Stéphane Roche. Spatial data uncertainty in the vgi world: Going from consumer to producer. Geomatica, 64(1):61-72, 2010. Google Scholar
  15. Mordechai Haklay and Patrick Weber. Openstreetmap: User-generated street maps. IEEE Pervasive Computing, 7(4):12-18, 2008. Google Scholar
  16. Michael I Jordan and Tom M Mitchell. Machine learning: Trends, perspectives, and prospects. Science, 349(6245):255-260, 2015. Google Scholar
  17. Ece Kamar, Severin Hacker, and Eric Horvitz. Combining human and machine intelligence in large-scale crowdsourcing. In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems-Volume 1, pages 467-474. International Foundation for Autonomous Agents and Multiagent Systems, 2012. Google Scholar
  18. M Kanevski, A Pozdnukhov, and V Timonin. Machine learning algorithms for geospatial data. applications and software tools. In Proceedings of the 4th International Congress on Environmental Modelling and Software, 2008. Google Scholar
  19. Leyla Kazemi and Cyrus Shahabi. Geocrowd: enabling query answering with spatial crowdsourcing. In Proceedings of the 20th international conference on advances in geographic information systems, pages 189-198. ACM, 2012. Google Scholar
  20. Somesh Kumar. Methods for community participation: a complete guide for practitioners. New Delhi (India) Vistaar Pub., 2002. Google Scholar
  21. Jae-Gil Lee and Minseo Kang. Geospatial big data: challenges and opportunities. Big Data Research, 2(2):74-81, 2015. Google Scholar
  22. Jin Liu, Xiao Yu, Zheng Xu, Kim-Kwang Raymond Choo, Liang Hong, and Xiaohui Cui. A cloud-based taxi trace mining framework for smart city. Software: Practice and Experience, 47(8):1081-1094, 2017. Google Scholar
  23. Gary Marcus. Deep learning: A critical appraisal. arXiv preprint arXiv:1801.00631, 2018. Google Scholar
  24. Amelia McNamara and Aran Lunzer. Exploring the effects of spatial aggregation, 2016. Google Scholar
  25. Julian D Olden, Joshua J Lawler, and N LeRoy Poff. Machine learning methods without tears: a primer for ecologists. The Quarterly review of biology, 83(2):171-193, 2008. Google Scholar
  26. Cathy O'Neil. Weapons of math destruction: How big data increases inequality and threatens democracy. Broadway Books, 2017. Google Scholar
  27. Georgios Paliouras, Vangelis Karkaletsis, Georgios Petasis, and Constantine D Spyropoulos. Learning decision trees for named-entity recognition and classification. In ECAI Workshop on Machine Learning for Information Extraction, 2000. Google Scholar
  28. Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, et al. Scikit-learn: Machine learning in python. Journal of machine learning research, 12(Oct):2825-2830, 2011. Google Scholar
  29. Chris Perkins. Plotting practices and politics:(im) mutable narratives in openstreetmap. Transactions of the Institute of British Geographers, 39(2):304-317, 2014. Google Scholar
  30. Sara Sabour, Nicholas Frosst, and Geoffrey E Hinton. Dynamic routing between capsules. In Advances in Neural Information Processing Systems, pages 3859-3869, 2017. Google Scholar
  31. Hossein Shafizadeh-Moghadam, Ali Asghari, Mohammad Taleai, Marco Helbich, and Amin Tayyebi. Sensitivity analysis and accuracy assessment of the land transformation model using cellular automata. GIScience &Remote Sensing, 54(5):639-656, 2017. Google Scholar
  32. Anna L Swan, Dov J Stekel, Charlie Hodgman, David Allaway, Mohammed H Alqahtani, Ali Mobasheri, and Jaume Bacardit. A machine learning heuristic to identify biologically relevant and minimal biomarker panels from omics data. BMC genomics, 16(1):S2, 2015. Google Scholar
  33. Liangpei Zhang, Lefei Zhang, and Bo Du. Deep learning for remote sensing data: A technical tutorial on the state of the art. IEEE Geoscience and Remote Sensing Magazine, 4(2):22-40, 2016. Google Scholar
  34. Bolei Zhou, Agata Lapedriza, Jianxiong Xiao, Antonio Torralba, and Aude Oliva. Learning deep features for scene recognition using places database. In Advances in neural information processing systems, pages 487-495, 2014. Google Scholar