DROPS

Document

DOI: 10.4230/LIPIcs.GISCIENCE.2018.17

xNet+SC: Classifying Places Based on Images by Incorporating Spatial Contexts

Authors: Bo Yan, Krzysztof Janowicz, Gengchen Mai, and Rui Zhu

Published in: LIPIcs, Volume 114, 10th International Conference on Geographic Information Science (GIScience 2018)

Abstract

With recent advancements in deep convolutional neural networks, researchers in geographic information science gained access to powerful models to address challenging problems such as extracting objects from satellite imagery. However, as the underlying techniques are essentially borrowed from other research fields, e.g., computer vision or machine translation, they are often not spatially explicit. In this paper, we demonstrate how utilizing the rich information embedded in spatial contexts (SC) can substantially improve the classification of place types from images of their facades and interiors. By experimenting with different types of spatial contexts, namely spatial relatedness, spatial co-location, and spatial sequence pattern, we improve the accuracy of state-of-the-art models such as ResNet - which are known to outperform humans on the ImageNet dataset - by over 40%. Our study raises awareness for leveraging spatial contexts and domain knowledge in general in advancing deep learning models, thereby also demonstrating that theory-driven and data-driven approaches are mutually beneficial.

Cite as

Bo Yan, Krzysztof Janowicz, Gengchen Mai, and Rui Zhu. xNet+SC: Classifying Places Based on Images by Incorporating Spatial Contexts. In 10th International Conference on Geographic Information Science (GIScience 2018). Leibniz International Proceedings in Informatics (LIPIcs), Volume 114, pp. 17:1-17:15, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2018)

Copy BibTex To Clipboard

@InProceedings{yan_et_al:LIPIcs.GISCIENCE.2018.17,
  author =	{Yan, Bo and Janowicz, Krzysztof and Mai, Gengchen and Zhu, Rui},
  title =	{{xNet+SC: Classifying Places Based on Images by Incorporating Spatial Contexts}},
  booktitle =	{10th International Conference on Geographic Information Science (GIScience 2018)},
  pages =	{17:1--17:15},
  series =	{Leibniz International Proceedings in Informatics (LIPIcs)},
  ISBN =	{978-3-95977-083-5},
  ISSN =	{1868-8969},
  year =	{2018},
  volume =	{114},
  editor =	{Winter, Stephan and Griffin, Amy and Sester, Monika},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops.dagstuhl.de/entities/document/10.4230/LIPIcs.GISCIENCE.2018.17},
  URN =		{urn:nbn:de:0030-drops-93450},
  doi =		{10.4230/LIPIcs.GISCIENCE.2018.17},
  annote =	{Keywords: Spatial context, Image classification, Place types, Convolutional neural network, Recurrent neural network}
}

Search Results

Documents authored by Yan, Bo

xNet+SC: Classifying Places Based on Images by Incorporating Spatial Contexts

Abstract

Cite as

Thanks for your feedback!

Could not send message