1 Search Results for "Yan, Bo"

Document
DOI: 10.4230/LIPIcs.GISCIENCE.2018.17
xNet+SC: Classifying Places Based on Images by Incorporating Spatial Contexts

Authors: Bo Yan, Krzysztof Janowicz, Gengchen Mai, and Rui Zhu

Published in: LIPIcs, Volume 114, 10th International Conference on Geographic Information Science (GIScience 2018)

Abstract
With recent advancements in deep convolutional neural networks, researchers in geographic information science gained access to powerful models to address challenging problems such as extracting objects from satellite imagery. However, as the underlying techniques are essentially borrowed from other research fields, e.g., computer vision or machine translation, they are often not spatially explicit. In this paper, we demonstrate how utilizing the rich information embedded in spatial contexts (SC) can substantially improve the classification of place types from images of their facades and interiors. By experimenting with different types of spatial contexts, namely spatial relatedness, spatial co-location, and spatial sequence pattern, we improve the accuracy of state-of-the-art models such as ResNet - which are known to outperform humans on the ImageNet dataset - by over 40%. Our study raises awareness for leveraging spatial contexts and domain knowledge in general in advancing deep learning models, thereby also demonstrating that theory-driven and data-driven approaches are mutually beneficial.
Cite as

Bo Yan, Krzysztof Janowicz, Gengchen Mai, and Rui Zhu. xNet+SC: Classifying Places Based on Images by Incorporating Spatial Contexts. In 10th International Conference on Geographic Information Science (GIScience 2018). Leibniz International Proceedings in Informatics (LIPIcs), Volume 114, pp. 17:1-17:15, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2018)

Copy BibTex To Clipboard

@InProceedings{yan_et_al:LIPIcs.GISCIENCE.2018.17,
  author =	{Yan, Bo and Janowicz, Krzysztof and Mai, Gengchen and Zhu, Rui},
  title =	{{xNet+SC: Classifying Places Based on Images by Incorporating Spatial Contexts}},
  booktitle =	{10th International Conference on Geographic Information Science (GIScience 2018)},
  pages =	{17:1--17:15},
  series =	{Leibniz International Proceedings in Informatics (LIPIcs)},
  ISBN =	{978-3-95977-083-5},
  ISSN =	{1868-8969},
  year =	{2018},
  volume =	{114},
  editor =	{Winter, Stephan and Griffin, Amy and Sester, Monika},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops-dev.dagstuhl.de/entities/document/10.4230/LIPIcs.GISCIENCE.2018.17},
  URN =		{urn:nbn:de:0030-drops-93450},
  doi =		{10.4230/LIPIcs.GISCIENCE.2018.17},
  annote =	{Keywords: Spatial context, Image classification, Place types, Convolutional neural network, Recurrent neural network}
}
  • Refine by Author
  • 1 Janowicz, Krzysztof
  • 1 Mai, Gengchen
  • 1 Yan, Bo
  • 1 Zhu, Rui

  • Refine by Classification
  • 1 Computing methodologies → Computer vision tasks
  • 1 Computing methodologies → Neural networks
  • 1 Theory of computation → Bayesian analysis

  • Refine by Keyword
  • 1 Convolutional neural network
  • 1 Image classification
  • 1 Place types
  • 1 Recurrent neural network
  • 1 Spatial context

  • Refine by Type
  • 1 document

  • Refine by Publication Year
  • 1 2018

Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail
© 2023-2024 Schloss Dagstuhl – LZI GmbH Imprint Privacy Contact