Document Open Access Logo

What Is a Spatio-Temporal Model Good For?: Validity as a Function of Purpose and the Questions Answered by a Model

Authors Simon Scheider , Judith A. Verstegen

PDF

File

Thumbnail PDF
PDF
LIPIcs.COSIT.2024.7.pdf
  • Filesize: 4.08 MB
  • 23 pages

Document Identifiers

Subject Classification

ACM Subject Classification
  • Computing methodologies → Discourse, dialogue and pragmatics
Keywords
  • validity
  • fitness-for-purpose
  • spatio-temporal modeling
  • pragmatics
  • question grammar

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads
    0
    Metadata Views

Abstract

The concept of validity is a cornerstone of science. Given this central role, it is somewhat surprising to find that validity remains a rather obscure concept. Unfortunately, the term is often reduced to a matter of ground truth data, seemingly because we fail to come to grips with it. In this paper, instead, we take a purpose-based approach to the validity of spatio-temporal models. We argue that a model application is valid only if the model delivers an answer to a particular spatio-temporal question specifying some experiment including spatio-temporal controls and measures. Such questions constitute the information purposes of models, forming an intermediate layer in a pragmatic knowledge pyramid with corresponding levels of validity. We introduce a corresponding question-based grammar that allows us to formally distinguish among contemporary inference, prediction, retrodiction, projection, and retrojection models. We apply the grammar to corresponding examples and discuss the possibilities for validating such models as a means to a given end.

Cite As Get BibTex

Simon Scheider and Judith A. Verstegen. What Is a Spatio-Temporal Model Good For?: Validity as a Function of Purpose and the Questions Answered by a Model. In 16th International Conference on Spatial Information Theory (COSIT 2024). Leibniz International Proceedings in Informatics (LIPIcs), Volume 315, pp. 7:1-7:23, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2024) https://doi.org/10.4230/LIPIcs.COSIT.2024.7

Author Details

Simon Scheider
  • Department of Human Geography and Spatial Planning, Utrecht University, The Netherlands
Judith A. Verstegen
  • Department of Human Geography and Spatial Planning, Utrecht University, The Netherlands

Funding

  • Scheider, Simon: Supported by the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 803498).

Supplementary Materials

References

  1. Craig A Aumann. A methodology for developing simulation models of complex systems. Ecological Modelling, 202(3-4):385-396, 2007. Google Scholar
  2. Peter Bauer, Alan Thorpe, and Gilbert Brunet. The quiet revolution of numerical weather prediction. Nature, 525(7567):47-55, 2015. Google Scholar
  3. Hal Caswell. 12: The validation problem. In Bernard C. Patten, editor, Systems analysis and simulation in ecology, volume 4, pages 313-325. Academic Press Inc., 1976. Google Scholar
  4. Roderick M Chisholm. Theory of knowledge, volume 3. Prentice-Hall Englewood Cliffs, NJ, 1989. Google Scholar
  5. Nicholas R Chrisman. Exploring geographic information systems. Wiley New York, 2002. Google Scholar
  6. Lee J Cronbach and Paul E Meehl. Construct validity in psychological tests. Psychological bulletin, 52(4):281, 1955. Google Scholar
  7. Jared Diamond. Laboratory experiments, field experiments, and natural experiments. Community ecology, pages 3-22, 1986. Google Scholar
  8. Deborah Dowling. Experimenting on theories. Science in context, 12(2):261-273, 1999. Google Scholar
  9. Roman Frigg. Scientific representation and the semantic view of theories. Theoria. Revista de Teoría, Historia y Fundamentos de la Ciencia, 21(1):49-65, 2006. Google Scholar
  10. Stan Geertman, Tom de Jong, Coen Wessels, and Jan Bleeker. The relocation of ambulance facilities in central Rotterdam. Applied GIS and Spatial Analysis, pages 215-232, 2003. Google Scholar
  11. Ronald N Giere. How models are used to represent reality. Philosophy of science, 71(5):742-752, 2004. Google Scholar
  12. Lucas Gren. Standards of validity and the validity of standards in behavioral software engineering research: the perspective of psychological test theory. In Proceedings of the 12th ACM/IEEE international symposium on empirical software engineering and measurement, pages 1-4, 2018. Google Scholar
  13. Stephan Hartmann. The world as a process: Simulations in the natural and social sciences. In Modelling and simulation in the social sciences from the philosophy of science point of view, pages 77-100. Springer, 1996. Google Scholar
  14. Katharina Hölscher and Niki Frantzeskaki. Transformative climate governance: a capacities perspective to systematise, evaluate and guide climate action. Springer, 2020. Google Scholar
  15. Peter Janich. Was ist Wahrheit?: eine philosophische Einführung, volume 2052. CH Beck, 1996. Google Scholar
  16. Peter Janich. Logisch-pragmatische Propädeutik: ein Grundkurs im philosophischen Reflektieren. Velbrück Wiss., 2001. Google Scholar
  17. Peter Janich. Die Naturalisierung der Information. In Kultur und Methode, pages 213-255. Suhrkamp, 2006. Google Scholar
  18. Peter Janich. What is information?, volume 55. University of Minnesota Press, 2018. Google Scholar
  19. Werner Kuhn. Core concepts of spatial information for transdisciplinary research. International Journal of Geographical Information Science, 26(12):2267-2276, 2012. Google Scholar
  20. Nina Siu-Ngan Lam. Spatial interpolation methods: a review. The American Cartographer, 10(2):129-150, 1983. Google Scholar
  21. Johannes Lenhard, Günter Küppers, and Terry Shinn. Simulation: Pragmatic constructions of reality, volume 25. Springer Science & Business Media, 2007. Google Scholar
  22. Matthew McBee. Statistical approaches to causal analysis. Statistical Approaches to Causal Analysis, pages 1-160, 2022. Google Scholar
  23. Samuel Messick. Standards of validity and the validity of standards in performance asessment. Educational measurement: Issues and practice, 14(4):5-8, 1995. Google Scholar
  24. Jorge Andrés Moncada, Judith A. Verstegen, John Alexander Posada, Martin Junginger, Zofia Lukszo, André Faaij, and Margot Weijnen. Exploring policy options to spur the expansion of ethanol production and consumption in brazil: An agent-based modeling approach. Energy Policy, 123:619-641, 2018. Google Scholar
  25. Giovanni Mosetti, Carlo Poloni, and Bruno Diviacco. Optimization of wind turbine positioning in large windfarms by means of a genetic algorithm. Journal of Wind Engineering and Industrial Aerodynamics, 51(1):105-116, 1994. Google Scholar
  26. Allan H Murphy. What is a good forecast? An essay on the nature of goodness in weather forecasting. Weather and forecasting, 8(2):281-293, 1993. Google Scholar
  27. Nico Neureiter, Peter Ranacher, Rik van Gijn, Balthasar Bickel, and Robert Weibel. Can Bayesian phylogeography reconstruct migrations and expansions in linguistic evolution? Royal Society open science, 8(1):201079, 2021. Google Scholar
  28. Enkhbold Nyamsuren, Haiqi Xu, Eric J Top, Simon Scheider, and Niels Steenbergen. Semantic complexity of geographic questions-a comparison in terms of conceptual transformations of answers. AGILE: GIScience Series, 4:10, 2023. Google Scholar
  29. Stan Openshaw. Using models in planning: a practical guide. Retailing and Planning Associates, 1978. Google Scholar
  30. Naomi Oreskes, Kristin Shrader-Frechette, and Kenneth Belitz. Verification, validation, and confirmation of numerical models in the earth sciences. Science, 263(5147):641-646, 1994. Google Scholar
  31. Judea Pearl. Causality. Cambridge University Press, 2009. Google Scholar
  32. Jaco Quist. Backcasting for a sustainable future: the impact after 10 years. Eburon Uitgeverij BV, 2007. Google Scholar
  33. Edward J Rykiel Jr. Testing ecological models: the meaning of validation. Ecological modelling, 90(3):229-244, 1996. Google Scholar
  34. Gilbert Ryle. The concept of mind. Hutchinson, 1949. Google Scholar
  35. Simon Scheider. Spatio-temporal modeling questions. Dataset, (visited on 2024-07-08). URL: https://github.com/simonscheider/ModelQuestions
    Software Heritage Logo archived version
    full metadata available at: https://doi.org/10.4230/artifacts.22460
  36. Simon Scheider. Spatio-temporal modeling questions. Technical report, Utrecht University, 2024. URL: https://doi.org/10.5281/zenodo.11066986.
  37. Simon Scheider and Tom de Jong. A conceptual model for automating spatial network analysis. Transactions in GIS, 26(1):421-458, 2022. Google Scholar
  38. Simon Scheider, Rogier Meerlo, Vedran Kasalica, and Anna-Lena Lamprecht. Ontology of core concept data types for answering geo-analytical questions. Journal of Spatial Information Science, 20:167-201, 2020. Google Scholar
  39. Simon Scheider, Enkhbold Nyamsuren, Han Kruiger, and Haiqi Xu. Geo-analytical question-answering with GIS. International Journal of Digital Earth, 14(1):1-14, 2021. Google Scholar
  40. Simon Scheider and Kai-Florian Richter. Pragmatic GeoAI: Geographic information as externalized practice. KI-Künstliche Intelligenz, 37(1):17-31, 2023. Google Scholar
  41. David Sinton. The inherent structure of information as a constraint to analysis: Mapped thematic data as a case study. Harvard papers on geographic information systems, 1978. Google Scholar
  42. Joseph D Sneed. Structuralism and scientific realism. In Methodology, Epistemology, and Philosophy of Science: Essays in Honour of Wolfgang Stegmüller on the Occasion of His 60th Birthday, June 3rd, 1983, pages 345-370. Springer, 1983. Google Scholar
  43. Tabea S Sonnenschein, G Ardine de Wit, Nicolette R den Braver, Roel CH Vermeulen, and Simon Scheider. Validating and constructing behavioral models for simulation and projection using automated knowledge extraction. Information Sciences, 662:120232, 2024. Google Scholar
  44. Niels Steenbergen, Eric Top, Enkhbold Nyamsuren, and Simon Scheider. Procedural metadata for geographic information using an algebra of core concept transformations. Journal of Spatial Information Science, 27:51-92, 2023. Google Scholar
  45. Claudia Tebaldi, Kevin Debeire, Veronika Eyring, Erich Fischer, John Fyfe, Pierre Friedlingstein, Reto Knutti, Jason Lowe, Brian O'Neill, Benjamin Sanderson, et al. Climate model projections from the scenario model intercomparison project (ScenarioMIP) of CMIP6. Earth System Dynamics Discussions, 2020:1-50, 2020. Google Scholar
  46. Eric Top, Simon Scheider, Haiqi Xu, Enkhbold Nyamsuren, and Niels Steenbergen. The semantics of extensive quantities within geographic information. Applied Ontology, 17(3):337-364, 2022. URL: https://doi.org/10.3233/AO-220268.
  47. Christian Troost, Andrew Reid Bell, Hedwig van Delden, Robert Huber, Tatiana Filatova, Quang Bao Le, Melvin Lippe, Leila Niamir, J Gareth Polhill, Zhanli Sun, and Thomas Berger. How to keep it adequate: A validation protocol for agent-based simulation. Environmental Modelling & software, 2023. URL: https://doi.org/10.1016/j.envsoft.2022.105559.
  48. Zeynep Tufekci. Big questions for social media big data: Representativeness, validity and other methodological pitfalls. In Eighth international AAAI conference on weblogs and social media, 2014. Google Scholar
  49. Behzad Vahedi, Werner Kuhn, and Andrea Ballatore. Question-based spatial computing—a case study. In Geospatial Data in a Changing World: Selected papers of the 19th AGILE Conference on Geographic Information Science, pages 37-50. Springer, 2016. Google Scholar
  50. JR Ritsema Van Eck and Tom de Jong. Accessibility analysis and spatial competition effects in the context of GIS-supported service location planning. Computers, environment and urban systems, 23(2):75-89, 1999. Google Scholar
  51. Judith Verstegen and Simon Scheider. Why the term prediction is overused. In Spatial Data Science Symposium 2023 Short Paper Proceedings. UC Santa Barbara: Center for Spatial Studies, 2023. Google Scholar
  52. Georg Henrik Von Wright. Explanation and understanding. Cornell University Press, 2004. Google Scholar
  53. Leland Wilkinson. The grammar of graphics. Springer, 2012. Google Scholar
  54. Haiqi Xu, Enkhbold Nyamsuren, Simon Scheider, and Eric Top. A grammar for interpreting geo-analytical questions as concept transformations. International Journal of Geographical Information Science, 37(2):276-306, 2023. Google Scholar
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail
© 2023-2025 Schloss Dagstuhl – LZI GmbH About DROPS Imprint Privacy Contact