Issue
Dagstuhl Reports, Volume 12, Issue 10
-
Part of:
Volume:
Dagstuhl Reports, Volume 12
Journal: Dagstuhl Reports (DagRep)
Publication Details
- published at: 2023-05-03
- Publisher: Schloss Dagstuhl – Leibniz-Zentrum für Informatik
- DBLP: db/journals/dagstuhl-reports/dagstuhl-reports12
Access Numbers
- Detailed Access Statistics available here
-
Total Document Accesses (updated on a weekly basis):
0PDF Downloads
Documents
No documents found matching your filter selection.
Document
Complete Issue
Dagstuhl Reports, Volume 12, Issue 10, October 2022, Complete Issue
Abstract
Dagstuhl Reports, Volume 12, Issue 10, October 2022, Complete Issue
Cite as
Dagstuhl Reports, Volume 12, Issue 10, pp. 1-242, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2023)
Copy BibTex To Clipboard
@Article{DagRep.12.10,
title = {{Dagstuhl Reports, Volume 12, Issue 10, October 2022, Complete Issue}},
pages = {1--242},
journal = {Dagstuhl Reports},
ISSN = {2192-5283},
year = {2023},
volume = {12},
number = {10},
publisher = {Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
address = {Dagstuhl, Germany},
URL = {https://drops-dev.dagstuhl.de/entities/document/10.4230/DagRep.12.10},
URN = {urn:nbn:de:0030-drops-178178},
doi = {10.4230/DagRep.12.10},
annote = {Keywords: Dagstuhl Reports, Volume 12, Issue 10, October 2022, Complete Issue}
}
Document
Front Matter
Dagstuhl Reports, Table of Contents, Volume 12, Issue 10, 2022
Abstract
Dagstuhl Reports, Table of Contents, Volume 12, Issue 10, 2022
Cite as
Dagstuhl Reports, Volume 12, Issue 10, pp. i-ii, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2023)
Copy BibTex To Clipboard
@Article{DagRep.12.10.i,
title = {{Dagstuhl Reports, Table of Contents, Volume 12, Issue 10, 2022}},
pages = {i--ii},
journal = {Dagstuhl Reports},
ISSN = {2192-5283},
year = {2023},
volume = {12},
number = {10},
publisher = {Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
address = {Dagstuhl, Germany},
URL = {https://drops-dev.dagstuhl.de/entities/document/10.4230/DagRep.12.10.i},
URN = {urn:nbn:de:0030-drops-178185},
doi = {10.4230/DagRep.12.10.i},
annote = {Keywords: Table of Contents, Frontmatter}
}
Document
Computer Science Methods for Effective and Sustainable Simulation Studies (Dagstuhl Seminar 22401)
Abstract
This report documents the program and the (preliminary) outcomes of Dagstuhl Seminar 22401 "Computer Science Methods for Effective and Sustainable Simulation Studies". The seminar has been dedicated to addressing central methodological challenges in conducting effective and sustainable simulation studies. Lightning talks provided the opportunity for participants to present their current research and ideas to advance methodological research in modeling and simulation. However, the lion’s share of the seminar was dedicated to working groups. One working group investigated how machine learning and modeling and simulation can be effectively integrated (Intelligent Modeling and Simulation Lifecycle). Another working group focused on methodological challenges to support policy via simulation (Policy by simulation: seeing is believing for interactive model co-creation and effective intervention). A third working group identified 4 challenges closely tied to the quest for sustainable simulation studies (Context, composition, automation, and communication - towards sustainable simulation studies) thereby, focusing on the role of model-based approaches and related methods.
Cite as
Wentong Cai, Christopher Carothers, David M. Nicol, and Adelinde M. Uhrmacher. Computer Science Methods for Effective and Sustainable Simulation Studies (Dagstuhl Seminar 22401). In Dagstuhl Reports, Volume 12, Issue 10, pp. 1-60, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2023)
Copy BibTex To Clipboard
@Article{cai_et_al:DagRep.12.10.1,
author = {Cai, Wentong and Carothers, Christopher and Nicol, David M. and Uhrmacher, Adelinde M.},
title = {{Computer Science Methods for Effective and Sustainable Simulation Studies (Dagstuhl Seminar 22401)}},
pages = {1--60},
journal = {Dagstuhl Reports},
ISSN = {2192-5283},
year = {2023},
volume = {12},
number = {10},
editor = {Cai, Wentong and Carothers, Christopher and Nicol, David M. and Uhrmacher, Adelinde M.},
publisher = {Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
address = {Dagstuhl, Germany},
URL = {https://drops-dev.dagstuhl.de/entities/document/10.4230/DagRep.12.10.1},
URN = {urn:nbn:de:0030-drops-178196},
doi = {10.4230/DagRep.12.10.1},
annote = {Keywords: Modeling, simulation, high performance computing, machine learning, visual analytics}
}
Document
Foundations for a New Perspective of Understanding Programming (Dagstuhl Seminar 22402)
Abstract
Software is created by people who think, feel, and express themselves to one another and their computers. For a long time, researchers have investigated how people read and write code on their computers and talk about code with one another. This way, researchers identified skills, education, and practices necessary to acquire expertise and perform software development duties. While these investigations are valuable, we have yet to devise and validate a scientific theory of program comprehension, which would be an important step in designing support for developers that is tailored to their cognitive needs. To succeed, we need techniques to shed more light on how programmers think. To this end, we need to look beyond computer science research.
Specifically, in the field of psychology and cognitive neuroscience, considerable progress has been made in building theories of cognitive processes. Important enabling technologies include eye tracking, functional magnetic resonance imaging (fMRI), electroencephalography (EEG), and functional near infrared spectroscopy (fNIRS). These methods have revolutionized the understanding of cognitive processes and are routinely used in non-computing disciplines. Such techniques have the potential to also modernize classic approaches to program comprehension research by informing new experimental designs. However, the use of such technologies to study program comprehension is recent, and many of the challenges of this interdisciplinary field remain unexplored.
This report documents the program and the outcomes of Dagstuhl Seminar 22402, "Foundations for a New Perspective of Understanding Programming", which explores these challenges. In total, 23 on-site participants attended the seminar along with two virtual keynote speakers. Participants engaged in intensive collaboration, including discussing past and current research, identifying gaps in the literature, and proposing future directions for improving the state of the art in program comprehension research.
Cite as
Madeline Endres, André Brechmann, Bonita Sharif, Westley Weimer, and Janet Siegmund. Foundations for a New Perspective of Understanding Programming (Dagstuhl Seminar 22402). In Dagstuhl Reports, Volume 12, Issue 10, pp. 61-83, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2023)
Copy BibTex To Clipboard
@Article{endres_et_al:DagRep.12.10.61,
author = {Endres, Madeline and Brechmann, Andr\'{e} and Sharif, Bonita and Weimer, Westley and Siegmund, Janet},
title = {{Foundations for a New Perspective of Understanding Programming (Dagstuhl Seminar 22402)}},
pages = {61--83},
journal = {Dagstuhl Reports},
ISSN = {2192-5283},
year = {2023},
volume = {12},
number = {10},
editor = {Endres, Madeline and Brechmann, Andr\'{e} and Sharif, Bonita and Weimer, Westley and Siegmund, Janet},
publisher = {Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
address = {Dagstuhl, Germany},
URL = {https://drops-dev.dagstuhl.de/entities/document/10.4230/DagRep.12.10.61},
URN = {urn:nbn:de:0030-drops-178209},
doi = {10.4230/DagRep.12.10.61},
annote = {Keywords: Programming Methodology, Programming Education, Program Comprehension, Neuro-imaging, Eye Tracking, Human Cognition, Human Computer Interaction, Software Engineering, Human Factors}
}
Document
Theory and Practice of SAT and Combinatorial Solving (Dagstuhl Seminar 22411)
Abstract
This report documents the program and the outcomes of Dagstuhl Seminar 22411 "Theory and Practice of SAT and Combinatorial Solving". The purpose of this workshop was to explore the Boolean satisfiability (SAT) problem, which plays a fascinating dual role in computer science. By the theory of NP-completeness, this problem captures thousands of important applications in different fields, and a rich mathematical theory has been developed showing that all these problems are likely to be infeasible to solve in the worst case. But real-world problems are typically not worst-case, and in recent decades exceedingly efficient algorithms based on so-called conflict-driven clause learning (CDCL) have turned SAT solvers into highly practical tools for solving large-scale real-world problems in a wide range of application areas. Analogous developments have taken place for problems beyond NP such as SAT-based optimization (MaxSAT), pseudo-Boolean optimization, satisfiability modulo theories (SMT) solving, quantified Boolean formula (QBF) solving, constraint programming, and mixed integer programming, where the conflict-driven paradigm has sometimes been added to other powerful techniques. The current state of the art in combinatorial solving presents a host of exciting challenges at the borderline between theory and practice. Can we gain a deeper scientific understanding of the techniques and heuristics used in modern combinatorial solvers and why they are so successful? Can we develop tools for rigorous analysis of the potential and limitations of these algorithms? Can computational complexity theory be extended to shed light on real-world settings that go beyond worst case? Can more powerful methods of reasoning developed in theoretical research be harnessed to yield improvements in practical performance? And can state-of-the-art combinatorial solvers be enhanced to not only solve problems, but also provide verifiable proofs of correctness for the solutions they produce? This workshop gathered leading applied and theoretical researchers working on SAT and combinatorial optimization more broadly in order to stimulate an exchange of ideas and techniques. We see great opportunities for fruitful interplay between theory and practice in these areas, as well as for technology transfer between different paradigms in combinatorial optimization, and our assessment is that this workshop demonstrated very convincingly that a more vigorous interaction has potential for major long-term impact in computer science, as well for applications in industry.
Cite as
Olaf Beyersdorff, Armin Biere, Vijay Ganesh, Jakob Nordström, and Andy Oertel. Theory and Practice of SAT and Combinatorial Solving (Dagstuhl Seminar 22411). In Dagstuhl Reports, Volume 12, Issue 10, pp. 84-105, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2023)
Copy BibTex To Clipboard
@Article{beyersdorff_et_al:DagRep.12.10.84,
author = {Beyersdorff, Olaf and Biere, Armin and Ganesh, Vijay and Nordstr\"{o}m, Jakob and Oertel, Andy},
title = {{Theory and Practice of SAT and Combinatorial Solving (Dagstuhl Seminar 22411)}},
pages = {84--105},
journal = {Dagstuhl Reports},
ISSN = {2192-5283},
year = {2023},
volume = {12},
number = {10},
editor = {Beyersdorff, Olaf and Biere, Armin and Ganesh, Vijay and Nordstr\"{o}m, Jakob and Oertel, Andy},
publisher = {Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
address = {Dagstuhl, Germany},
URL = {https://drops-dev.dagstuhl.de/entities/document/10.4230/DagRep.12.10.84},
URN = {urn:nbn:de:0030-drops-178212},
doi = {10.4230/DagRep.12.10.84},
annote = {Keywords: Boolean satisfiability (SAT), SAT solving, computational complexity, proof complexity, combinatorial solving, combinatorial optimization, constraint programming, mixed integer linear programming}
}
Document
Intelligent Security: Is "AI for Cybersecurity" a Blessing or a Curse (Dagstuhl Seminar 22412)
Abstract
This report documents the outcomes of Dagstuhl Seminar 22412 "Intelligent Security: Is "AI for Cybersecurity" a Blessing or a Curse". The seminar brought together 25 attendees from 10 countries (Canada, Croatia, Czech Republic, France, Germany, Netherlands, Singapore, Sweden, Switzerland, and the USA). There were 17 male and 8 female participants. Three participants were from the industry, and the rest were from academia. The gathered researchers are actively working in the domains of artificial intelligence and cybersecurity, emphasizing hardware security, fuzzing, physical security, and network security. The seminar aims to foster sharing experiences and best practices between various cybersecurity applications and understand how and when certain approaches are transferable. The first two days were devoted to 20-minute self-introductions by participants to achieve these goals. At the end of the second day, we made a list of topics that were decided to be the focus of the seminar and that will be discussed in the groups in the next few days. On the third and fourth days, the work was conducted in four discussion groups where at the end of each day, all participants gathered to report the results from the discussion groups and to align the goals. On the last day, we again worked in one group to summarize the findings and foster networking among participants. A hike was organized in the afternoon of the third day. The seminar was a success. The participants actively participated in the working groups and the discussions and went home with new ideas and collaborators. This report gathers the abstracts of the presented talks and the conclusions from the discussion groups, which we consider relevant contributions toward better interdisciplinary research on artificial intelligence and cybersecurity.
Cite as
Nele Mentens, Stjepan Picek, and Ahmad-Reza Sadeghi. Intelligent Security: Is "AI for Cybersecurity" a Blessing or a Curse (Dagstuhl Seminar 22412). In Dagstuhl Reports, Volume 12, Issue 10, pp. 106-128, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2023)
Copy BibTex To Clipboard
@Article{mentens_et_al:DagRep.12.10.106,
author = {Mentens, Nele and Picek, Stjepan and Sadeghi, Ahmad-Reza},
title = {{Intelligent Security: Is "AI for Cybersecurity" a Blessing or a Curse (Dagstuhl Seminar 22412)}},
pages = {106--128},
journal = {Dagstuhl Reports},
ISSN = {2192-5283},
year = {2023},
volume = {12},
number = {10},
editor = {Mentens, Nele and Picek, Stjepan and Sadeghi, Ahmad-Reza},
publisher = {Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
address = {Dagstuhl, Germany},
URL = {https://drops-dev.dagstuhl.de/entities/document/10.4230/DagRep.12.10.106},
URN = {urn:nbn:de:0030-drops-178229},
doi = {10.4230/DagRep.12.10.106},
annote = {Keywords: Cybersecurity, Artificial Intelligence, Hardware Security, Machine Learning, Explainability}
}
Document
Security of Decentralized Financial Technologies (Dagstuhl Seminar 22421)
Abstract
The decentralized finance (DeFi) sector has grown to a 13+ billion USD economy, encompassing various financial activities. The non-custodial nature of DeFi requires users to take responsibility for managing their assets, but it also provides them more control over their assets. The Dagstuhl Seminar brought researchers together to examine the security, privacy, and financial properties of DeFi and explore ways to protect users. The seminar aimed to reconcile the conflicting demands of security, usability, and performance in DeFi and outline best practices. Despite progress made in the DeFi sector, there is still much to be explored and improved, such as user education, regulatory compliance, and the scalability and performance limitations of decentralized ledgers. To build a secure and user-friendly DeFi ecosystem, continued collaboration among experts is needed.
Cite as
Arthur Gervais and Marie Vasek. Security of Decentralized Financial Technologies (Dagstuhl Seminar 22421). In Dagstuhl Reports, Volume 12, Issue 10, pp. 129-142, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2023)
Copy BibTex To Clipboard
@Article{gervais_et_al:DagRep.12.10.129,
author = {Gervais, Arthur and Vasek, Marie},
title = {{Security of Decentralized Financial Technologies (Dagstuhl Seminar 22421)}},
pages = {129--142},
journal = {Dagstuhl Reports},
ISSN = {2192-5283},
year = {2023},
volume = {12},
number = {10},
editor = {Gervais, Arthur and Vasek, Marie},
publisher = {Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
address = {Dagstuhl, Germany},
URL = {https://drops-dev.dagstuhl.de/entities/document/10.4230/DagRep.12.10.129},
URN = {urn:nbn:de:0030-drops-178233},
doi = {10.4230/DagRep.12.10.129},
annote = {Keywords: blockchain technology, decentralized finance (DeFi), distributed consensus protocols, security economics, security foundations}
}
Document
Developmental Machine Learning: From Human Learning to Machines and Back (Dagstuhl Seminar 22422)
Abstract
This interdisciplinary seminar brought together 18 academic and industry computer science researchers in artificial intelligence, computer vision and machine learning with 19 researchers from developmental psychology, neuroscience and linguistics. The objective was to catalyze connections between these communities, through discussions on both how the use of developmental insights can spur advances in machine learning, and how computational models and data-driven learning can lead to novel tools and insights for studying child development. The seminar consisted of tutorials, working groups, and a series of talks and discussion sessions. The main outcomes of this seminar were 1) The founding of DevelopmentalAI (http://www.developmentalai.com), an online research community to serve as a venue for communication and collaboration between develpomental and machine learning researchers, as well as a place collect and organize relevant research papers and talks; 2) Working group outputs - summaries of in-depth discussions on research questions at the intersection of developmental and machine learning, including the role of information bottlenecks and multimodality, as well as proposals for novel developmentally motivated benchmarks.
Cite as
James M. Rehg, Pierre-Yves Oudeyer, Linda B. Smith, Sho Tsuji, Stefan Stojanov, and Ngoc Anh Thai. Developmental Machine Learning: From Human Learning to Machines and Back (Dagstuhl Seminar 22422). In Dagstuhl Reports, Volume 12, Issue 10, pp. 143-165, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2023)
Copy BibTex To Clipboard
@Article{rehg_et_al:DagRep.12.10.143,
author = {Rehg, James M. and Oudeyer, Pierre-Yves and Smith, Linda B. and Tsuji, Sho and Stojanov, Stefan and Thai, Ngoc Anh},
title = {{Developmental Machine Learning: From Human Learning to Machines and Back (Dagstuhl Seminar 22422)}},
pages = {143--165},
journal = {Dagstuhl Reports},
ISSN = {2192-5283},
year = {2023},
volume = {12},
number = {10},
editor = {Rehg, James M. and Oudeyer, Pierre-Yves and Smith, Linda B. and Tsuji, Sho and Stojanov, Stefan and Thai, Ngoc Anh},
publisher = {Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
address = {Dagstuhl, Germany},
URL = {https://drops-dev.dagstuhl.de/entities/document/10.4230/DagRep.12.10.143},
URN = {urn:nbn:de:0030-drops-178247},
doi = {10.4230/DagRep.12.10.143},
annote = {Keywords: developmental psychology, human learning, machine learning, computer vision, language learning}
}
Document
Data-Driven Combinatorial Optimisation (Dagstuhl Seminar 22431)
Abstract
Machine learning’s impressive achievements in the last decade have urged many scientific communities to ask if and how the techniques developed in that field to leverage data could be used to advance research in others. The combinatorial optimisation community is one of those, and the area of data-driven combinatorial optimisation has emerged. The motivation of the seminar and its design and development have followed the idea of making researchers both in academia and industry belonging to different communities - from operations research to constraint programming, from artificial intelligence to machine learning - communicate, establish a shared language, and ultimately (try to) set the roadmap for the development of the field.
Cite as
Emma Frejinger, Andrea Lodi, Michele Lombardi, and Neil Yorke-Smith. Data-Driven Combinatorial Optimisation (Dagstuhl Seminar 22431). In Dagstuhl Reports, Volume 12, Issue 10, pp. 166-174, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2023)
Copy BibTex To Clipboard
@Article{frejinger_et_al:DagRep.12.10.166,
author = {Frejinger, Emma and Lodi, Andrea and Lombardi, Michele and Yorke-Smith, Neil},
title = {{Data-Driven Combinatorial Optimisation (Dagstuhl Seminar 22431)}},
pages = {166--174},
journal = {Dagstuhl Reports},
ISSN = {2192-5283},
year = {2023},
volume = {12},
number = {10},
editor = {Frejinger, Emma and Lodi, Andrea and Lombardi, Michele and Yorke-Smith, Neil},
publisher = {Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
address = {Dagstuhl, Germany},
URL = {https://drops-dev.dagstuhl.de/entities/document/10.4230/DagRep.12.10.166},
URN = {urn:nbn:de:0030-drops-178257},
doi = {10.4230/DagRep.12.10.166},
annote = {Keywords: combinatorial optimisation, constraint programming, machine learning, Mixed integer programming, operations research, Reinforcement learning}
}
Document
Towards a Unified Model of Scholarly Argumentation (Dagstuhl Seminar 22432)
Abstract
This report summarizes the outcomes of the Dagstuhl Seminar 22432: "Towards a Unified Model of Scholarly Argumentation." The purpose of this Seminar was to enable robust advances in argumentation technology by collecting and collaborating on use cases in scholarly and biomedical discourse and working on a foundational model for argumentation in science and healthcare. Most importantly, the seminar served to develop a multidisciplinary, international research community devoted to building and maintaining principles, tools, and models for studying scholarly argumentation. Over the course of the seminar week, the seminar laid the foundation of a shared formalism, illuminated important scholarly use cases for argumentation modeling, and identified directions for future exploration.
Cite as
Khalid Al-Khatib, Anita de Waard, Dayne Freitag, Iryna Gurevych, Yufang Hou, and Harrisen Scells. Towards a Unified Model of Scholarly Argumentation (Dagstuhl Seminar 22432). In Dagstuhl Reports, Volume 12, Issue 10, pp. 175-206, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2023)
Copy BibTex To Clipboard
@Article{alkhatib_et_al:DagRep.12.10.175,
author = {Al-Khatib, Khalid and de Waard, Anita and Freitag, Dayne and Gurevych, Iryna and Hou, Yufang and Scells, Harrisen},
title = {{Towards a Unified Model of Scholarly Argumentation (Dagstuhl Seminar 22432)}},
pages = {175--206},
journal = {Dagstuhl Reports},
ISSN = {2192-5283},
year = {2023},
volume = {12},
number = {10},
editor = {Al-Khatib, Khalid and de Waard, Anita and Gurevych, Iryna and Hou, Yufang and Scells, Harrisen},
publisher = {Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
address = {Dagstuhl, Germany},
URL = {https://drops-dev.dagstuhl.de/entities/document/10.4230/DagRep.12.10.175},
URN = {urn:nbn:de:0030-drops-178264},
doi = {10.4230/DagRep.12.10.175},
annote = {Keywords: Argument mining, Argument modeling, Scholarly discourse}
}
Document
Optimization at the Second Level (Dagstuhl Seminar 22441)
Abstract
This report documents the program and the outcomes of Dagstuhl Seminar 22441 "Optimization at the Second Level". The seminar was held on October 30 - November 4, 2022 in Schloss Dagstuhl - Leibniz-Zentrum für Informatik. Participants gave overview talks and presented recent results in bilevel, robust, and stochastic optimization. These three areas have in common that they typically deal with optimization problems which are contained in the second level of the polynomial hierarchy. The goal of the seminar was to bring together experts of bilevel, robust, and stochastic optimization in order to connect and work towards new insights and approaches for such problems. During the seminar, the relationships between these different areas of optimization were intensively discussed and interesting connections were identified.
Cite as
Luce Brotcorne, Christoph Buchheim, Dick den Hertog, and Dorothee Henke. Optimization at the Second Level (Dagstuhl Seminar 22441). In Dagstuhl Reports, Volume 12, Issue 10, pp. 207-224, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2023)
Copy BibTex To Clipboard
@Article{brotcorne_et_al:DagRep.12.10.207,
author = {Brotcorne, Luce and Buchheim, Christoph and den Hertog, Dick and Henke, Dorothee},
title = {{Optimization at the Second Level (Dagstuhl Seminar 22441)}},
pages = {207--224},
journal = {Dagstuhl Reports},
ISSN = {2192-5283},
year = {2023},
volume = {12},
number = {10},
editor = {Brotcorne, Luce and Buchheim, Christoph and den Hertog, Dick and Henke, Dorothee},
publisher = {Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
address = {Dagstuhl, Germany},
URL = {https://drops-dev.dagstuhl.de/entities/document/10.4230/DagRep.12.10.207},
URN = {urn:nbn:de:0030-drops-178274},
doi = {10.4230/DagRep.12.10.207},
annote = {Keywords: bilevel optimization, robust optimization, stochastic optimization, computational complexity, algorithmics}
}
Document
Toward Scientific Evidence Standards in Empirical Computer Science (Dagstuhl Seminar 22442)
Abstract
Many scientific fields of study use formally established evidence standards during the peer review and evaluation process, such as Consolidated Standards of Reporting Trials (CONSORT) in medical research, the What Works Clearinghouse (WWC) used in education in the United States, or the APA Journal Article Reporting Standards (JARS) in psychology. The basis for these standards is community agreement on what to report in empirical studies. Such standards achieve two key goals. First, they make it easier to compare studies, facilitating replications, through transparent reporting and sharing of data, which can provide confidence that multiple research teams can obtain the same results. Second, they establish community agreement on how to report on and evaluate studies using different methodologies. The discipline of computer science does not have formalized evidence standards, even for major conferences or journals. This Dagstuhl Seminar has three primary objectives:
1) To establish a process for creating or adopting an existing evidence standard for empirical research in computer science.
2) To build a community of scholars that can discuss what a general standard should include.
3) To kickstart the discussion with scholars from software engineering, human-computer interaction, and computer science education. In order to better discuss and understand the implications of such standards across several empirical subfields of computer science and to facilitate adoption, we brought together participants from a range of backgrounds; including academia and industry, software engineering, computer-human interaction and computer science education, as well as representatives from several prominent journals. Funding: This material is based upon work supported by the National Science Foundation under Grant Numbers NSF HCC: 2106392 and NSF I-TEST: 2048356.
Cite as
Timothy Kluthe, Brett A. Becker, Christopher D. Hundhausen, Ciera Jaspan, Andreas Stefik, and Thomas Zimmermann. Toward Scientific Evidence Standards in Empirical Computer Science (Dagstuhl Seminar 22442). In Dagstuhl Reports, Volume 12, Issue 10, pp. 225-240, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2023)
Copy BibTex To Clipboard
@Article{kluthe_et_al:DagRep.12.10.225,
author = {Kluthe, Timothy and Becker, Brett A. and Hundhausen, Christopher D. and Jaspan, Ciera and Stefik, Andreas and Zimmermann, Thomas},
title = {{Toward Scientific Evidence Standards in Empirical Computer Science (Dagstuhl Seminar 22442)}},
pages = {225--240},
journal = {Dagstuhl Reports},
ISSN = {2192-5283},
year = {2023},
volume = {12},
number = {10},
editor = {Kluthe, Timothy and Becker, Brett A. and Hundhausen, Christopher D. and Jaspan, Ciera and Stefik, Andreas and Zimmermann, Thomas},
publisher = {Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
address = {Dagstuhl, Germany},
URL = {https://drops-dev.dagstuhl.de/entities/document/10.4230/DagRep.12.10.225},
URN = {urn:nbn:de:0030-drops-178289},
doi = {10.4230/DagRep.12.10.225},
annote = {Keywords: Community evidence standards, Human factors}
}