2026-07-19T23:55:57Z https://drops.dagstuhl.de/oai

oai:drops-oai.dagstuhl.de:970 2024-03-06T11:07:00Z ddc:004 open_access

Subjectivity in Clone Judgment: Can We Ever Agree? Kapser, Cory Anderson, Paul Godfrey, Michael Koschke, Rainer Rieger, Matthias van Rysselberghe, Filip Weißgerber, Peter Code clone study inter-rater agreement ill-defined problem An objective definition of what a code clone is currently eludes the field. A small study was performed at an international workshop to elicit judgments and discussions from world experts regarding what characteristics define a code clone. Less than half of the clone candidates judged had 80% agreement amongst the judges. Judges appeared to differ primarily in their criteria for judgment rather than their interpretation of the clone candidates. In subsequent open discussion the judges provided several reasons for their judgments. The study casts additional doubt on the reliability of experimental results in the field when the full criterion for clone judgment is not spelled out. Schloss Dagstuhl – Leibniz-Zentrum für Informatik Cory Kapser and Paul Anderson and Michael Godfrey and Rainer Koschke and Matthias Rieger and Filip van Rysselberghe and Peter Weißgerber 2007 Is Part Of Dagstuhl Seminar Proceedings, Volume 6301, Duplication, Redundancy, and Similarity in Software (2007) InProceedings Text doc-type:ResearchArticle publishedVersion application/pdf doi:10.4230/DagSemProc.06301.12 urn:nbn:de:0030-drops-9701 https://drops.dagstuhl.de/entities/document/10.4230/DagSemProc.06301.12 eng https://creativecommons.org/licenses/by/4.0/legalcode