workshop-reproducibility.md

layout	title	group	dates	committees
default	ACM SIGCOMM 2017 Reproducibility Workshop (Reproducibility'17)	Workshops	info date Opening of the discussion forum and submission system (OPEN NOW) <del>January 25, 2017</del> info date Submission deadline <del>March 24, 2017</del> <del>March 31st, 2017 9:00pm PST</del> info date Acceptance notification <del>April 28, 2017</del> info date Camera ready deadline May 29th, 2017 9:00pm PST	role people Workshop Co-Chairs name affiliation Olivier Bonaventure Universitée catholique de Louvain, Belgium name affiliation Luigi Iannone Telecom ParisTech, France name affiliation Damien Saucez Inria, France role people Technical Program Committee name affiliation Amogh Dhamdhere CAIDA name affiliation Anja Feldmann Technische Universität Berlin name affiliation Bob Lantz Open Networking Laboratory name affiliation Gwendal Simon Telecom Bretagne name affiliation Hamed Haddadi Queen Mary University of London name affiliation Joerg Ott Technische Universität München name affiliation Klaus Wehrle RWTH Aachen University name affiliation Marco Fiore CNR – IEIIT name affiliation Marco Mellia Politecnico di Torino name affiliation Matthias Wählisch Freie Universität Berlin name affiliation Mohamed Naoufal Mahfoudi Inria name affiliation Phillipa Gill University of Massachusetts — Amherst name affiliation Tom Henderson University of Washington name affiliation Tristan Henderson University of St Andrews name affiliation Yibo Zhu Microsoft

{{ page.title }}

Workshop Program

{% include program-online.html type="reproducibility" %}

Call For Papers

Ensuring the reproducibility of results is essential in experimental sciences. Unfortunately, as highlighted recently, a large proportion of research results are hardly, if not at all, reproducible, raising reasonable doubts on the research lead by scientists around the world.

To address this important issue, the ACM has introduced a new policy on result and artifact review and badging. The policy defines clearly the terminology to be used to assess results and artifacts but does not specify the review process.

The goal of the workshop is to craft recommendations on research results and artifacts review process for conferences and journals of the SIGCOMM interest group. To achieve this goal, the workshop is structured as a forum where presenters will discuss with attendees their experience in reviewing research results and artifacts.

To prepare the discussion authors are requested to submit discussions around papers published in the various conferences in recent years, with experimental results and artifacts. Submitted papers to the workshop will provide an extended abstract with either feedback on the actual review of papers in these conferences or proposals of methods to review papers, from a results and artifact perspective. To emulate discussions before but also after the workshop, an open virtual forum is set in place to exchange ideas and experiences: http://reproducibility.lisp-lab.org.

Topics of Interest

Topics of particular interest include, but are not limited to:

• Reviewing experience;
• Enabling environments and tools for reproducibility;
• Methods and tools to anonymize datasets;
• Testbeds for reproducible research;
• Platforms to share experimental results and artifacts.

The workshop will try to answer questions rose by the ACM such as:

• Should reviews occur before or after acceptance of a paper?
• How many reviewers should there be?
• Should the reviewers be anonymous, or should they be allowed to interact openly with the authors?
• How should artifacts be packaged for review?
• What specific metrics should be used to assess quality?

Contact workshop co-chairs{: data-role="button" class="button" }.

Submission Instructions

Submissions must be original unpublished work. Submitted papers must be at most three (3) pages long, including all figures, tables, references, and appendices in two-column 10pt ACM format. Papers must include authors names and affiliations for peer reviewing by the PC. Authors are invited to follow the terminology defined by the ACM Result and Artifact Review and Badging publication policy. Authors of accepted papers are expected to present their papers at the workshop. The outcomes of the workshop will be published in ACM Computer Communication Review (CCR).

To guarantee freedom to attend to everyone, remote attendance will be possible for the workshop.

Paper registration and submission can be done via HotCRP at: https://sigcomm17reproducibility.hotcrp.com/.

Important Dates

{% include dates2.html dates=page.dates %}

Authors Take Note

The official publication date is the date the proceedings are made available in the ACM Digital Library. This date may be up to TWO WEEKS prior to the first day of your conference. The official publication date affects the deadline for any patent filings related to published work.

Committees

{% include committees.html committees=page.committees %}