3rd International Workshop on Practical Reproducible Evaluation of Systems
June 24th, 2020
(Online event, co-located with HPDC'20)
Submit (single-blind) via EasyChair. We look for two categories of submissions:
Position papers. This category is for papers whose goal is to propose solutions (or scope the work that needs to be done) to address some of the issues outlined above. We hope that a research agenda comes out of this and that we can create a community that meets yearly to report on our status in addressing these problems.
Experience papers. This category consists of papers reporting on the authors’ experience in automating one or more experimentation pipelines. The committee will look for submissions reporting on their experience: what worked? What aspects of experiment automation and validation are hard in your domain? What can be done to improve the tooling for your domain?
We expect submissions from topics such as, but not limited to:
Authors are invited to submit manuscripts in English not exceeding 5
pages of content. The 5-page limit includes figures, tables and
appendices, but does not include references, for which there is no
page limit. Submissions must use the ACM Master
Template
(please use the sigconf format with default options).
The proceedings will be archived in both the ACM Digital Library and IEEE Xplore through SIGHPC. In addition, pre-print versions of the accepted articles will be published in this website (as allowed by ACM’s publishing policy).
These tools can be used used to automate your experiments (not an exhaustive list): CK, CWL, Popper, ReproZip, Sciunit, Sumatra.
If you have any problems or questions, please contact us via e-mail at: ivotron@ucsc.edu
Submission deadline: April 20, 2020. (11PM PDT)
Notification of acceptance: May 1, 2020.
Camera-ready copy due: May 6, 2020.
Workshop: June 24, 2020.