Submit (single-blind) via EasyChair. We look for two categories of submissions:

  • Position papers. This category is for papers whose goal is to propose solutions (or scope the work that needs to be done) to address some of the issues outlined above. We hope that a research agenda comes out of this and that we can create a community that meets yearly to report on our status in addressing these problems.

  • Experience papers. This category consists of papers reporting on the authors’ experience in automating one or more experimentation pipelines. The committee will look for submissions reporting on their experience: what worked? What aspects of experiment automation and validation are hard in your domain? What can be done to improve the tooling for your domain?

Topics

We expect submissions from topics such as, but not limited to:

  • Experiment dependency management.
  • Software citation and persistence.
  • Data versioning and preservation.
  • Provenance of data-intensive experiments.
  • Tools and techniques for incorporating provenance into publications.
  • Automated experiment execution and validation.
  • Experiment portability for code, performance, and related metrics.
  • Experiment discoverability for re-use.
  • Cost-benefit analysis frameworks for reproducibility.
  • Usability and adaptability of reproducibility frameworks into already-established domain-specific tools.
  • Long-term artifact archiving for future reproducibility.
  • Frameworks for sociological constructs to incentivize paradigm shifts.
  • Policies around publication of articles/software.
  • Blinding and selecting artifacts for review while maintaining history.
  • Reproducibility-aware computational infrastructure.

Format

Authors are invited to submit manuscripts in English not exceeding 5 pages of content. The 5-page limit includes figures, tables and appendices, but does not include references, for which there is no page limit. Submissions must use the ACM Master Template (please use the sigconf format with default options).

Proceedings

The proceedings will be archived in both the ACM Digital Library and IEEE Xplore through SIGHPC. In addition, pre-print versions of the accepted articles will be published in this website (as allowed by ACM’s publishing policy).

Tools

These tools can be used used to automate your experiments (not an exhaustive list): CK, CWL, Popper, ReproZip, Sciunit, Sumatra.

Contact

If you have any problems or questions, please contact us via e-mail at: ivotron@ucsc.edu

Important Dates
  • Submission deadline: April 20, 2020. (11PM PDT)

  • Notification of acceptance: May 1, 2020.

  • Camera-ready copy due: May 6, 2020.

  • Workshop: June 24, 2020.

News
  • June 22, 2020 - Proceedings have been published by ACM!
  • May 22, 2020 - Workshop program posted!
  • April 30, 2020 - Keynote announced!
  • April 9, 2020 - Submission deadline extended!
  • March 1, 2020 - Submission site online!
  • February 14, 2020 - Workshop accepted!