Panel – Experiment Artifact Sharing: Challenges and Solutions

Moderator: Laura Tinnel (SRI International)
Panelists: Clémentine Maurice (CNRS, IRIS); Martin Rosso (Eindhoven University of Technology); Eric Eide (U. Utah)

The sharing of experiment artifacts is essential to reproducibility, which is a cornerstone of science. As the community recognizes this need, several major cybersecurity conferences now encourage researchers to share artifacts. Sharing and reuse of these artifacts is not without challenges. Panelists discuss the challenges, incentives, and other solutions to increasing artifact sharing as a practice in the cybersecurity research community.

Panelist's biographies

Laura Tinnel is a Senior Computer Scientist at SRI International, where she pursues her interest in science-based experimentation for cybersecurity. She has been involved in the LASER Workshop since 2012 and is one of the primary authors of the NSF-funded 2015 Cybersecurity Experimentation of the Future (CEF) report (https://www.cyberexperimentation.org/cef-study/) which identified the need for better sharing of experiment artifacts and results, among other things. Laura is also a Principal Investigator on the NSF-sponsored collaborative SEARCCH project.

Clémentine Maurice is a full-time researcher for CNRS, at CRIStAL (Lille, France). Her research interests include microarchitectural attacks and defenses, reverse-engineering processor parts, and software-based fault attacks. Clémentine was co-chair on the WOOT 2019 artifact evaluation committee. She is currently serving as co-chair on the USENIX Security 2021 artifact evaluation committee.

Martin Rosso is a doctoral candidate in the Department of Mathematics and Computer Science at Eindhoven University of Technology in The Netherlands, where he is currently researching intrusion detection in industrial control systems. Martin co-authored "SAIBERSOC: Synthetic Attack Injection to Benchmark and Evaluate the Performance of Security Operation Centers", which was published at ACSAC 2020. He and his team received the ACSAC 2020 Distinguished Paper with Artifact Award for their combined paper and research artifacts, which received a "reusable" rating (the highest level of evaluation) from the ACSAC 2020 Artifact Evaluation Committee. ACSAC Paper, Slides, and Video Presentation: https://www.acsac.org/2020/program/final/s28.html. Published Artifacts: https://gitlab.tue.nl/saibersoc/acsac2020-artifacts.

Eric Eide conducts research in advancing the state of the art in engineering trustworthy systems software at the University of Utah. There he runs Cloudlab, flexible, scientific infrastructure for research on the future of cloud computing. Eric is a Principal Investigator on the NSF-sponsored Sharing Expertise and Artifacts for Reuse through a Cybersecurity Community Hub SEARCCH project.