The sharing of experiment artifacts is essential to reproducibility, which is a cornerstone of science. As the community recognizes this need, several major cybersecurity conferences now encourage researchers to share artifacts. Sharing and reuse of these artifacts is not without challenges. Panelists discuss the challenges, incentives, and other solutions to increasing artifact sharing as a practice in the cybersecurity research community.

Panelist's biographies

Laura Tinnel is a Senior Computer Scientist at SRI International, where she pursues her interest in science-based experimentation for cybersecurity. She has been involved in the LASER Workshop since 2012 and is one of the primary authors of the NSF-funded 2015 Cybersecurity Experimentation of the Future (CEF) report (https://www.cyberexperimentation.org/cef-study/) which identified the need for better sharing of experiment artifacts and results, among other things. Laura is also a Principal Investigator on the NSF-sponsored collaborative SEARCCH project.

Clémentine Maurice is a full-time researcher for CNRS, at CRIStAL (Lille, France). Her research interests include microarchitectural attacks and defenses, reverse-engineering processor parts, and software-based fault attacks. Clémentine was co-chair on the WOOT 2019 artifact evaluation committee. She is currently serving as co-chair on the USENIX Security 2021 artifact evaluation committee.

Martin Rosso is a doctoral candidate in the Department of Mathematics and Computer Science at Eindhoven University of Technology in The Netherlands, where he is currently researching intrusion detection in industrial control systems. Martin co-authored "SAIBERSOC: Synthetic Attack Injection to Benchmark and Evaluate the Performance of Security Operation Centers", which was published at ACSAC 2020. He and his team received the ACSAC 2020 Distinguished Paper with Artifact Award for their combined paper and research artifacts, which received a "reusable" rating (the highest level of evaluation) from the ACSAC 2020 Artifact Evaluation Committee. ACSAC Paper, Slides, and Video Presentation: https://www.acsac.org/2020/program/final/s28.html. Published Artifacts: https://gitlab.tue.nl/saibersoc/acsac2020-artifacts.

Eric Eide conducts research in advancing the state of the art in engineering trustworthy systems software at the University of Utah. There he runs Cloudlab, flexible, scientific infrastructure for research on the future of cloud computing. Eric is a Principal Investigator on the NSF-sponsored Sharing Expertise and Artifacts for Reuse through a Cybersecurity Community Hub SEARCCH project.

View More Papers

Obfuscated Access and Search Patterns in Searchable Encryption

Zhiwei Shang (University of Waterloo), Simon Oya (University of Waterloo), Andreas Peter (University of Twente), Florian Kerschbaum (University of Waterloo)

Read More

Comparative Analysis of the DoT with HTTPS Certificate Ecosystems

Ali Sadeghi Jahromi, AbdelRahman Abdou (Carleton University)

Read More

Rosita: Towards Automatic Elimination of Power-Analysis Leakage in Ciphers

Madura A. Shelton (University of Adelaide), Niels Samwel (Radboud University), Lejla Batina (Radboud University), Francesco Regazzoni (University of Amsterdam and...

Read More

Empirical Scanning Analysis of Censys and Shodan

Christopher Bennett, AbdelRahman Abdou, and Paul C. van Oorschot (School of Computer Science, Carleton University, Canada)

Read More