Learning from Authoritative Security Experiment Results (LASER) Workshop 2020

Workshop Overview

The LASER workshop series focuses on learning from and improving cybersecurity experiment results. The workshop strives to provide a highly interactive, collegial environment for discussing and learning from experimental methodologies, execution, and results. Ultimately, the workshop seeks to foster a dramatic change in the experimental paradigm for cybersecurity research, improving the overall quality and reporting of practiced science.

Each year, the LASER committee chooses a slightly different focus and approach to help the community reach the overall goals of the effort. This year, the LASER workshop is gathering a group of authors of accepted NDSS papers to come together to explore and discuss the experimental aspects of their work amongst themselves and with other workshop participants. Conference papers all too often must focus on research results and contain limited discussion of the experimental aspects of the work. LASER will provide authors the opportunity to lead focused discussion on the experimental approaches and methodologies used to obtain their results.

We invite open participation by others interested in being part of and learning from such discussions. To participate, simply register for the workshop.

Workshop Format

The workshop will be structured as a true “workshop” in the sense that it will focus on discussion and interaction around the topic of experimental methodologies, execution, and results with the goal of encouraging improvements in experimental science in cybersecurity research. Authors will lead the group in a discussion of the experimental aspects of their work.

Areas of interest include, but are not limited to, the following:

  • Research questions and/or hypothesis
  • Experimental methodologies used and/or developed
  • Experiment design
  • Use of simulation, emulation, virtualization, and/or physical testbeds
  • Use of specialized hardware including CPS and IoT devices
  • Modeling of human-behavior characteristics
  • Software tools used and/or developed to perform experimentation
  • Approaches to experiment validation, monitoring, and data collection
  • Datasets used and/or developed to perform experimentation
  • Measurements and metrics
  • Analytical techniques used and/or developed to evaluate experimental results

As a group, participants will discuss these areas and answer interesting questions such as:

  • Did you use experimentation artifacts borrowed from the community?
  • Did you attempt to replicate or reproduce results of earlier research as part of your work?
  • What can be learned from your methodology and your experience using your methodology?
  • What did you try that did not succeed before getting to the results you presented?
  • Did you produce any intermediate results including possible unsuccessful tests or experiments?

Workshop Agenda

Sunday, February 23

8:00 am – 7:00 pm


8:30 am – 8:45 am

Welcome, Workshop Goals/Organization

8:45 am – 10:15 am

Session 1: Paper Discussions

Cyber-Physical Testbed: Case Study to Evaluate Anti-Reconnaissance Approaches on Power Grids’ Cyber-Physical Infrastructures

Hui Lin and Bibek Shresthar (University of Nevada, Reno); Yih-Chun Hu (University of Illinois, Urbana-Champaign)

Genotype Extraction and False Relative Attacks: Security Risks to Third-Party Genetic Genealogy Services Beyond Identity Inference

Peter Ney, Luis Ceze, and Tadayoshi Kohno (University of Washington)

10:15 am – 10:45 am

Morning Break

10:45 am – 12:15 pm

Session 2: Paper Discussions

Experimental Analyses of RF Fingerprint Technique for Securing Keyless Entry System in Modern Cars

Kyungho Joo (Korea University), Wonsuk Choi (Hansung University), and DongHoon Lee (Korea University)

How to Hack Compliance: Using Lessons Learned to Repeatably Audit Compliance Programs for Digital Security Concerns

Rock Stevens (University of Maryland, College Park); Josiah Dykstra (Independent Security Researcher); Wendy Knox Everette (Leviathan Security Group, Inc.); Michelle L. Mazurek (University of Maryland, College Park)

12:15 pm – 1:15 pm

Workshop Lunch

1:15 pm – 3:00 pm

Session 3: Invited Talk and Paper Discussions

Invited Talk: Can You Do that Again? Real-World Requirements for Cybersecurity Experiment Replication

Stephen Schwab, University of Southern California, Information Sciences Institute

How to Hack Blockchain Systems

Parinya Ekparinya (University of Sydney); Vincent Gramoli (University of Sydney and Data61, CSIRO); Guillaume Jourjon (Data61, CSIRO)

3:00 pm – 3:30 pm

Afternoon Break

3:30 pm – 5:15 pm

Session 4: Paper Discussions

Security Evaluation of MCUS Defenses

Naif Saleh Almakhdhub (Purdue University and King Saud University); Abraham A Clements (Sandia National Labs); Saurabh Bagchi (Purdue University); Mathias Payer (EPFL)

TKPERM: Cross-platform Permission Knowledge Transfer to Detect Overprivileged Third-party Applications

Faysal Hossain Shezan and Kaiming Cheng (University of Virginia); Zhen Zhang and Yinzhi Cao (Johns Hopkins University); Yuan Tian (University of Virginia)

5:00 pm – 5:15 pm


5:30 pm – 6:30 pm

NDSS 2020 Welcome Reception

Workshop Papers

Participants in the LASER Workshop are invited to write new papers on their experimental work. The papers will be published in post-workshop proceedings. The new papers will be driven and guided, in part, by the discussions and interactions, and possibly even new collaborations, forged at the workshop.

Draft papers will be due approximately two months after the workshop. The program committee will review papers and provide notifications and feedback one month after submission. Final camera-ready papers will be due approximately one month later.

Important Dates

  • LASER Workshop @ NDSS: February 23, 2020
  • Draft Papers Submitted: April 23, 2020
  • Notifications and feedback: May 23, 2020
  • Final Papers Submitted: June 23, 2020
  • Papers Published: July 23, 2020


  • Jim Alves-Foss (University of Idaho)
  • David Balenson (SRI International)
  • Terry Benzel (USC-ISI)
  • Laura S. Tinnel (SRI International)

Further Information

Please see www.laser-workshop.org for more information about the LASER Workshop Series and 2020.laser-workshop.org for more information about LASER 2020. Send questions to [email protected].