When Does My Program Do This? Learning Circumstances of Software Behavior
A program fails. Under which circumstances does the failure occur? Our ALHAZEN approach starts with a run that exhibits a particular behavior and automatically determines input features associated with the behavior in question: (1) We use a grammar to parse the input into individual elements. (2) We use a decision tree learner to observe and learn which input elements are associated with the behavior in question. (3) We use the grammar to generate additional inputs to further strengthen or refute hypotheses as learned associations. (4) By repeating steps 2 and 3, we obtain a theory that explains and predicts the given behavior. In our evaluation using inputs for find, grep, NetHack, and a JavaScript transpiler, the theories produced by Alhazen predict and produce failures with high accuracy and allow developers to focus on a small set of input features: “grep fails whenever the --fixed-strings option is used in conjunction with an empty search string.”
Tue 15 NovDisplayed time zone: Beijing, Chongqing, Hong Kong, Urumqi change
14:00 - 15:30 | ESEC/FSE 20 Software Testing IESEC/FSE 2020 at SRC LT 52 Chair(s): Arie van Deursen Delft University of Technology | ||
14:00 15mTalk | Testing Self-Adaptive Software with Probabilistic Guarantees on Performance Metrics ESEC/FSE 2020 Claudio Mandrioli Lund University, Sweden, Martina Maggio Saarland University, Germany / Lund University, Sweden DOI Pre-print | ||
14:15 15mTalk | Search-Based Adversarial Testing and Improvement of Constrained Credit Scoring Systems ESEC/FSE 2020 Salah Ghamizi University of Luxembourg, Luxembourg, Maxime Cordy University of Luxembourg, Luxembourg, Martin Gubri University of Luxembourg, Luxembourg, Mike Papadakis University of Luxembourg, Luxembourg, Andrey Boystov University of Luxembourg, Luxembourg, Yves Le Traon University of Luxembourg, Luxembourg, Anne Goujon BGL BNP Paribas, Luxembourg | ||
14:30 15mTalk | Is Neuron Coverage a Meaningful Measure for Testing Deep Neural Networks? ESEC/FSE 2020 Fabrice Harel-Canada University of California at Los Angeles, USA, Lingxiao Wang University of California at Los Angeles, USA, Muhammad Ali Gulzar Virginia Tech, USA, Quanquan Gu University of California at Los Angeles, USA, Miryung Kim University of California at Los Angeles, USA Link to publication Authorizer link Pre-print | ||
14:45 15mTalk | When Does My Program Do This? Learning Circumstances of Software Behavior ESEC/FSE 2020 Alexander Kampmann CISPA, Germany, Nikolas Havrikov CISPA, Germany, Ezekiel Soremekun SnT, University of Luxembourg, Andreas Zeller CISPA Helmholtz Center for Information Security Link to publication DOI | ||
15:00 15mTalk | FrUITeR: A Framework for Evaluating UI Test Reuse ESEC/FSE 2020 Yixue Zhao University of Massachusetts at Amherst, Justin Chen Columbia University, USA, Adriana Sejfia University of Southern California, Marcelo Schmitt Laser University of Southern California, USA, Jie M. Zhang King's College London, Federica Sarro University College London, Mark Harman University College London, Nenad Medvidović University of Southern California Pre-print Media Attached | ||