Write a Blog >>
ESEC/FSE 2022
Mon 14 - Fri 18 November 2022 Singapore
Mon 14 Nov 2022 14:45 - 15:00 at SRC LT 51 - Community Chair(s): Dirk Riehle

Gamification is the use of game elements such as points, leaderboards, and badges in a non-game context to encourage a desired behavior from individuals interacting with an environment. Recently, gamification has found its way into software engineering contexts as a means to promote certain activities to practitioners. Previous studies investigated the use of gamification to promote the adoption of a variety of tools and practices, however, these studies were either performed in an educational environment or in small to medium-sized teams of developers in the industry.

We performed a large-scale mixed-methods study on the effects of badge-based gamification in promoting the adoption of DevOps practices in a very large company and evaluated how practice adoption is associated with changes in key delivery, quality, and throughput metrics of 333 software projects.
We observed an accelerated adoption of some gamified DevOps practices by at least 60%, with increased adoption rates up to 6x.
We found mixed results when associating badge adoption and metric changes:
teams that earned testing badges showed an increase in bug fixing commits but output fewer commits and pull requests; teams that earned code review and quality tooling badges exhibited faster delivery metrics.
Finally, our empirical study was supplemented by a survey with 45 developers where 73% of respondents found badges to be helpful for learning about and adopting new standardized practices. Our results contribute to the rich knowledge on gamification with a unique and important perspective from real industry practitioners.

Mon 14 Nov

Displayed time zone: Beijing, Chongqing, Hong Kong, Urumqi change

14:00 - 15:30
CommunityResearch Papers / Ideas, Visions and Reflections / Demonstrations / Industry Paper at SRC LT 51
Chair(s): Dirk Riehle University of Bavaria, Erlangen
14:00
15m
Talk
In War and Peace: The Impact of World Politics on Software Ecosystems
Ideas, Visions and Reflections
Raula Gaikovina Kula Nara Institute of Science and Technology, Christoph Treude University of Melbourne
DOI
14:15
15m
Talk
A Retrospective Study of One Decade of Artifact Evaluations
Research Papers
Stefan Winter LMU Munich, Christopher Steven Timperley Carnegie Mellon University, Ben Hermann TU Dortmund, Jürgen Cito TU Wien, Jonathan Bell Northeastern University, Michael Hilton Carnegie Mellon University, Dirk Beyer LMU Munich
DOI
14:30
15m
Talk
Understanding Skills for OSS Communities on GitHub
Research Papers
Jenny T. Liang University of Washington, Thomas Zimmermann Microsoft Research, Denae Ford Microsoft Research
DOI Pre-print Media Attached
14:45
15m
Talk
Achievement Unlocked: A Case Study on Gamifying DevOps Practices in Industry
Industry Paper
Patrick Ayoup Concordia University, Diego Costa Concordia University, Canada, Emad Shihab Concordia University
DOI
15:00
7m
Talk
iTiger: An Automatic Issue Title Generation Tool
Demonstrations
Ting Zhang Singapore Management University, Ivana Clairine Irsan Singapore Management University, Ferdian Thung Singapore Management University, DongGyun Han Royal Holloway, University of London, David Lo Singapore Management University, Lingxiao Jiang Singapore Management University
15:08
7m
Talk
CodeMatcher: A Tool for Large-Scale Code Search Based on Query Semantics Matching
Demonstrations
Chao Liu Chongqing University, Xuanlin Bao Chongqing University, Xin Xia Huawei, Meng Yan Chongqing University, David Lo Singapore Management University, Ting Zhang Singapore Management University
15:15
15m
Talk
Generating Realistic Vulnerabilities via Neural Code Editing: An Empirical Study
Research Papers
Yu Nong Washington State University, Yuzhe Ou University of Texas at Dallas, Michael Pradel University of Stuttgart, Feng Chen University of Texas at Dallas, Haipeng Cai Washington State University
DOI Pre-print