What to Expect from Code Review Bots on GitHub? A Survey with OSS Maintainers

Mairieli Wessel, Alexander Serebrenik, Igor Scaliante Wiese, Igor Steinmacher, Marco Aurelio Gerosa

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review


    Software bots are used by Open Source Software (OSS) projects to streamline the code review process. Interfacing between developers and automated services, code review bots report continuous integration failures, code quality checks, and code coverage. However, the impact of such bots on maintenance tasks is still neglected. In this paper, we study how project maintainers experience code review bots. We surveyed 127 maintainers and asked about their expectations and perception of changes incurred by code review bots. Our findings reveal that the most frequent expectations include enhancing the feedback bots provide to developers, reducing the maintenance burden for developers, and enforcing code coverage. While maintainers report that bots satisfied their expectations, they also perceived unexpected effects, such as communication noise and newcomers' dropout. Based on these results, we provide a series of implications for bot developers, as well as insights for future research.
    Original languageEnglish
    Title of host publicationBrazilian Symposium on Software Engineering
    Publication statusAccepted/In press - 18 Aug 2020


    Dive into the research topics of 'What to Expect from Code Review Bots on GitHub? A Survey with OSS Maintainers'. Together they form a unique fingerprint.

    Cite this