Using Benchmarking Bots for Continuous Performance Assessment
Journal article, 2022
Benchmarking bots are starting to see use as a productivity tool, helping large open source projects judge whether new code contributions negatively impact performance. We discuss how and why projects use benchmarking bots, and present an in-depth case study of The Nanosoldier bot used by the team behind the Julia programming language.
Codes
Open source software
Benchmark testing
Software
Bot (Internet)
Manuals
Software development management
Author
Florian Markusse
Eindhoven University of Technology
Philipp Leitner
Chalmers, Computer Science and Engineering (Chalmers), Interaction Design and Software Engineering
Alexander Serebrenik
Eindhoven University of Technology
IEEE Software
0740-7459 (ISSN) 19374194 (eISSN)
Vol. 39 5 50-55Subject Categories
Software Engineering
Computer Science
DOI
10.1109/MS.2022.3184430