Predicting Test Case Verdicts Using TextualAnalysis of Commited Code Churns
Paper i proceeding, 2019

Background: Continuous Integration (CI) is an agile software development practice that involves producing several clean builds of the software per day. The creation of these builds involve running excessive executions of automated tests, which is hampered by high hardware cost and reduced development velocity. Goal: The goal of our research is to develop a method that reduces the number of executed test cases at each CI cycle.Method: We adopt a design research approach with an infrastructure provider company to develop a method that exploits Ma-chine Learning (ML) to predict test case verdicts for committed sourcecode. We train five different ML models on two data sets and evaluate their performance using two simple retrieval measures: precision and recall. Results: While the results from training the ML models on the first data-set of test executions revealed low performance, the curated data-set for training showed an improvement on performance with respect to precision and recall. Conclusion: Our results indicate that the method is applicable when training the ML model on churns of small sizes

Test Case Selection

Code Churn

Machine Learning

Verdicts

Författare

Khaled Al Sabbagh

Chalmers, Data- och informationsteknik, Software Engineering, Software Engineering for Testing, Requirements, Innovation and Psychology

Miroslaw Staron

Chalmers, Data- och informationsteknik, Software Engineering, Software Engineering for Cyber Physical Systems

Regina Hebig

Chalmers, Data- och informationsteknik, Software Engineering, Software Engineering for Testing, Requirements, Innovation and Psychology

Wilhelm Meding

CEUR Workshop Proceedings

16130073 (ISSN)

Vol. 2476 138-153 7

International Workshop on Software Measurement and the International Conference on Software Process and Product Measurement
Haarlem, Netherlands,

Ämneskategorier

Programvaruteknik

Datavetenskap (datalogi)

Datorsystem

Mer information

Skapat

2021-08-18