AI-Based Automotive Test Case Generation: An Action Research Study on Integration of Generative AI into Test Automation Frameworks

Paper in proceeding, 2025

Generative AI is transforming software development, particularly in unit and regression testing. However, it’s rarely used in Hardware-in-the-Loop (HIL) testing due to hardware-specific environments. This paper examines integrating GitHub Copilot into automotive test automation frameworks, focusing on Volvo’s Test Automation Framework (TAF). It explores how Copilot can automate test case generation and compares AI-generated test cases with manually written ones in terms of reliability and robustness. Using an iterative action research methodology, the study evaluates the functional suitability of AI-generated test cases and the challenges of integration. Results show that in the first iteration, 23% of AI-generated test cases passed in Jenkins and received high functionality scores. In the second iteration, this increased to 36%. These findings highlight the potential of Generative AI to enhance HIL testing.