Automotive A/B testing: Challenges and Lessons Learned from Practice
Paper in proceeding, 2020

Over the past 15 years, A/B testing has been a critical tool for accurate prioritization of development efforts in online and web-facing companies. As automotive companies progress on their digitalization process, A/B testing and other experimentation techniques start to be adopted. However, specific characteristics of the automotive software industry create additional challenges to the successful adoption of A/B testing. Recently, research has been conducted to investigate the challenges and opportunities for experimentation techniques in the automotive and more generally in the embedded systems domain. However, despite the collaboration with industry, previous research was based on either hypothesized or toy scenarios in companies seeking, but not yet running experimentation. Utilizing a case study method, we investigate the challenges of adopting A/B testing in two large-scale automotive companies that are currently running or preparing for their first A/B testing. The contribution of this paper is two-fold. First, we present our main findings in terms of the challenges of real A/B testing iterations in automotive vehicles. Second, we present the current, potential solutions and lessons learned from applying A/B testing in the automotive domain.

Automotive Software

Challenges

Case study

A/B testing

Author

David Issa Mattos

Chalmers, Computer Science and Engineering (Chalmers), Software Engineering (Chalmers)

Jan Bosch

Chalmers, Computer Science and Engineering (Chalmers), Software Engineering (Chalmers)

Helena Holmström Olsson

Chalmers, Computer Science and Engineering (Chalmers), Software Engineering (Chalmers)

Aita Maryam Korshani

Volvo Cars

Jonn Lantz

Volvo Cars

Proceedings - 46th Euromicro Conference on Software Engineering and Advanced Applications, SEAA 2020

Vol. August 2020 101-109 9226309
978-172819532-2 (ISBN)

2020 46th Euromicro Conference on Software Engineering and Advanced Applications (SEAA)
Portoroz, Slovenia,

Subject Categories

Other Engineering and Technologies not elsewhere specified

Software Engineering

Information Science

DOI

10.1109/SEAA51224.2020.00026

ISBN

9781728195322

More information

Latest update

1/3/2024 9