Automotive A/B testing: Challenges and Lessons Learned from Practice
Paper i proceeding, 2020

Over the past 15 years, A/B testing has been a critical tool for accurate prioritization of development efforts in online and web-facing companies. As automotive companies progress on their digitalization process, A/B testing and other experimentation techniques start to be adopted. However, specific characteristics of the automotive software industry create additional challenges to the successful adoption of A/B testing. Recently, research has been conducted to investigate the challenges and opportunities for experimentation techniques in the automotive and more generally in the embedded systems domain. However, despite the collaboration with industry, previous research was based on either hypothesized or toy scenarios in companies seeking, but not yet running experimentation. Utilizing a case study method, we investigate the challenges of adopting A/B testing in two large-scale automotive companies that are currently running or preparing for their first A/B testing. The contribution of this paper is two-fold. First, we present our main findings in terms of the challenges of real A/B testing iterations in automotive vehicles. Second, we present the current, potential solutions and lessons learned from applying A/B testing in the automotive domain.

Automotive Software

Challenges

Case study

A/B testing

Författare

David Issa Mattos

Chalmers, Data- och informationsteknik, Software Engineering

Jan Bosch

Chalmers, Data- och informationsteknik, Software Engineering

Helena Holmström Olsson

Chalmers, Data- och informationsteknik, Software Engineering

Aita Maryam Korshani

Volvo Cars

Jonn Lantz

Volvo Cars

Proceedings - 46th Euromicro Conference on Software Engineering and Advanced Applications, SEAA 2020

Vol. August 2020 101-109 9226309
978-172819532-2 (ISBN)

2020 46th Euromicro Conference on Software Engineering and Advanced Applications (SEAA)
Portoroz, Slovenia,

Ämneskategorier

Övrig annan teknik

Programvaruteknik

Systemvetenskap

DOI

10.1109/SEAA51224.2020.00026

ISBN

9781728195322

Mer information

Senast uppdaterat

2024-01-03