Qualitative and Quantitative Assessment of Integration Testing for Model-Based Software in the Automotive Industry
Licentiate thesis, 2016

Background: Integration testing of vehicle software in the automotive industry relies heavily on simulation models. As they replicate actual vehicle functions in the testing process, they increase in size and amount of interconnectivity as rapidly as the actual functions. Valid simulation models are a precondition for valid integration testing. Hence, assessment of the models is of high importance in industry. At the same time, assessment approaches for model-based software validated in industry are scarce.
Objective: The goal of this thesis is to assess current integration testing in the automotive industry and extend the validation of simulation models. Accordingly, we aim to collect insights from the practitioners in the field, including elicitation of actual challenges in the industry, state-of-the-practice processes, and assessments of applicability for validation approaches.
Method: To achieve the objectives we combine quantitative and qualitative research methods including interviews, workshops, surveys, literature reviews, software measurements, correlation analysis, and statistical tests. In five studies attached with this thesis we combine multiple research methods to achieve high validity and to ensure all presented approaches are applicable in industry.
Results: We elicited and categorized challenges from practitioners in practice, particularly in the field of integration testing for automotive software and analyze the current software development process. We present measurement results from complexity and size metrics, as a first assessment of the models. In addition to single measurements, we show how to evaluate software measurement results collected over time and how they can be related to model quality. We show that outlier analysis can help detecting impactful observations in the model development process. Furthermore, we found five approaches for the prediction of software model growth data and elaborate on their strengths and weaknesses, in practice. Next to providing actual approaches, we present practitioners expectations towards maintainability measurements and measurement predictions.
Conclusion: In this work we contribute to the understanding of concrete challenges in industry, we describe current processes, and provide approaches applicable in industry to address elicited challenges. With our work we improve the current assessment of validity of simulation models in integration testing in the automotive industry.

Industrial Case Studies

Software Quality

Validation

Software Metrics

Maintainability

Software Engineering

Empirical Research

Technical Debt

SVEA 130, Lindholmen, Göteborg
Opponent: Martin Törngren, KTH Royal Institute of Technology, Sweden

Author

Jan Schröder

Chalmers, Computer Science and Engineering (Chalmers), Software Engineering (Chalmers)

J. Schroeder, C. Berger, M. Staron, T. Herpel, A. Knauss “Unveiling Anomalies and their Impact on Software Quality in Model-Based Automotive Software Revisions with Software Metrics and Domain Experts”

J. Schroeder, C. Berger, T. Herpel, M. Staron “Comparing the Applicability of Complexity Measurements for Simulink Models during Integration Testing – An Industrial Case Study”

J. Schroeder, C. Berger, A. Knauss, H. Preenja, M. Ali, M. Staron, T. Herpel “Prediction of Software Model Growth in Practice”

J. Schroeder, C. Berger, T. Herpel “Simulation and Validation of a Safety- Critical Electronic Control Unit for Integration Testing in Connected Hardware-in-the-Loop Environments”

J. Schroeder, C. Berger, T. Herpel “Challenges from Integration Testing using Interconnected Hardware-in-the-Loop Test Rigs at an Automotive OEM”

Subject Categories

Other Engineering and Technologies not elsewhere specified

Reliability and Maintenance

Software Engineering

Publisher

University of Gothenburg

SVEA 130, Lindholmen, Göteborg

Opponent: Martin Törngren, KTH Royal Institute of Technology, Sweden

More information

Latest update

2/1/2018 7