Qualitative and Quantitative Assessment of Integration Testing for Model-Based Software in the Automotive Industry
Licentiate thesis, 2016
Objective: The goal of this thesis is to assess current integration testing in the automotive industry and extend the validation of simulation models. Accordingly, we aim to collect insights from the practitioners in the field, including elicitation of actual challenges in the industry, state-of-the-practice processes, and assessments of applicability for validation approaches.
Method: To achieve the objectives we combine quantitative and qualitative research methods including interviews, workshops, surveys, literature reviews, software measurements, correlation analysis, and statistical tests. In five studies attached with this thesis we combine multiple research methods to achieve high validity and to ensure all presented approaches are applicable in industry.
Results: We elicited and categorized challenges from practitioners in practice, particularly in the field of integration testing for automotive software and analyze the current software development process. We present measurement results from complexity and size metrics, as a first assessment of the models. In addition to single measurements, we show how to evaluate software measurement results collected over time and how they can be related to model quality. We show that outlier analysis can help detecting impactful observations in the model development process. Furthermore, we found five approaches for the prediction of software model growth data and elaborate on their strengths and weaknesses, in practice. Next to providing actual approaches, we present practitioners expectations towards maintainability measurements and measurement predictions.
Conclusion: In this work we contribute to the understanding of concrete challenges in industry, we describe current processes, and provide approaches applicable in industry to address elicited challenges. With our work we improve the current assessment of validity of simulation models in integration testing in the automotive industry.
Industrial Case Studies
Chalmers, Computer Science and Engineering (Chalmers), Software Engineering (Chalmers)
J. Schroeder, C. Berger, M. Staron, T. Herpel, A. Knauss “Unveiling Anomalies and their Impact on Software Quality in Model-Based Automotive Software Revisions with Software Metrics and Domain Experts”
J. Schroeder, C. Berger, T. Herpel, M. Staron “Comparing the Applicability of Complexity Measurements for Simulink Models during Integration Testing – An Industrial Case Study”
J. Schroeder, C. Berger, A. Knauss, H. Preenja, M. Ali, M. Staron, T. Herpel “Prediction of Software Model Growth in Practice”
J. Schroeder, C. Berger, T. Herpel “Simulation and Validation of a Safety- Critical Electronic Control Unit for Integration Testing in Connected Hardware-in-the-Loop Environments”
J. Schroeder, C. Berger, T. Herpel “Challenges from Integration Testing using Interconnected Hardware-in-the-Loop Test Rigs at an Automotive OEM”
Other Engineering and Technologies not elsewhere specified
Reliability and Maintenance
University of Gothenburg
SVEA 130, Lindholmen, Göteborg
Opponent: Martin Törngren, KTH Royal Institute of Technology, Sweden