Exploratory testing of large-scale systems – Testing in the continuous integration and delivery pipeline
Paper i proceeding, 2017

In this paper, we show how exploratory testing plays a role as part of a continuous integration and delivery pipeline for large-scale and complex software products. We propose a test method that incorporates exploratory testing as an activity in the continuous integration and delivery pipeline, and is based on elements from other testing techniques such as scenario-based testing, testing in teams and testing in time-boxed sessions. The test method has been validated during ten months by 28 individuals (21 engineers and 7 flight test pilots) in a case study where the system under test is a fighter aircraft. Quantitative data from the case study company shows that the exploratory test teams produced more problem reports than other test teams. The interview results show that both engineers and test pilots were generally positive or very positive when they described their experiences from the case study, and consider the test method to be an efficient way of testing the system in the case study.

Continuous integration

Exploratory testing

Software testing

Large-scale systems

Continuous delivery


T. Mårtensson


D. Ståhl

Ericsson AB

Jan Bosch

Chalmers, Data- och informationsteknik, Software Engineering

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

03029743 (ISSN) 16113349 (eISSN)

Vol. 10611 LNCS 368-384
978-331969925-7 (ISBN)


Data- och informationsvetenskap





Mer information

Senast uppdaterat