Exploratory testing of large-scale systems – Testing in the continuous integration and delivery pipeline
Paper i proceeding, 2017

In this paper, we show how exploratory testing plays a role as part of a continuous integration and delivery pipeline for large-scale and complex software products. We propose a test method that incorporates exploratory testing as an activity in the continuous integration and delivery pipeline, and is based on elements from other testing techniques such as scenario-based testing, testing in teams and testing in time-boxed sessions. The test method has been validated during ten months by 28 individuals (21 engineers and 7 flight test pilots) in a case study where the system under test is a fighter aircraft. Quantitative data from the case study company shows that the exploratory test teams produced more problem reports than other test teams. The interview results show that both engineers and test pilots were generally positive or very positive when they described their experiences from the case study, and consider the test method to be an efficient way of testing the system in the case study.

Continuous integration

Software testing

Exploratory testing

Large-scale systems

Continuous delivery

Författare

T. Mårtensson

Saab AB

D. Ståhl

Ericsson Sweden

Jan Bosch

Chalmers, Data- och informationsteknik, Software Engineering

Lecture Notes in Computer Science

0302-9743 (ISSN)

Vol. 10611 LNCS 368-384

Ämneskategorier

Data- och informationsvetenskap

DOI

10.1007/978-3-319-69926-4_26

ISBN

978-331969925-7