Experimentation growth: Evolving trustworthy A/B testing capabilities in online software companies
Artikel i vetenskaplig tidskrift, 2018

Companies need to know how much value their ideas deliver to customers. One of the most powerful ways to accurately measure this is by conducting online controlled experiments (OCEs). To run experiments, however, companies need to develop strong experimentation practices as well as align their organization and culture to experimentation. The main objective of this paper is to demonstrate how to run OCEs at large scale using the experience of companies that succeeded in scaling. Based on case study research at Microsoft, Booking.com, Skyscanner, and Intuit, we present our main contribution-The Experiment Growth Model. This four-stage model addresses the seven critical aspects of experimentation and can help companies to transform their organizations into learning laboratories where new ideas can be tested with scientific accuracy. Ultimately, this should lead to better products and services.

experimentation growth model

A/B testing

online controlled experimentation

case study

Författare

Aleksander Fabijan

Malmö universitet

Pavel Dmitriev

Outreach Io

Colin McFarland

Skyscanner

Lukas Vermeer

Booking.com

Helena Holmstrom Olsson

Malmö universitet

Jan Bosch

Chalmers, Data- och informationsteknik, Software Engineering, Software Engineering for Testing, Requirements, Innovation and Psychology

Journal of Software: Evolution and Process

2047-7481 (ISSN)

Vol. 30 12 e2113

Ämneskategorier

Övrig annan teknik

Företagsekonomi

Programvaruteknik

DOI

10.1002/smr.2113

Mer information

Senast uppdaterat

2019-03-01