The Benefits of Controlled Experimentation at Scale

DSpace Repository

The Benefits of Controlled Experimentation at Scale

Overview

Detailed record

dc.contributor.author Fabijan, Aleksander en_US
dc.contributor.author Dmitriev, Pavel en_US
dc.contributor.author Olsson Holmström, Helena en_US
dc.contributor.author Bosh, Jan en_US
dc.date.accessioned 2017-12-20T09:47:42Z
dc.date.available 2017-12-20T09:47:42Z
dc.date.issued 2017 en_US
dc.identifier.isbn 978-1-5386-2141-7
dc.identifier.uri http://hdl.handle.net/2043/24150
dc.description.abstract Online controlled experiments (for example A/B tests) are increasingly being performed to guide product development and accelerate innovation in online software product companies. The benefits of controlled experiments have been shown in many cases with incremental product improvement as the objective. In this paper, we demonstrate that the value of controlled experimentation at scale extends beyond this recognized scenario. Based on an exhaustive and collaborative case study in a large software-intensive company with highly developed experimentation culture, we inductively derive the benefits of controlled experimentation. The contribution of our paper is twofold. First, we present a comprehensive list of benefits and illustrate our findings with five case examples of controlled experiments conducted at Microsoft. Second, we provide guidance on how to achieve each of the benefits. With our work, we aim to provide practitioners in the online domain with knowledge on how to use controlled experimentation to maximize the benefits on the portfolio, product and team level. en_US
dc.format.extent 9
dc.language.iso eng en_US
dc.publisher IEEE en_US
dc.subject controlled experimentation en_US
dc.subject leading metrics en_US
dc.subject lagging metrics en_US
dc.subject data-driven development en_US
dc.subject.classification Technology en_US
dc.title The Benefits of Controlled Experimentation at Scale en_US
dc.type Paper in proceeding en_US
dc.relation.url http://dsd-seaa2017.ocg.at/seaa2017.html en_US
dc.identifier.paperprint 0 en_US
dc.contributor.department Malmö University. Faculty of Technology and Society
dc.identifier.doi 10.1109/SEAA.2017.47
dc.subject.srsc Research Subject Categories::TECHNOLOGY en_US
dc.relation.ispartofpublication 2017 43rd Euromicro Conference on Software Engineering and Advanced Applications (SEAA);
dc.description.authorversion Yes en_US
dcterms.description.conferenceName Euromicro Conference on Software Engineering and Advanced Applications (SEAA) en_US
dcterms.description.conferencePlace Vienna, Austria en_US
dcterms.description.conferenceYear 2017 en_US
dc.format.ePage 26
dc.format.sPage 18
mahlocal.rights.oaType green
 Find Full text Files for download
Icon

This item appears in the following Collection(s)

Overview

Search


Browse

My Account

Statistics