An Activity and Metric Model for Online Controlled Experiments

DSpace Repository

An Activity and Metric Model for Online Controlled Experiments

Overview

Detailed record

dc.contributor.author Mattos Issa, David en_US
dc.contributor.author Fabijan, Aleksander en_US
dc.contributor.author Dimitriev, Pavel en_US
dc.contributor.author Bosch, Jan en_US
dc.contributor.author Olsson Holmström, Helena en_US
dc.contributor.editor Kuhrmann, Marco
dc.contributor.editor Schneider, Kurt
dc.contributor.editor Pfahl, Dietmar
dc.contributor.editor Amasaki, Sousuke
dc.contributor.editor Ciolkowski, Marcus
dc.contributor.editor Hebig, Regina
dc.contributor.editor Tell, Paolo
dc.contributor.editor Klünder, Jil
dc.contributor.editor Küpper, Steffen
dc.date.accessioned 2019-03-05T12:42:31Z
dc.date.available 2019-03-05T12:42:31Z
dc.date.issued 2018 en_US
dc.identifier.isbn 978-3-030-03672-0
dc.identifier.isbn 978-3-030-03673-7
dc.identifier.issn 0302-9743
dc.identifier.uri http://hdl.handle.net/2043/28009
dc.description.abstract Accurate prioritization of efforts in product and services development is critical to the success of every company. Online controlled experiments, also known as A/B tests, enable software companies to establish causal relationships between changes in their systems and the movements in the metrics. By experimenting, product development can be directed towards identifying and delivering value. Previous research stresses the need for data-driven development and experimentation. However, the level of granularity in which existing models explain the experimentation process is neither sufficient, in terms of details, nor scalable, in terms of how to increase number and run different types of experiments, in an online setting. Based on a case study of multiple products running online controlled experiments at Microsoft, we provide an experimentation framework composed of two detailed experimentation models focused on two main aspects; the experimentation activities and the experimentation metrics. This work intends to provide guidelines to companies and practitioners on how to set and organize experimentation activities for running trustworthy online controlled experiments. en_US
dc.language.iso eng en_US
dc.publisher Springer en_US
dc.relation.ispartofseries Lecture Notes in Computer Science;11271
dc.relation.ispartofseries Programming and Software Engineering;11271
dc.subject Data-driven development en_US
dc.subject A/B tests en_US
dc.subject Online controlled experiments en_US
dc.subject.classification Technology en_US
dc.title An Activity and Metric Model for Online Controlled Experiments en_US
dc.type Paper in proceeding en_US
dc.relation.url https://profes2018.wordpress.com/ en_US
dc.identifier.paperprint 0 en_US
dc.contributor.department Malmö University. Faculty of Technology and Society
dc.identifier.doi 10.1007/978-3-030-03673-7_14
dc.subject.srsc Research Subject Categories::TECHNOLOGY en_US
dc.relation.ispartofpublication PROFES 2018 : Product-Focused Software Process Improvement;
dc.description.authorversion Yes
dcterms.description.conferenceName International Conference of Product-focused Software Process Improvement en_US
dcterms.description.conferencePlace Wolfsburg, Germany en_US
dcterms.description.conferenceYear November 28-30 en_US
dc.format.ePage 198 en_US
dc.format.sPage 182 en_US
 Find Full text Files for download
Icon
Accepted manuscript

This item appears in the following Collection(s)

Overview

Search


Browse

My Account

Statistics