Continuous A/B testing in containers

A. Révész, Norbert Pataki

Research output: Paper

1 Citation (Scopus)

Abstract

Software version ranking plays an important role in improved user experience and software quality. A/B testing is a technique to distinguish between the popularity and usability of two quite similar versions (A and B) of a product, marketing strategy, search ad, etc. It is a kind of two-sample hypothesis testing, used in the field of statistics. This controlled experiment can evaluate user engagement or satisfaction with a new service, feature, or product. A/B testing is typically used in evaluation of user-experience design in software technology. DevOps is an emerging software methodology in which the development and operations are not independent processes, they affect each other. DevOps emphasizes the usage of virtualization technologies (e.g. containers). Docker is widely-used technology for containerization. In this paper, we deal with a new approach for regular A/B testing via Docker containers. Our solution provides an API that can be available from many DevOps tools. This approach is DevOps-style A/B testing because after the evaluation the better version remains in production.

Original languageEnglish
Pages11-14
Number of pages4
DOIs
Publication statusPublished - jan. 1 2019
Event2nd International Conference on Geoinformatics and Data Analysis, ICGDA 2019 - Prague, Czech Republic
Duration: márc. 15 2019márc. 17 2019

Conference

Conference2nd International Conference on Geoinformatics and Data Analysis, ICGDA 2019
CountryCzech Republic
CityPrague
Period3/15/193/17/19

Fingerprint

Containers
Testing
Application programming interfaces (API)
Marketing
Statistics
Experiments

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Révész, A., & Pataki, N. (2019). Continuous A/B testing in containers. 11-14. Paper presented at 2nd International Conference on Geoinformatics and Data Analysis, ICGDA 2019, Prague, Czech Republic. https://doi.org/10.1145/3318236.3318254

Continuous A/B testing in containers. / Révész, A.; Pataki, Norbert.

2019. 11-14 Paper presented at 2nd International Conference on Geoinformatics and Data Analysis, ICGDA 2019, Prague, Czech Republic.

Research output: Paper

Révész, A & Pataki, N 2019, 'Continuous A/B testing in containers', Paper presented at 2nd International Conference on Geoinformatics and Data Analysis, ICGDA 2019, Prague, Czech Republic, 3/15/19 - 3/17/19 pp. 11-14. https://doi.org/10.1145/3318236.3318254
Révész A, Pataki N. Continuous A/B testing in containers. 2019. Paper presented at 2nd International Conference on Geoinformatics and Data Analysis, ICGDA 2019, Prague, Czech Republic. https://doi.org/10.1145/3318236.3318254
Révész, A. ; Pataki, Norbert. / Continuous A/B testing in containers. Paper presented at 2nd International Conference on Geoinformatics and Data Analysis, ICGDA 2019, Prague, Czech Republic.4 p.
@conference{c13bdc3624b24b1db17d61c132c08500,
title = "Continuous A/B testing in containers",
abstract = "Software version ranking plays an important role in improved user experience and software quality. A/B testing is a technique to distinguish between the popularity and usability of two quite similar versions (A and B) of a product, marketing strategy, search ad, etc. It is a kind of two-sample hypothesis testing, used in the field of statistics. This controlled experiment can evaluate user engagement or satisfaction with a new service, feature, or product. A/B testing is typically used in evaluation of user-experience design in software technology. DevOps is an emerging software methodology in which the development and operations are not independent processes, they affect each other. DevOps emphasizes the usage of virtualization technologies (e.g. containers). Docker is widely-used technology for containerization. In this paper, we deal with a new approach for regular A/B testing via Docker containers. Our solution provides an API that can be available from many DevOps tools. This approach is DevOps-style A/B testing because after the evaluation the better version remains in production.",
keywords = "A/B testing, Containers, DevOps, Docker",
author = "A. R{\'e}v{\'e}sz and Norbert Pataki",
year = "2019",
month = "1",
day = "1",
doi = "10.1145/3318236.3318254",
language = "English",
pages = "11--14",
note = "2nd International Conference on Geoinformatics and Data Analysis, ICGDA 2019 ; Conference date: 15-03-2019 Through 17-03-2019",

}

TY - CONF

T1 - Continuous A/B testing in containers

AU - Révész, A.

AU - Pataki, Norbert

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Software version ranking plays an important role in improved user experience and software quality. A/B testing is a technique to distinguish between the popularity and usability of two quite similar versions (A and B) of a product, marketing strategy, search ad, etc. It is a kind of two-sample hypothesis testing, used in the field of statistics. This controlled experiment can evaluate user engagement or satisfaction with a new service, feature, or product. A/B testing is typically used in evaluation of user-experience design in software technology. DevOps is an emerging software methodology in which the development and operations are not independent processes, they affect each other. DevOps emphasizes the usage of virtualization technologies (e.g. containers). Docker is widely-used technology for containerization. In this paper, we deal with a new approach for regular A/B testing via Docker containers. Our solution provides an API that can be available from many DevOps tools. This approach is DevOps-style A/B testing because after the evaluation the better version remains in production.

AB - Software version ranking plays an important role in improved user experience and software quality. A/B testing is a technique to distinguish between the popularity and usability of two quite similar versions (A and B) of a product, marketing strategy, search ad, etc. It is a kind of two-sample hypothesis testing, used in the field of statistics. This controlled experiment can evaluate user engagement or satisfaction with a new service, feature, or product. A/B testing is typically used in evaluation of user-experience design in software technology. DevOps is an emerging software methodology in which the development and operations are not independent processes, they affect each other. DevOps emphasizes the usage of virtualization technologies (e.g. containers). Docker is widely-used technology for containerization. In this paper, we deal with a new approach for regular A/B testing via Docker containers. Our solution provides an API that can be available from many DevOps tools. This approach is DevOps-style A/B testing because after the evaluation the better version remains in production.

KW - A/B testing

KW - Containers

KW - DevOps

KW - Docker

UR - http://www.scopus.com/inward/record.url?scp=85066853950&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85066853950&partnerID=8YFLogxK

U2 - 10.1145/3318236.3318254

DO - 10.1145/3318236.3318254

M3 - Paper

AN - SCOPUS:85066853950

SP - 11

EP - 14

ER -