Containerized A/B testing

A. Révész, Norbert Pataki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Software version ranking plays an important role in improved user experience and software quality. A/B testing is technique to distinguish between the popularity and usability of two quite similar versions (A and B) of a product, marketing strategy, search ad, etc. It is a kind of two-sample hypothesis testing, used in the field of statistics. This controlled experiment can evaluate user engagement or satisfaction with a new service, feature, or product. A/B testing is typically used in evaluation of user-experience design in software technology. DevOps is an emerging software methodology in which the development and operations are not independent processes, they affect each other. DevOps emphasizes the usage of virtualization technologies (e.g. containers). Docker is widely-used technology for containerization. In this paper we deal with a new approach for A/B testing via Docker containers. This approach is DevOps-style A/B testing because after the evaluation the better version remains in production.

Original languageEnglish
Title of host publicationSQAMIA 2017 - Proceedings of the 6th Workshop on Software Quality Analysis, Monitoring, Improvement, and Applications
PublisherCEUR-WS
Volume1938
ISBN (Electronic)9788670313552
Publication statusPublished - Jan 1 2017
Event6th Workshop on Software Quality Analysis, Monitoring, Improvement, and Applications, SQAMIA 2017 - Belgrade, Serbia
Duration: Sep 11 2017Sep 13 2017

Other

Other6th Workshop on Software Quality Analysis, Monitoring, Improvement, and Applications, SQAMIA 2017
CountrySerbia
CityBelgrade
Period9/11/179/13/17

Fingerprint

Testing
Containers
Marketing
Statistics
Experiments
Virtualization

Keywords

  • A/B testing
  • Containers
  • DevOps
  • Docker

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Révész, A., & Pataki, N. (2017). Containerized A/B testing. In SQAMIA 2017 - Proceedings of the 6th Workshop on Software Quality Analysis, Monitoring, Improvement, and Applications (Vol. 1938). [14] CEUR-WS.

Containerized A/B testing. / Révész, A.; Pataki, Norbert.

SQAMIA 2017 - Proceedings of the 6th Workshop on Software Quality Analysis, Monitoring, Improvement, and Applications. Vol. 1938 CEUR-WS, 2017. 14.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Révész, A & Pataki, N 2017, Containerized A/B testing. in SQAMIA 2017 - Proceedings of the 6th Workshop on Software Quality Analysis, Monitoring, Improvement, and Applications. vol. 1938, 14, CEUR-WS, 6th Workshop on Software Quality Analysis, Monitoring, Improvement, and Applications, SQAMIA 2017, Belgrade, Serbia, 9/11/17.
Révész A, Pataki N. Containerized A/B testing. In SQAMIA 2017 - Proceedings of the 6th Workshop on Software Quality Analysis, Monitoring, Improvement, and Applications. Vol. 1938. CEUR-WS. 2017. 14
Révész, A. ; Pataki, Norbert. / Containerized A/B testing. SQAMIA 2017 - Proceedings of the 6th Workshop on Software Quality Analysis, Monitoring, Improvement, and Applications. Vol. 1938 CEUR-WS, 2017.
@inproceedings{5bc044cb095c4a71ba13f854a4afb30b,
title = "Containerized A/B testing",
abstract = "Software version ranking plays an important role in improved user experience and software quality. A/B testing is technique to distinguish between the popularity and usability of two quite similar versions (A and B) of a product, marketing strategy, search ad, etc. It is a kind of two-sample hypothesis testing, used in the field of statistics. This controlled experiment can evaluate user engagement or satisfaction with a new service, feature, or product. A/B testing is typically used in evaluation of user-experience design in software technology. DevOps is an emerging software methodology in which the development and operations are not independent processes, they affect each other. DevOps emphasizes the usage of virtualization technologies (e.g. containers). Docker is widely-used technology for containerization. In this paper we deal with a new approach for A/B testing via Docker containers. This approach is DevOps-style A/B testing because after the evaluation the better version remains in production.",
keywords = "A/B testing, Containers, DevOps, Docker",
author = "A. R{\'e}v{\'e}sz and Norbert Pataki",
year = "2017",
month = "1",
day = "1",
language = "English",
volume = "1938",
booktitle = "SQAMIA 2017 - Proceedings of the 6th Workshop on Software Quality Analysis, Monitoring, Improvement, and Applications",
publisher = "CEUR-WS",

}

TY - GEN

T1 - Containerized A/B testing

AU - Révész, A.

AU - Pataki, Norbert

PY - 2017/1/1

Y1 - 2017/1/1

N2 - Software version ranking plays an important role in improved user experience and software quality. A/B testing is technique to distinguish between the popularity and usability of two quite similar versions (A and B) of a product, marketing strategy, search ad, etc. It is a kind of two-sample hypothesis testing, used in the field of statistics. This controlled experiment can evaluate user engagement or satisfaction with a new service, feature, or product. A/B testing is typically used in evaluation of user-experience design in software technology. DevOps is an emerging software methodology in which the development and operations are not independent processes, they affect each other. DevOps emphasizes the usage of virtualization technologies (e.g. containers). Docker is widely-used technology for containerization. In this paper we deal with a new approach for A/B testing via Docker containers. This approach is DevOps-style A/B testing because after the evaluation the better version remains in production.

AB - Software version ranking plays an important role in improved user experience and software quality. A/B testing is technique to distinguish between the popularity and usability of two quite similar versions (A and B) of a product, marketing strategy, search ad, etc. It is a kind of two-sample hypothesis testing, used in the field of statistics. This controlled experiment can evaluate user engagement or satisfaction with a new service, feature, or product. A/B testing is typically used in evaluation of user-experience design in software technology. DevOps is an emerging software methodology in which the development and operations are not independent processes, they affect each other. DevOps emphasizes the usage of virtualization technologies (e.g. containers). Docker is widely-used technology for containerization. In this paper we deal with a new approach for A/B testing via Docker containers. This approach is DevOps-style A/B testing because after the evaluation the better version remains in production.

KW - A/B testing

KW - Containers

KW - DevOps

KW - Docker

UR - http://www.scopus.com/inward/record.url?scp=85030769755&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85030769755&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85030769755

VL - 1938

BT - SQAMIA 2017 - Proceedings of the 6th Workshop on Software Quality Analysis, Monitoring, Improvement, and Applications

PB - CEUR-WS

ER -