Containerized A/B testing

Ádám Révész, Norbert Pataki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Software version ranking plays an important role in improved user experience and software quality. A/B testing is technique to distinguish between the popularity and usability of two quite similar versions (A and B) of a product, marketing strategy, search ad, etc. It is a kind of two-sample hypothesis testing, used in the field of statistics. This controlled experiment can evaluate user engagement or satisfaction with a new service, feature, or product. A/B testing is typically used in evaluation of user-experience design in software technology. DevOps is an emerging software methodology in which the development and operations are not independent processes, they affect each other. DevOps emphasizes the usage of virtualization technologies (e.g. containers). Docker is widely-used technology for containerization. In this paper we deal with a new approach for A/B testing via Docker containers. This approach is DevOps-style A/B testing because after the evaluation the better version remains in production.

Original languageEnglish
Title of host publicationSQAMIA 2017 - Proceedings of the 6th Workshop on Software Quality Analysis, Monitoring, Improvement, and Applications
EditorsZoran Budimac
PublisherCEUR-WS
ISBN (Electronic)9788670313552
Publication statusPublished - Jan 1 2017
Event6th Workshop on Software Quality Analysis, Monitoring, Improvement, and Applications, SQAMIA 2017 - Belgrade, Serbia
Duration: Sep 11 2017Sep 13 2017

Publication series

NameCEUR Workshop Proceedings
Volume1938
ISSN (Print)1613-0073

Other

Other6th Workshop on Software Quality Analysis, Monitoring, Improvement, and Applications, SQAMIA 2017
CountrySerbia
CityBelgrade
Period9/11/179/13/17

Keywords

  • A/B testing
  • Containers
  • DevOps
  • Docker

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'Containerized A/B testing'. Together they form a unique fingerprint.

  • Cite this

    Révész, Á., & Pataki, N. (2017). Containerized A/B testing. In Z. Budimac (Ed.), SQAMIA 2017 - Proceedings of the 6th Workshop on Software Quality Analysis, Monitoring, Improvement, and Applications [14] (CEUR Workshop Proceedings; Vol. 1938). CEUR-WS.