LabelMovie: Semi-supervised machine annotation tool with quality assurance and crowd-sourcing options for videos

Zsolt Palotai, Miklos Lang, Andras Sarkany, Zoltan Toser, Daniel Sonntag, Takumi Toyama, Andras Lorincz

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

For multiple reasons, the automatic annotation of video recordings is challenging. The amount of database video instances to be annotated is huge, tedious manual labeling sessions are required, the multi-modal annotation needs exact information of space, time, and context, and the different labeling opportunities require special agreements between annotators, and alike. Crowd-sourcing with quality assurance by experts may come to the rescue here. We have developed a special tool: individual experts can annotate videos over the Internet, their work can be joined and filtered, the annotated material can be evaluated by machine learning methods, and automated annotation may start according to a predefined confidence level. A relatively small number of manually labeled instances may efficiently bootstrap the machine annotation procedure. We present the new mathematical concepts and algorithms for semi-supervised induction and the corresponding manual annotation tool which features special visualization methods for crowd-sourced users. A special feature is that the annotation tool is usable for users not familiar with machine learning methods; for example, we allow them to ignite and handle a complex bootstrapping process.

Original languageEnglish
Title of host publication2014 12th International Workshop on Content-Based Multimedia Indexing, CBMI 2014
PublisherIEEE Computer Society
ISBN (Print)9781479939909
DOIs
Publication statusPublished - Jan 1 2014
Event12th International Workshop on Content-Based Multimedia Indexing, CBMI 2014 - Klagenfurt, Austria
Duration: Jun 18 2014Jun 20 2014

Publication series

NameProceedings - International Workshop on Content-Based Multimedia Indexing
ISSN (Print)1949-3991

Other

Other12th International Workshop on Content-Based Multimedia Indexing, CBMI 2014
CountryAustria
CityKlagenfurt
Period6/18/146/20/14

    Fingerprint

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Information Systems

Cite this

Palotai, Z., Lang, M., Sarkany, A., Toser, Z., Sonntag, D., Toyama, T., & Lorincz, A. (2014). LabelMovie: Semi-supervised machine annotation tool with quality assurance and crowd-sourcing options for videos. In 2014 12th International Workshop on Content-Based Multimedia Indexing, CBMI 2014 [6849850] (Proceedings - International Workshop on Content-Based Multimedia Indexing). IEEE Computer Society. https://doi.org/10.1109/CBMI.2014.6849850