Workflow-level parameter study support for production grids

Peter Kacsuk, Zoltan Farkas, Gabor Hermann

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

Workflow applications are frequently used in many production Grids. There is a natural need to run the same workflow with many different parameter sets. Unfortunately current Grid portals either do not support this kind of applications or give only specialized support and hence users are obliged to do all the tedious work needed to manage such parameter study applications. P-GRADE portal has been providing a high-level, graphical workflow development and execution environment for various Grids (EGEE, UK NGS, GIN VO, OSG, TeraGrid, etc.) built on second and third generation Grid technologies (GT2, LCG-2, GT4, gLite). Feedback from the user communities of the portal showed that parameter study support is highly needed and hence the recent release of the portal supports the workflow-level parameter study applications. The current paper describes the semantics and implementation principles of managing and executing workflows as parameter studies. Two algorithms are described in detail. The black box algorithm optimizes the usage of storage resources while the PS-labeling algorithm minimizes the load of Grid processing resources. Special emphasis is on the concurrent management of large number of files and jobs in the portal and in the Grids as well as providing a user-friendly, easy-to-use graphical environment to define the workflows and monitor their parametric study execution.

Original languageEnglish
Title of host publicationComputational Science and Its Applications - ICCSA 2007 - International Conference, Proceedings
PublisherSpringer Verlag
Pages872-885
Number of pages14
EditionPART 3
ISBN (Print)9783540744825
DOIs
Publication statusPublished - 2007
EventInternational Conference on Computational Science and its Applications, ICCSA 2007 - Kuala Lumpur, Malaysia
Duration: Aug 26 2007Aug 29 2007

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 3
Volume4707 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

OtherInternational Conference on Computational Science and its Applications, ICCSA 2007
CountryMalaysia
CityKuala Lumpur
Period8/26/078/29/07

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Workflow-level parameter study support for production grids'. Together they form a unique fingerprint.

  • Cite this

    Kacsuk, P., Farkas, Z., & Hermann, G. (2007). Workflow-level parameter study support for production grids. In Computational Science and Its Applications - ICCSA 2007 - International Conference, Proceedings (PART 3 ed., pp. 872-885). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4707 LNCS, No. PART 3). Springer Verlag. https://doi.org/10.1007/978-3-540-74484-9_74