Brokering Solution for Science Gateways Using Multiple Distributed Computing Infrastructures

Krisztian Karoczkai, Attila Kertesz, P. Kacsuk

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

The ever growing number of computation-intensive applications calls for the interoperation of distributed infrastructures such as Clouds, Grids and private clusters. The European SHIWA and ER-flow projects have been initiated to enable the combination of heterogeneous scientific workflows, and to execute them in a large-scale system consisting of multiple Distributed Computing Infrastructures including Grids and Clouds. One of the resource management challenges of these projects called parameter study job scheduling. A parameter study job of a workflow has a large number of input files to be consumed by independent job instances. In this paper we propose a meta-brokering solution for these workflows to be applied in science gateways. To cope with the high uncertainty and unpredictable load of the utilized infrastructures, we rely on resource priority services. These tools are capable of determining and dynamically updating priorities of the available infrastructures to be selected for job instances.

Original languageEnglish
Title of host publicationProceedings - 7th International Workshop on Science Gateways, IWSG 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages28-33
Number of pages6
ISBN (Print)9781467374590
DOIs
Publication statusPublished - Aug 21 2015
Event7th International Workshop on Science Gateways, IWSG 2015 - Budapest, Hungary
Duration: Jun 3 2015Jun 5 2015

Other

Other7th International Workshop on Science Gateways, IWSG 2015
CountryHungary
CityBudapest
Period6/3/156/5/15

Fingerprint

Gateways (computer networks)
Distributed computer systems
Large scale systems
Scheduling
Uncertainty

Keywords

  • Distributed infrastructures
  • Interoperability
  • Meta-brokering
  • Workflows

ASJC Scopus subject areas

  • Engineering (miscellaneous)
  • Computer Networks and Communications
  • Computer Science Applications

Cite this

Karoczkai, K., Kertesz, A., & Kacsuk, P. (2015). Brokering Solution for Science Gateways Using Multiple Distributed Computing Infrastructures. In Proceedings - 7th International Workshop on Science Gateways, IWSG 2015 (pp. 28-33). [7217925] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IWSG.2015.12

Brokering Solution for Science Gateways Using Multiple Distributed Computing Infrastructures. / Karoczkai, Krisztian; Kertesz, Attila; Kacsuk, P.

Proceedings - 7th International Workshop on Science Gateways, IWSG 2015. Institute of Electrical and Electronics Engineers Inc., 2015. p. 28-33 7217925.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Karoczkai, K, Kertesz, A & Kacsuk, P 2015, Brokering Solution for Science Gateways Using Multiple Distributed Computing Infrastructures. in Proceedings - 7th International Workshop on Science Gateways, IWSG 2015., 7217925, Institute of Electrical and Electronics Engineers Inc., pp. 28-33, 7th International Workshop on Science Gateways, IWSG 2015, Budapest, Hungary, 6/3/15. https://doi.org/10.1109/IWSG.2015.12
Karoczkai K, Kertesz A, Kacsuk P. Brokering Solution for Science Gateways Using Multiple Distributed Computing Infrastructures. In Proceedings - 7th International Workshop on Science Gateways, IWSG 2015. Institute of Electrical and Electronics Engineers Inc. 2015. p. 28-33. 7217925 https://doi.org/10.1109/IWSG.2015.12
Karoczkai, Krisztian ; Kertesz, Attila ; Kacsuk, P. / Brokering Solution for Science Gateways Using Multiple Distributed Computing Infrastructures. Proceedings - 7th International Workshop on Science Gateways, IWSG 2015. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 28-33
@inproceedings{fb7b67f9610d42eaaffdb9c5a6ea21c2,
title = "Brokering Solution for Science Gateways Using Multiple Distributed Computing Infrastructures",
abstract = "The ever growing number of computation-intensive applications calls for the interoperation of distributed infrastructures such as Clouds, Grids and private clusters. The European SHIWA and ER-flow projects have been initiated to enable the combination of heterogeneous scientific workflows, and to execute them in a large-scale system consisting of multiple Distributed Computing Infrastructures including Grids and Clouds. One of the resource management challenges of these projects called parameter study job scheduling. A parameter study job of a workflow has a large number of input files to be consumed by independent job instances. In this paper we propose a meta-brokering solution for these workflows to be applied in science gateways. To cope with the high uncertainty and unpredictable load of the utilized infrastructures, we rely on resource priority services. These tools are capable of determining and dynamically updating priorities of the available infrastructures to be selected for job instances.",
keywords = "Distributed infrastructures, Interoperability, Meta-brokering, Workflows",
author = "Krisztian Karoczkai and Attila Kertesz and P. Kacsuk",
year = "2015",
month = "8",
day = "21",
doi = "10.1109/IWSG.2015.12",
language = "English",
isbn = "9781467374590",
pages = "28--33",
booktitle = "Proceedings - 7th International Workshop on Science Gateways, IWSG 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Brokering Solution for Science Gateways Using Multiple Distributed Computing Infrastructures

AU - Karoczkai, Krisztian

AU - Kertesz, Attila

AU - Kacsuk, P.

PY - 2015/8/21

Y1 - 2015/8/21

N2 - The ever growing number of computation-intensive applications calls for the interoperation of distributed infrastructures such as Clouds, Grids and private clusters. The European SHIWA and ER-flow projects have been initiated to enable the combination of heterogeneous scientific workflows, and to execute them in a large-scale system consisting of multiple Distributed Computing Infrastructures including Grids and Clouds. One of the resource management challenges of these projects called parameter study job scheduling. A parameter study job of a workflow has a large number of input files to be consumed by independent job instances. In this paper we propose a meta-brokering solution for these workflows to be applied in science gateways. To cope with the high uncertainty and unpredictable load of the utilized infrastructures, we rely on resource priority services. These tools are capable of determining and dynamically updating priorities of the available infrastructures to be selected for job instances.

AB - The ever growing number of computation-intensive applications calls for the interoperation of distributed infrastructures such as Clouds, Grids and private clusters. The European SHIWA and ER-flow projects have been initiated to enable the combination of heterogeneous scientific workflows, and to execute them in a large-scale system consisting of multiple Distributed Computing Infrastructures including Grids and Clouds. One of the resource management challenges of these projects called parameter study job scheduling. A parameter study job of a workflow has a large number of input files to be consumed by independent job instances. In this paper we propose a meta-brokering solution for these workflows to be applied in science gateways. To cope with the high uncertainty and unpredictable load of the utilized infrastructures, we rely on resource priority services. These tools are capable of determining and dynamically updating priorities of the available infrastructures to be selected for job instances.

KW - Distributed infrastructures

KW - Interoperability

KW - Meta-brokering

KW - Workflows

UR - http://www.scopus.com/inward/record.url?scp=84959897690&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84959897690&partnerID=8YFLogxK

U2 - 10.1109/IWSG.2015.12

DO - 10.1109/IWSG.2015.12

M3 - Conference contribution

SN - 9781467374590

SP - 28

EP - 33

BT - Proceedings - 7th International Workshop on Science Gateways, IWSG 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -