Remote storage management in science gateways via data bridging

Ákos Hajnal, István Márton, Zoltán Farkas, P. Kacsuk

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

State-of-the-art science gateways can be connected to several distributed computing infrastructures (DCIs) and are able to run jobs and workflows simultaneously in all those DCIs. Flexibility of accessing diverse data storages from these workflows and assisting end users to manage these storages are however the missing features in current gateway implementations, in which these problems often prove to be a barrier of exploiting the power of distributed computing by user communities having no or little IT competence. This paper addresses these issues by integrating a data bridging service called Data Avenue into WS-PGRADE/gUSE portal framework. Data Avenue offers tools for the end users to easily manage their data residing on various storage resources, and also, jobs become capable of accessing different storages regardless of the particular distributed computing infrastructure where the job is currently being run.

Original languageEnglish
Pages (from-to)4398-4411
Number of pages14
JournalConcurrency Computation Practice and Experience
Volume27
Issue number16
DOIs
Publication statusPublished - Nov 1 2015

Fingerprint

Storage management
Gateway
Distributed computer systems
Distributed Computing
Infrastructure
Work Flow
Gateways (computer networks)
Data Storage
Flexibility
Data storage equipment
Resources

Keywords

  • data handling
  • data storage systems
  • data transfer
  • grid computing

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Software
  • Computational Theory and Mathematics
  • Theoretical Computer Science

Cite this

Remote storage management in science gateways via data bridging. / Hajnal, Ákos; Márton, István; Farkas, Zoltán; Kacsuk, P.

In: Concurrency Computation Practice and Experience, Vol. 27, No. 16, 01.11.2015, p. 4398-4411.

Research output: Contribution to journalArticle

Hajnal, Ákos ; Márton, István ; Farkas, Zoltán ; Kacsuk, P. / Remote storage management in science gateways via data bridging. In: Concurrency Computation Practice and Experience. 2015 ; Vol. 27, No. 16. pp. 4398-4411.
@article{bab02f03d1424ba78d66df7f13f3a3f9,
title = "Remote storage management in science gateways via data bridging",
abstract = "State-of-the-art science gateways can be connected to several distributed computing infrastructures (DCIs) and are able to run jobs and workflows simultaneously in all those DCIs. Flexibility of accessing diverse data storages from these workflows and assisting end users to manage these storages are however the missing features in current gateway implementations, in which these problems often prove to be a barrier of exploiting the power of distributed computing by user communities having no or little IT competence. This paper addresses these issues by integrating a data bridging service called Data Avenue into WS-PGRADE/gUSE portal framework. Data Avenue offers tools for the end users to easily manage their data residing on various storage resources, and also, jobs become capable of accessing different storages regardless of the particular distributed computing infrastructure where the job is currently being run.",
keywords = "data handling, data storage systems, data transfer, grid computing",
author = "{\'A}kos Hajnal and Istv{\'a}n M{\'a}rton and Zolt{\'a}n Farkas and P. Kacsuk",
year = "2015",
month = "11",
day = "1",
doi = "10.1002/cpe.3520",
language = "English",
volume = "27",
pages = "4398--4411",
journal = "Concurrency Computation Practice and Experience",
issn = "1532-0626",
publisher = "John Wiley and Sons Ltd",
number = "16",

}

TY - JOUR

T1 - Remote storage management in science gateways via data bridging

AU - Hajnal, Ákos

AU - Márton, István

AU - Farkas, Zoltán

AU - Kacsuk, P.

PY - 2015/11/1

Y1 - 2015/11/1

N2 - State-of-the-art science gateways can be connected to several distributed computing infrastructures (DCIs) and are able to run jobs and workflows simultaneously in all those DCIs. Flexibility of accessing diverse data storages from these workflows and assisting end users to manage these storages are however the missing features in current gateway implementations, in which these problems often prove to be a barrier of exploiting the power of distributed computing by user communities having no or little IT competence. This paper addresses these issues by integrating a data bridging service called Data Avenue into WS-PGRADE/gUSE portal framework. Data Avenue offers tools for the end users to easily manage their data residing on various storage resources, and also, jobs become capable of accessing different storages regardless of the particular distributed computing infrastructure where the job is currently being run.

AB - State-of-the-art science gateways can be connected to several distributed computing infrastructures (DCIs) and are able to run jobs and workflows simultaneously in all those DCIs. Flexibility of accessing diverse data storages from these workflows and assisting end users to manage these storages are however the missing features in current gateway implementations, in which these problems often prove to be a barrier of exploiting the power of distributed computing by user communities having no or little IT competence. This paper addresses these issues by integrating a data bridging service called Data Avenue into WS-PGRADE/gUSE portal framework. Data Avenue offers tools for the end users to easily manage their data residing on various storage resources, and also, jobs become capable of accessing different storages regardless of the particular distributed computing infrastructure where the job is currently being run.

KW - data handling

KW - data storage systems

KW - data transfer

KW - grid computing

UR - http://www.scopus.com/inward/record.url?scp=84944876717&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84944876717&partnerID=8YFLogxK

U2 - 10.1002/cpe.3520

DO - 10.1002/cpe.3520

M3 - Article

VL - 27

SP - 4398

EP - 4411

JO - Concurrency Computation Practice and Experience

JF - Concurrency Computation Practice and Experience

SN - 1532-0626

IS - 16

ER -