Array requirements for scientific applications and an implementation for microsoft SQL server

László Dobos, Alexander Szalay, José Blakeley, Tamás Budavári, I. Csabai, Dragan Tomic, Milos Milovanovic, Marko Tintor, Andrija Jovanovic

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

This paper outlines certain scenarios from the fields of astrophysics and fluid dynamics simulations which require high performance data warehouses that support array data type. A common feature of all these use cases is that subsetting and preprocessing the data on the server side (as far as possible inside the database server process) is necessary to avoid the client-server overhead and to minimize IO utilization. Analyzing and summarizing the requirements of the various fields help software engineers to come up with a comprehensive design of an array extension to relational database systems that covers a wide range of scientific applications. We also present a working implementation of an array data type for Microsoft SQL Server 2008 to support large-scale scientific applications. We introduce the design of the array type, results from a performance evaluation, and discuss the lessons learned from this implementation. The library can be downloaded from our website at http://voservices.net/sqlarray/.

Original languageEnglish
Title of host publicationACM International Conference Proceeding Series
Pages13-19
Number of pages7
DOIs
Publication statusPublished - 2011
EventEDBT/ICDT 2011 Workshop on Array Databases, AD'11 - Uppsala, Sweden
Duration: Mar 25 2011Mar 25 2011

Other

OtherEDBT/ICDT 2011 Workshop on Array Databases, AD'11
CountrySweden
CityUppsala
Period3/25/113/25/11

Fingerprint

Servers
Relational database systems
Astrophysics
Data warehouses
Fluid dynamics
Websites
Engineers
Computer simulation

Keywords

  • Abstract data types
  • Array types
  • Database server programming
  • Extensibility

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Dobos, L., Szalay, A., Blakeley, J., Budavári, T., Csabai, I., Tomic, D., ... Jovanovic, A. (2011). Array requirements for scientific applications and an implementation for microsoft SQL server. In ACM International Conference Proceeding Series (pp. 13-19) https://doi.org/10.1145/1966895.1966897

Array requirements for scientific applications and an implementation for microsoft SQL server. / Dobos, László; Szalay, Alexander; Blakeley, José; Budavári, Tamás; Csabai, I.; Tomic, Dragan; Milovanovic, Milos; Tintor, Marko; Jovanovic, Andrija.

ACM International Conference Proceeding Series. 2011. p. 13-19.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Dobos, L, Szalay, A, Blakeley, J, Budavári, T, Csabai, I, Tomic, D, Milovanovic, M, Tintor, M & Jovanovic, A 2011, Array requirements for scientific applications and an implementation for microsoft SQL server. in ACM International Conference Proceeding Series. pp. 13-19, EDBT/ICDT 2011 Workshop on Array Databases, AD'11, Uppsala, Sweden, 3/25/11. https://doi.org/10.1145/1966895.1966897
Dobos L, Szalay A, Blakeley J, Budavári T, Csabai I, Tomic D et al. Array requirements for scientific applications and an implementation for microsoft SQL server. In ACM International Conference Proceeding Series. 2011. p. 13-19 https://doi.org/10.1145/1966895.1966897
Dobos, László ; Szalay, Alexander ; Blakeley, José ; Budavári, Tamás ; Csabai, I. ; Tomic, Dragan ; Milovanovic, Milos ; Tintor, Marko ; Jovanovic, Andrija. / Array requirements for scientific applications and an implementation for microsoft SQL server. ACM International Conference Proceeding Series. 2011. pp. 13-19
@inproceedings{175a76ed72404b169ddb869ee3281182,
title = "Array requirements for scientific applications and an implementation for microsoft SQL server",
abstract = "This paper outlines certain scenarios from the fields of astrophysics and fluid dynamics simulations which require high performance data warehouses that support array data type. A common feature of all these use cases is that subsetting and preprocessing the data on the server side (as far as possible inside the database server process) is necessary to avoid the client-server overhead and to minimize IO utilization. Analyzing and summarizing the requirements of the various fields help software engineers to come up with a comprehensive design of an array extension to relational database systems that covers a wide range of scientific applications. We also present a working implementation of an array data type for Microsoft SQL Server 2008 to support large-scale scientific applications. We introduce the design of the array type, results from a performance evaluation, and discuss the lessons learned from this implementation. The library can be downloaded from our website at http://voservices.net/sqlarray/.",
keywords = "Abstract data types, Array types, Database server programming, Extensibility",
author = "L{\'a}szl{\'o} Dobos and Alexander Szalay and Jos{\'e} Blakeley and Tam{\'a}s Budav{\'a}ri and I. Csabai and Dragan Tomic and Milos Milovanovic and Marko Tintor and Andrija Jovanovic",
year = "2011",
doi = "10.1145/1966895.1966897",
language = "English",
isbn = "9781450306140",
pages = "13--19",
booktitle = "ACM International Conference Proceeding Series",

}

TY - GEN

T1 - Array requirements for scientific applications and an implementation for microsoft SQL server

AU - Dobos, László

AU - Szalay, Alexander

AU - Blakeley, José

AU - Budavári, Tamás

AU - Csabai, I.

AU - Tomic, Dragan

AU - Milovanovic, Milos

AU - Tintor, Marko

AU - Jovanovic, Andrija

PY - 2011

Y1 - 2011

N2 - This paper outlines certain scenarios from the fields of astrophysics and fluid dynamics simulations which require high performance data warehouses that support array data type. A common feature of all these use cases is that subsetting and preprocessing the data on the server side (as far as possible inside the database server process) is necessary to avoid the client-server overhead and to minimize IO utilization. Analyzing and summarizing the requirements of the various fields help software engineers to come up with a comprehensive design of an array extension to relational database systems that covers a wide range of scientific applications. We also present a working implementation of an array data type for Microsoft SQL Server 2008 to support large-scale scientific applications. We introduce the design of the array type, results from a performance evaluation, and discuss the lessons learned from this implementation. The library can be downloaded from our website at http://voservices.net/sqlarray/.

AB - This paper outlines certain scenarios from the fields of astrophysics and fluid dynamics simulations which require high performance data warehouses that support array data type. A common feature of all these use cases is that subsetting and preprocessing the data on the server side (as far as possible inside the database server process) is necessary to avoid the client-server overhead and to minimize IO utilization. Analyzing and summarizing the requirements of the various fields help software engineers to come up with a comprehensive design of an array extension to relational database systems that covers a wide range of scientific applications. We also present a working implementation of an array data type for Microsoft SQL Server 2008 to support large-scale scientific applications. We introduce the design of the array type, results from a performance evaluation, and discuss the lessons learned from this implementation. The library can be downloaded from our website at http://voservices.net/sqlarray/.

KW - Abstract data types

KW - Array types

KW - Database server programming

KW - Extensibility

UR - http://www.scopus.com/inward/record.url?scp=79955986173&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79955986173&partnerID=8YFLogxK

U2 - 10.1145/1966895.1966897

DO - 10.1145/1966895.1966897

M3 - Conference contribution

AN - SCOPUS:79955986173

SN - 9781450306140

SP - 13

EP - 19

BT - ACM International Conference Proceeding Series

ER -