Evaluation challenges for a Federation of heterogeneous information providers: The case of NASA's Earth Science Information Partnerships

C. Plaisant, A. Komlodi, F. Lindsay

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

NASA's Earth Science Information Partnership Federation is an experiment funded to assess the ability of a group of widely heterogeneous earth science data or service providers to self organize and provide improved and affordable access to an expanding earth science user community. As it is self-organizing, the Federation is mandated to set in place an evaluation methodology and collect metrics reflecting the outcomes and benefits of the Federation. This paper describes the challenges of organizing such a federated partnership self-evaluation and discusses the issues encountered during the metrics definition phase of the early data collection. Our experience indicates that a large number of metrics will be needed to fully represent the activities and strengths of all partners, but because of the heterogeneity of the ESIPs the qualitative data (comments accompanying the metric data and success stories) becomes the most useful information. Other lessons learned included the absolute need for online browsing tools to accompany data collection tools. Finally, our experience confirms the effect of evaluation as an agent of change, the best example being the high level of collaboration among the ESIPs which can be in part attributed to the initial identification of collaboration as one of the important evaluation factors of the Federation.

Original languageEnglish
Title of host publicationProceedings - IEEE 9th International Workshops on Enabling Technologies
Subtitle of host publicationInfrastructure for Collaborative Enterprises, WET ICE 2000
PublisherIEEE Computer Society
Pages130-135
Number of pages6
ISBN (Electronic)0769507980
DOIs
Publication statusPublished - Jan 1 2000
EventIEEE 9th International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises, WET ICE 2000 - Gaithersburg, United States
Duration: Jun 14 2000Jun 16 2000

Publication series

NameProceedings of the Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises, WETICE
Volume2000-January
ISSN (Print)1524-4547

Other

OtherIEEE 9th International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises, WET ICE 2000
CountryUnited States
CityGaithersburg
Period6/14/006/16/00

    Fingerprint

Keywords

  • Collaboration
  • Computer aided software engineering
  • Customer satisfaction
  • Educational institutions
  • Geoscience
  • Laboratories
  • NASA
  • Organizing
  • Performance evaluation
  • US Government

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture

Cite this

Plaisant, C., Komlodi, A., & Lindsay, F. (2000). Evaluation challenges for a Federation of heterogeneous information providers: The case of NASA's Earth Science Information Partnerships. In Proceedings - IEEE 9th International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises, WET ICE 2000 (pp. 130-135). [883717] (Proceedings of the Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises, WETICE; Vol. 2000-January). IEEE Computer Society. https://doi.org/10.1109/ENABL.2000.883717