October 5-9, 2014

Abstract

P5.10 The challenges in metadata management: 20+ years of ESO data

Ignacio Vera (European Southern Observatory)

Adam Dobrzycki (European Southern Observatory), Alberto Micol (European Southern Observatory), Cristiano da Rocha (European Southern Observatory), Myha Vuong (European Southern Observatory)

The European Southern Observatory Science Archive Facility has been in operations for more than 20 years. It contains data produced by ESO telescopes as well as the metadata needed for characterizing and distributing those data. This metadata is used to build the different archive services provided by the Archive. Over these years, services have been added, modified or even decommissioned creating a cocktail of new, evolved and legacy data systems. The challenge for the Archive is to harmonize the differences of those data systems to provide the community with a homogeneous experience when using ESO data. In this paper, we present ESO experience in three particular challenging areas. First discussion is dedicated to the problem of metadata quality over the time, second we will argue how to integrate obsolete data models on the current services and finally we will present the challenges of ever growing databases. We will provide our experience dealing with those issues and the solutions adopted to mitigate there effects.

Mode of presentation: poster

Applicable ADASS XXIV theme category: Meta-data management