October 5-9, 2014

Abstract

O1.4 Enabling Scalable Data Analytics for LSST and Beyond through Qserv

Jacek Becla (SLAC)

The construction of the Large Synoptic Survey Telescope (LSST) is starting this year. Its large and rich data set will enable exploration of a wide range of astrophysical questions, ranging from discovering "killer" asteroids, to examining the nature of dark energy. The exploration will involve running a wide range of spatial and temporal analyses, including computationally intensive scientific investigations in multi-dimensional space over the entire data set. Over a million analyses, from trivial to very complex, are expected daily, every day, for decades. A specialized database system is developed to make that not only possible, but also fast and efficient. The talk will describe the driving requirements, assumptions made, and design trade offs that were considered in developing the baseline architecture for the LSST database. Details of its prototype implementation, Qserv, will be given, highlighting its features, status, and potential for usage outside LSST and even outside astronomy.

Mode of presentation: Invited Speaker (need to be confirmed by the SOC)

Applicable ADASS XXIV theme category: Big Data Challenges