SC is the International Conference for
High Performance Computing, Networking,
Storage and Analysis

SCHEDULE: NOV 12-18, 2011

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

You can also create your personal schedule on the SC11 app (Boopsie) on your smartphone. Simply select a session you want to attend and "add" it to your plan. Continue in this manner until you have created your own personal schedule. All your events will appear under "My Event Planner" on your smartphone.

Qserv: A Distributed Shared-Nothing Database for the LSST Catalog

SESSION: State of the Practice - Cloud/Grids

EVENT TYPE: State of the Practice

TIME: 11:30AM - 12:00PM


AUTHOR(S):Daniel L. Wang, Serge Monkewitz, Kian-Tat Lim, Jacek Becla


The LSST project will provide public access to a database catalog that, in its final year, is estimated to include 26 billion stars and galaxies in dozens of trillion detections in multiple petabytes. Because we are not aware of an existing open-source database implementation that has been demonstrated to efficiently satisfy astronomers' spatial self-joining and cross-matching queries at this scale, we have implemented Qserv, a distributed shared-nothing SQL database query system. To speed development, Qserv relies on two successful open-source software packages: the MySQL RDBMS and the Xrootd distributed file system. We describe Qserv's design, architecture, and ability to scale to LSST's data requirements. We illustrate its potential with test results on a 150-node using 55 billion rows and 30 terabytes. These results demonstrate the soundness of Qserv's approach and the scale it achieves on today's hardware.

Chair/Author Details:

David Martin (Chair) - Argonne National Lab

Daniel L. Wang - SLAC National Accelerator Laboratory

Serge Monkewitz - California Institute of Technology

Kian-Tat Lim - SLAC National Accelerator Laboratory

Jacek Becla - SLAC National Accelerator Laboratory

Add to iCal  Click here to download .ics calendar file

Add to Outlook  Click here to download .vcs calendar file

Add to Google Calendarss  Click here to add event to your Google Calendar

The full paper can be found in the ACM Digital Library

   Sponsors    ACM    IEEE