SCHEDULE: NOV 12-18, 2011

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

You can also create your personal schedule on the SC11 app (Boopsie) on your smartphone. Simply select a session you want to attend and "add" it to your plan. Continue in this manner until you have created your own personal schedule. All your events will appear under "My Event Planner" on your smartphone.

Parallel Index and Query for Large Scale Data Analysis

SESSION: Querying Large Scale Data

EVENT TYPE: Paper

TIME: 4:00PM - 4:30PM

AUTHOR(S):Jerry Chou, Kesheng Wu, Mark Howison, Mr. Prabhat, Oliver Ruebel, Brian Austin, E. Wes Bethel, Ji Qiang, Robert D. Ryne, Arie Shoshani

ROOM:TCC 305

ABSTRACT:
Modern scientific datasets present numerous data management and analysis challenges. State-of-the-art index and query technologies are critical for facilitating interactive exploration of large datasets, but numerous challenges remain in terms of designing a system for processing general scientific datasets. The system needs to be able to run on distributed multi-core platforms, efficiently utilize underlying I/O infrastructure, and scale to massive datasets. We present FastQuery, a novel software framework that address these challenges. FastQuery utilizes a state-of-the-art index and query technology (FastBit) and is designed to process massive datasets on modern supercomputing platforms. We apply the FastQuery framework to processing of a massive 50TB dataset generated by a large scale accelerator modeling code. We demonstrate the scalability of the tool to 11,520 cores. Motivated by the scientific need to search for interesting particles in this dataset, we use our framework to reduce search time from hours to tens of seconds.

Chair/Author Details:

Jerry Chou - Lawrence Berkeley National Laboratory

Kesheng Wu - Lawrence Berkeley National Laboratory

Mark Howison - Lawrence Berkeley National Laboratory

Mr. Prabhat - Lawrence Berkeley National Laboratory

Oliver Ruebel - Lawrence Berkeley National Laboratory

Brian Austin - Lawrence Berkeley National Laboratory

E. Wes Bethel - Lawrence Berkeley National Laboratory

Ji Qiang - Lawrence Berkeley National Laboratory

Robert D. Ryne - Lawrence Berkeley National Laboratory

Arie Shoshani - Lawrence Berkeley National Laboratory

  Click here to download .ics calendar file

  Click here to download .vcs calendar file

  Click here to add event to your Google Calendar

The full paper can be found in the ACM Digital Library