When viewing the Technical Program schedule, on the far righthand side
is a column labeled "PLANNER." Use this planner to build your own
schedule. Once you select an event and want to add it to your personal
schedule, just click on the calendar icon of your choice (outlook
calendar, ical calendar or google calendar) and that event will be
stored there. As you select events in this manner, you will have your
own schedule to guide you through the week.
You can also create your personal schedule on the SC11 app (Boopsie) on your smartphone. Simply select a session you want to attend and "add" it to your plan. Continue in this manner until you have created your own personal schedule. All your events will appear under "My Event Planner" on your smartphone.
Parallel Index and Query for Large Scale Data Analysis
SESSION: Querying Large Scale Data
EVENT TYPE: Paper
TIME: 4:00PM - 4:30PM
AUTHOR(S):Jerry Chou, Kesheng Wu, Mark Howison, Mr. Prabhat, Oliver Ruebel, Brian Austin, E. Wes Bethel, Ji Qiang, Robert D. Ryne, Arie Shoshani
ABSTRACT: Modern scientific datasets present numerous data management and analysis challenges. State-of-the-art index and query technologies are critical for facilitating interactive exploration of large datasets, but numerous challenges remain in terms of designing a system for processing general scientific datasets. The system needs to be able to run on distributed multi-core platforms, efficiently utilize underlying I/O infrastructure, and scale to massive datasets.
We present FastQuery, a novel software framework that address these challenges. FastQuery utilizes a state-of-the-art index and query technology (FastBit) and is designed to process massive datasets on modern supercomputing platforms. We apply the FastQuery framework to processing of a massive 50TB dataset generated by a large scale accelerator modeling code. We demonstrate the scalability of the tool to 11,520 cores. Motivated by the scientific need to search for interesting particles in this dataset, we use our framework to reduce search time from hours to tens of seconds.
Jerry Chou - Lawrence Berkeley National Laboratory
Kesheng Wu - Lawrence Berkeley National Laboratory
Mark Howison - Lawrence Berkeley National Laboratory
Mr. Prabhat - Lawrence Berkeley National Laboratory
Oliver Ruebel - Lawrence Berkeley National Laboratory
Brian Austin - Lawrence Berkeley National Laboratory
E. Wes Bethel - Lawrence Berkeley National Laboratory
Ji Qiang - Lawrence Berkeley National Laboratory
Robert D. Ryne - Lawrence Berkeley National Laboratory
Arie Shoshani - Lawrence Berkeley National Laboratory