Pangeo at the National Center for Atmospheric Research

Julia Kent

Computational and Information Systems Laboratory – NCAR

 

With the rise of Big Earth Data, geoscientists (and scientists in general) are facing the daunting challenge of performing analysis on datasets that are increasingly large and unwieldy.  The Pangeo platform, however, shows tremendous promise for scalable geoscientific data analysis.  Built on core technologies such as Dask and Xarray, the Pangeo framework provides the potential for interactive scientific analysis in a way that has never existed before.  Recognizing this promise, the National Center for Atmospheric Research (NCAR) in Boulder, Colorado, USA, has invested in the development of the Pangeo platform for analysis use on NCAR’s Wyoming Supercomputing Center (NWSC).  In this presentation, we provide an overview of the activities surrounding NCAR’s efforts with Pangeo, including benchmarking and scaling studies of the Pangeo platform at NWSC, considerations on future computing infrastructure at the NWSC in support of Pangeo, software contributions to the Pangeo ecosystem, and educational efforts to entrain scientists in Python, Pangeo, and similar approaches.

ABOUT AeRO

AeRO is the industry association focused on eResearch in Australasia. We play a critical coordination role for our members, who are actively transforming research via Information Technology. Organisations join AeRO to advance their own capabilities and services, to collaborate and to network with peers. AeRO believes researchers and the sector significantly benefit from greater communication, coordination and sharing among the increasingly different and evolving service providers.

Conference Managers

Please contact the team at Conference Design with any questions regarding the conference.
© 2017 Conference Design Pty Ltd