Computational and Information Systems Laboratory – NCAR
With the rise of Big Earth Data, geoscientists (and scientists in general) are facing the daunting challenge of performing analysis on datasets that are increasingly large and unwieldy. The Pangeo platform, however, shows tremendous promise for scalable geoscientific data analysis. Built on core technologies such as Dask and Xarray, the Pangeo framework provides the potential for interactive scientific analysis in a way that has never existed before. Recognizing this promise, the National Center for Atmospheric Research (NCAR) in Boulder, Colorado, USA, has invested in the development of the Pangeo platform for analysis use on NCAR’s Wyoming Supercomputing Center (NWSC). In this presentation, we provide an overview of the activities surrounding NCAR’s efforts with Pangeo, including benchmarking and scaling studies of the Pangeo platform at NWSC, considerations on future computing infrastructure at the NWSC in support of Pangeo, software contributions to the Pangeo ecosystem, and educational efforts to entrain scientists in Python, Pangeo, and similar approaches.