ESDS Progress Over the Past Few Months#
The first ESDS “meeting” took place in mid March 2021, with the kickoff event being the CGD town hall (here is the blog post detailing the topics at that meeting). Since that meeting, we have moved forward, holding a variety of Work in Progress talks, partnering with Xdev to offer Python Tutorials, and publish a series of blog posts aimed at documenting scientific workflows here at NCAR.
Most of our blog posts thus far have been focused on Python tutorials, workflow examples, or conference summaries. One new type of post we will be posting now are monthly summaries on ESDS activities. Since we have not posted one yet, we grouped up all of our activities since early March. Going forward, we will post on a monthly basis!
We outline some of the key points of progress over the past few months below! We also have update our vision, values, and near-term goals, accessible on our about us page. If you are interested in more of the details, be sure to check out the ESDS Vision Whitepaper.
Work in Progress Talks#
If you are interested in the links to these talks, or the discussion points, check out the agenda using this link!
Workflow Examples#
HiRes CESM MARBL repo (5 April 2021) - Mike Levy (CGD)
SMYLE Analysis (19 April 2021) - Steve Yeager (CGD)
Data Preprocessing and Workflows for Machine Learning (12 July 2021) - Maria Molina (CGD)
Machine Learning at NCAR (9 August 2021) - David John Gagne (CISL)
Oxygen Minimum Zone Analysis with Pangeo (23 August 2021) - Julius Busecke (Columbia LDEO)
Fast parallel access to existing netCDF file collections with Zarr (20 September 2021) - Lucas Sterzinger (CISL)
Python Package Overviews#
We include links to the respective packages below!
CAM Diagnostics (5 April 2021) - Brian Medeiros (CGD)
An Overview of GeoCAT (12 April 2021) - Orhan Eroglu (CISL)
An Overview of CF-Xarray (12 April 2021) - Deepak Cherian (CGD)
Intake-ESM (10 May 2021) - Anderson Banihirwe (CISL)
ecgtools (7 June 2021) - Max Grover (CGD)
GeoCAT Temporal Averaging (7 June 2021) - Heather Craker (CISL)
Funnel: a prototype supporting extensible diagnostics (26 July 2021) - Matt Long (CGD)
An Overview of MetPy (9 August 2021) - Ryan May and Drew Camron (Unidata)
Office Hours#
In addition to the educational content mentioned above, we have been offering weekly office hours, staffed by Xdev members.
We have had a total of 23 attendees so far, with the most common topics being Xarray, Matplotlib, and Dask.
Recently, we have a had a slight decline in attendance, so if you are interested in finding help with your Python-oriented workflow, be sure to stop by on Mondays at 3 PM MT!
Blog Posts#
Over the course of the last few months, we posted a total of 23 blog posts, not including posts related to Python tutorials.
Documentation and Citations#
Data Access#
Data Computation#
Data Visualization#
Creating Visualizations of Intake-ESM Catalogs (11 June 2021)
Plotting CESM Data on an Unstructured Grid using
GeoviewsandDatashader(13 August 2021)Examining Diagnotics Using
Intake-ESMandhvPlot(20 August 2021)Regridding High Resolution Observations to a High Resolution Model Grid (10 September 2021)
End to End Workflow#
Indexing unstructured grids with the Power of Xoak (23 April 2021)
Using Intake-ESM to Analyze Data from CESM2-LE (06 August 2021)
Comparing Atmospheric Model Output with Observations Using
Intake-ESM(27 August 2021)Reimagining Diagnostics Through the Use of the Jupyter Ecosystem (24 September 2021)
Conference Summaries, Discussions, and Resources#
Python Tutorials#
As mentioned previously, the Python Tutorial series has been on ongoing training resource, led by Julia Kent and fellow Xdevers. Below is a list of the tutorial blog posts and associated videos.