ESDS Update November 2021#
November was an active month! There were a couple of ESDS Forum talks, a variety of answered Python questions during office hours, and a Python tutorial!
Check out the following ESDS update for the month of November 2021.
Xdev Updates#
Xdev has continued to make progress on the Funnel project; this extends the data catalog with “analysis recipes”, providing an effective strategy for modularization and extensibility of workflows.
The esds-funnel provides the caching framework, while the esm-collections repository is where we prototype the full workflows with the catalogs and analysis recipes.
We have continued to push forward on the xwrf project, which aims to help bring the Weather Research and Forecasting (WRF) model into the Pangeo ecosystem. Be sure to follow the xwrf repository for updates.
ESDS Forum#
Python Package Overviews#
Introducing Project Raijin Community Geoscience Analysis Tools for Unstructured Mesh Data (29 November 2021) - Orhan Eroglu (CISL)
General Discussion#
An Open Discussion Around Earth System Prediction at NCAR (01 November 2021) - Matt Long (CGD)
ESDS Blog Posts#
Data Computation#
End to End Workflow#
Office Hour Questions#
During the month of October 2021, our team answered a total of 10 questions at our weekly Xdev Office Hours.
Below is a summary of the most common questions brought up during office hours!
Matplotlib Questions#
How do you make boxplots with two datasets of varying sizes?
Solution: Called
plt.boxplot()twice, usewidth = 0.1for both calls andpositions=[1.5,2.5,3.5,4.5]for the second call.
Dask Questions#
How do you run Dask on Casper?
Solution: Encouraged use of
ncar-jobqueuepackage, using the compute nodes on Casper.
Xarray Questions#
How do you load multiple files into xarray and plot the output?
Solution: Had to call .load() and .some_variable in order to access the shape, pointed to xarray and dask section on ESDS FAQ page.
How do you drop specific dates from a dataset?
Solution: Used cftime_range() along with sel_drop()
Conda Questions#
How do you uninstall and reinstall a conda environment?
Solution: Encouraged to check out the anaconda docs about deleting environment and reinstall environment.
How do you make sure your conda environment is activated upon opening terminal?
Solution: Added a new section walking through this process called “Activating Your Base Environment Upon Opening a Terminal”