{ "cells": [ { "cell_type": "markdown", "id": "6834b397-d190-4214-a0d4-b91b202517eb", "metadata": {}, "source": [ "# Creating Visualizations of Intake-ESM Catalogs" ] }, { "cell_type": "markdown", "id": "88f5fad0-c002-4e58-858a-378af84fa961", "metadata": {}, "source": [ "A common initial task when working with a new dataset is figuring out what data is available. This is especially true when working with climate ensembles with several components and time-frequency output (ex. Community Earth System Model Large Ensemble, CESM-LE). Here, we will examine different methods of investigating this catalog" ] }, { "cell_type": "markdown", "id": "d244a6a4-dea7-4872-b2ae-ee9ce82fcdd4", "metadata": {}, "source": [ "## Imports\n", "\n", "Here, we will use [intake-esm](https://intake-esm.readthedocs.io/en/latest/) and [graphviz](https://graphviz.readthedocs.io/en/stable/manual.html), which can be installed using the following (including jupyterlab too!)\n", "\n", "```\n", "conda install -c conda-forge jupyterlab intake-esm graphviz\n", "```\n", "\n", "Once you install these packages, open jupyterlab!" ] }, { "cell_type": "code", "execution_count": 1, "id": "234fbcdc-68d3-48e1-ac7d-3719b87fd95d", "metadata": {}, "outputs": [], "source": [ "import intake\n", "from graphviz import Digraph" ] }, { "cell_type": "markdown", "id": "feef9176-0cee-4879-8a64-5eab032de164", "metadata": {}, "source": [ "## Read in intake-esm catalog" ] }, { "cell_type": "code", "execution_count": 2, "id": "909babf1-c9dc-4e43-b2cf-cd0f15e455ca", "metadata": {}, "outputs": [], "source": [ "col = intake.open_esm_datastore(\n", " 'https://raw.githubusercontent.com/NCAR/cesm-lens-aws/master/intake-catalogs/aws-cesm1-le.json'\n", ")" ] }, { "cell_type": "markdown", "id": "da14d8ea-06c0-4992-9a0a-e44c971779aa", "metadata": {}, "source": [ "Typically, the process is to read in the dataframe containing the metadata, but this can be tough to read/understand what data is all there" ] }, { "cell_type": "code", "execution_count": 3, "id": "cefeb1cb-79a8-4b31-bf8b-89de56818841", "metadata": {}, "outputs": [ { "data": { "text/html": [ "
\n", " | variable | \n", "long_name | \n", "component | \n", "experiment | \n", "frequency | \n", "vertical_levels | \n", "spatial_domain | \n", "units | \n", "start_time | \n", "end_time | \n", "path | \n", "
---|---|---|---|---|---|---|---|---|---|---|---|
0 | \n", "FLNS | \n", "net longwave flux at surface | \n", "atm | \n", "20C | \n", "daily | \n", "1.0 | \n", "global | \n", "W/m2 | \n", "1920-01-01 12:00:00 | \n", "2005-12-31 12:00:00 | \n", "s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNS.... | \n", "
1 | \n", "FLNSC | \n", "clearsky net longwave flux at surface | \n", "atm | \n", "20C | \n", "daily | \n", "1.0 | \n", "global | \n", "W/m2 | \n", "1920-01-01 12:00:00 | \n", "2005-12-31 12:00:00 | \n", "s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLNSC... | \n", "
2 | \n", "FLUT | \n", "upwelling longwave flux at top of model | \n", "atm | \n", "20C | \n", "daily | \n", "1.0 | \n", "global | \n", "W/m2 | \n", "1920-01-01 12:00:00 | \n", "2005-12-31 12:00:00 | \n", "s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FLUT.... | \n", "
3 | \n", "FSNS | \n", "net solar flux at surface | \n", "atm | \n", "20C | \n", "daily | \n", "1.0 | \n", "global | \n", "W/m2 | \n", "1920-01-01 12:00:00 | \n", "2005-12-31 12:00:00 | \n", "s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FSNS.... | \n", "
4 | \n", "FSNSC | \n", "clearsky net solar flux at surface | \n", "atm | \n", "20C | \n", "daily | \n", "1.0 | \n", "global | \n", "W/m2 | \n", "1920-01-01 12:00:00 | \n", "2005-12-31 12:00:00 | \n", "s3://ncar-cesm-lens/atm/daily/cesmLE-20C-FSNSC... | \n", "
... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "
430 | \n", "WVEL | \n", "vertical velocity | \n", "ocn | \n", "RCP85 | \n", "monthly | \n", "60.0 | \n", "global_ocean | \n", "centimeter/s | \n", "2006-01-16 12:00:00 | \n", "2100-12-16 12:00:00 | \n", "s3://ncar-cesm-lens/ocn/monthly/cesmLE-RCP85-W... | \n", "
431 | \n", "NaN | \n", "NaN | \n", "ocn | \n", "CTRL | \n", "static | \n", "NaN | \n", "global_ocean | \n", "NaN | \n", "NaN | \n", "NaN | \n", "s3://ncar-cesm-lens/ocn/static/grid.zarr | \n", "
432 | \n", "NaN | \n", "NaN | \n", "ocn | \n", "HIST | \n", "static | \n", "NaN | \n", "global_ocean | \n", "NaN | \n", "NaN | \n", "NaN | \n", "s3://ncar-cesm-lens/ocn/static/grid.zarr | \n", "
433 | \n", "NaN | \n", "NaN | \n", "ocn | \n", "RCP85 | \n", "static | \n", "NaN | \n", "global_ocean | \n", "NaN | \n", "NaN | \n", "NaN | \n", "s3://ncar-cesm-lens/ocn/static/grid.zarr | \n", "
434 | \n", "NaN | \n", "NaN | \n", "ocn | \n", "20C | \n", "static | \n", "NaN | \n", "global_ocean | \n", "NaN | \n", "NaN | \n", "NaN | \n", "s3://ncar-cesm-lens/ocn/static/grid.zarr | \n", "
435 rows × 11 columns
\n", "\n", " | variable | \n", "long_name | \n", "component | \n", "experiment | \n", "frequency | \n", "vertical_levels | \n", "spatial_domain | \n", "units | \n", "start_time | \n", "end_time | \n", "path | \n", "
---|---|---|---|---|---|---|---|---|---|---|---|
0 | \n", "FLNS | \n", "net longwave flux at surface | \n", "atm | \n", "20C | \n", "monthly | \n", "1.0 | \n", "global | \n", "W/m2 | \n", "1920-01-16 12:00:00 | \n", "2005-12-16 12:00:00 | \n", "s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-FLN... | \n", "
1 | \n", "FLNSC | \n", "clearsky net longwave flux at surface | \n", "atm | \n", "20C | \n", "monthly | \n", "1.0 | \n", "global | \n", "W/m2 | \n", "1920-01-16 12:00:00 | \n", "2005-12-16 12:00:00 | \n", "s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-FLN... | \n", "
2 | \n", "FLUT | \n", "upwelling longwave flux at top of model | \n", "atm | \n", "20C | \n", "monthly | \n", "1.0 | \n", "global | \n", "W/m2 | \n", "1920-01-16 12:00:00 | \n", "2005-12-16 12:00:00 | \n", "s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-FLU... | \n", "
3 | \n", "FSNS | \n", "net solar flux at surface | \n", "atm | \n", "20C | \n", "monthly | \n", "1.0 | \n", "global | \n", "W/m2 | \n", "1920-01-16 12:00:00 | \n", "2005-12-16 12:00:00 | \n", "s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-FSN... | \n", "
4 | \n", "FSNSC | \n", "clearsky net solar flux at surface | \n", "atm | \n", "20C | \n", "monthly | \n", "1.0 | \n", "global | \n", "W/m2 | \n", "1920-01-16 12:00:00 | \n", "2005-12-16 12:00:00 | \n", "s3://ncar-cesm-lens/atm/monthly/cesmLE-20C-FSN... | \n", "
... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "... | \n", "
60 | \n", "VNT | \n", "flux of heat in grid-y direction | \n", "ocn | \n", "20C | \n", "monthly | \n", "60.0 | \n", "global_ocean | \n", "degC/s | \n", "1920-01-16 12:00:00 | \n", "2005-12-16 12:00:00 | \n", "s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-VNT... | \n", "
61 | \n", "VVEL | \n", "velocity in grid-y direction | \n", "ocn | \n", "20C | \n", "monthly | \n", "60.0 | \n", "global_ocean | \n", "centimeter/s | \n", "1920-01-16 12:00:00 | \n", "2005-12-16 12:00:00 | \n", "s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-VVE... | \n", "
62 | \n", "WTS | \n", "salt flux across top face | \n", "ocn | \n", "20C | \n", "monthly | \n", "60.0 | \n", "global_ocean | \n", "gram/kilogram/s | \n", "1920-01-16 12:00:00 | \n", "2005-12-16 12:00:00 | \n", "s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-WTS... | \n", "
63 | \n", "WTT | \n", "heat flux across top face | \n", "ocn | \n", "20C | \n", "monthly | \n", "60.0 | \n", "global_ocean | \n", "degC/s | \n", "1920-01-16 12:00:00 | \n", "2005-12-16 12:00:00 | \n", "s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-WTT... | \n", "
64 | \n", "WVEL | \n", "vertical velocity | \n", "ocn | \n", "20C | \n", "monthly | \n", "60.0 | \n", "global_ocean | \n", "centimeter/s | \n", "1920-01-16 12:00:00 | \n", "2005-12-16 12:00:00 | \n", "s3://ncar-cesm-lens/ocn/monthly/cesmLE-20C-WVE... | \n", "
65 rows × 11 columns
\n", "