{ "cells": [ { "cell_type": "markdown", "id": "ce32e674-97e2-4c2e-b281-d1c3b53bd80b", "metadata": {}, "source": [ "# Community Earth System Model Large Ensemble (CESM LENS) Data Sets on AWS\n" ] }, { "cell_type": "markdown", "id": "737da5ef-d152-48c2-b815-ec6bf1676010", "metadata": {}, "source": [ "## Overview\n", "\n", "The [National Center for Atmospheric Research (NCAR)](https://ncar.ucar.edu/)\n", "Community Earth System Model Large Ensemble\n", "([CESM LENS](http://www.cesm.ucar.edu/projects/community-projects/LENS/))\n", "dataset includes a 40-member ensemble of climate simulations for the period\n", "1920-2100. All model runs were subject to the same radiative forcing scenario:\n", "historical up to 2005, and RCP8.5 thereafter. (RCP8.5 - Representative\n", "Concentration Pathway 8.5 - refers to the worst-case scenario considered in the\n", "[Fifth Assessment Report](https://www.ipcc.ch/report/ar5/wg1/) of the\n", "Intergovernmental Panel on Climate Change - IPCC). Each of the 40 runs begins\n", "from a slightly different initial atmospheric state (created by randomly\n", "perturbing temperatures at the level of round-off error). The data comprise both\n", "surface (2D) and volumetric (3D) variables in the atmosphere, ocean, land, and\n", "ice domains.\n", "\n", "The total LENS data volume is ~500 TB, and is traditionally accessible through\n", "the NCAR Climate Data Gateway\n", "([CDG](https://www.earthsystemgrid.org/dataset/ucar.cgd.ccsm4.CESM_CAM5_BGC_LE.html))\n", "for download or via web services. A subset (currently ~70 TB compressed)\n", "including the most useful variables is now\n", "[freely available on AWS S3](https://registry.opendata.aws/ncar-cesm-lens/)\n", "thanks to the\n", "[AWS Public Dataset Program](https://aws.amazon.com/opendata/public-datasets/).\n", "\n", "Slides from an informational briefing about this dataset are available\n", "[here](http://ncar-aws-www.s3-website-us-west-2.amazonaws.com/20200212.CESM_LENS.AWStelecon.pdf).\n" ] }, { "cell_type": "markdown", "id": "a24c253d-eb96-4d7d-b927-2398c98f4830", "metadata": {}, "source": [ "## Accessing CESM LENS on AWS\n", "\n", "- S3 bucket name: **ncar-cesm-lens**\n", "- Region: **us-west-2** region\n", "- Amazon resource name: **arn:aws:s3:::ncar-cesm-lens**\n", "- Bucket contents list: https://ncar-cesm-lens.s3.amazonaws.com/\n" ] }, { "cell_type": "markdown", "id": "95f953fd-e56f-416e-b0c1-6e4c17e3965c", "metadata": {}, "source": [ "## Data\n", "\n", "Zarr format: The LENS data on AWS are structured according to the\n", "[Zarr](https://zarr.readthedocs.io/en/stable/) storage format. There are\n", "independent Zarr stores for each component, frequency, experiment, and variable.\n", "The naming convention is:\n", "`{component}/{frequency}/cesmLE-{experiment}-{variable}.zarr` where:\n", "\n", "- `component` = atm (atmosphere), lnd (land), ocn (ocean), ice_nh or ice_sh\n", " (ice, northern and southern hemispheres)\n", "- `frequency` = monthly, daily, or hourly6-startYear-endYear (6-hourly data are\n", " available for distinct periods)\n", "- `experiment` = 20C (20th century runs), RCP85 (RCP 8.5 runs), HIST (historical\n", " run), CTRL (fully-coupled control run), CTRL_AMIP (atmosphere-only control\n", " run), CTRL_SLAB (slab-ocean control run)\n", "- `variable` = one of the variable names listed in the tables below\n", "\n", "### Data Catalog\n", "\n", "The table below shows the available Zarr stores, including the experiments,\n", "variables, time ranges, and 2D or 3D nature (3D means multiple atmosphere levels\n", "or ocean depths are present). See also\n", "[collection description](https://ncar-cesm-lens.s3-us-west-2.amazonaws.com/catalogs/aws-cesm1-le.json)\n", "and\n", "[catalog file](https://ncar-cesm-lens.s3-us-west-2.amazonaws.com/catalogs/aws-cesm1-le.csv)\n", "used by [Intake-esm](https://intake-esm.readthedocs.io/).\n" ] }, { "cell_type": "code", "execution_count": 3, "id": "741b30d3-496a-46a6-90bf-1a1449c42716", "metadata": { "tags": [ "remove-input" ] }, "outputs": [ { "data": { "text/html": [ "\n", "\n", "\n", "\n", "\n", "\n", "\n", "