Community Earth System Model Large Ensemble (CESM LENS) Data Sets on AWS

Overview

The National Center for Atmospheric Research (NCAR) Community Earth System Model Large Ensemble (CESM LENS) dataset includes a 40-member ensemble of climate simulations for the period 1920-2100. All model runs were subject to the same radiative forcing scenario: historical up to 2005, and RCP8.5 thereafter. (RCP8.5 - Representative Concentration Pathway 8.5 - refers to the worst-case scenario considered in the Fifth Assessment Report of the Intergovernmental Panel on Climate Change - IPCC). Each of the 40 runs begins from a slightly different initial atmospheric state (created by randomly perturbing temperatures at the level of round-off error). The data comprise both surface (2D) and volumetric (3D) variables in the atmosphere, ocean, land, and ice domains.

The total LENS data volume is ~500 TB, and is traditionally accessible through the NCAR Climate Data Gateway (CDG) for download or via web services. A subset (currently ~70 TB compressed) including the most useful variables is now freely available on AWS S3 thanks to the AWS Public Dataset Program.

Slides from an informational briefing about this dataset are available here.

Accessing CESM LENS on AWS

Data

Zarr format: The LENS data on AWS are structured according to the Zarr storage format. There are independent Zarr stores for each component, frequency, experiment, and variable. The naming convention is: {component}/{frequency}/cesmLE-{experiment}-{variable}.zarr where:

  • component = atm (atmosphere), lnd (land), ocn (ocean), ice_nh or ice_sh (ice, northern and southern hemispheres)

  • frequency = monthly, daily, or hourly6-startYear-endYear (6-hourly data are available for distinct periods)

  • experiment = 20C (20th century runs), RCP85 (RCP 8.5 runs), HIST (historical run), CTRL (fully-coupled control run), CTRL_AMIP (atmosphere-only control run), CTRL_SLAB (slab-ocean control run)

  • variable = one of the variable names listed in the tables below

Data Catalog

The table below shows the available Zarr stores, including the experiments, variables, time ranges, and 2D or 3D nature (3D means multiple atmosphere levels or ocean depths are present). See also collection description and catalog file used by Intake-esm.

Notebook Examples

A Jupyter Notebook illustrating how to read the LENS data on AWS, and reproducing Figures 2 and 4 from Kay et al. (2015), has been developed. This Notebook and other resources on GitHub will be gradually improved and augmented.

Data Citation

Data are freely available and reusable under the terms of the CC-BY-4.0 license. See Terms of Use. If you use these data, we request that you provide attribution in any derived products. The original, complete LENS dataset and the AWS-hosted subset have different DOIs (Digital Object Identifiers) to reflect their differing scope and format, so please cite whichever version of the dataset used, as well as the Kay et al. (2015) paper:

  • AWS-hosted subset: doi:10.26024/wt24-5j82 de La Beaujardière, J., Banihirwe, A., Shih, C.-F., Paul, K., and Hamman, J., (2019), “NCAR CESM LENS Cloud-Optimized Subset,” UCAR/NCAR Computational and Informations Systems Lab

  • Original dataset: doi:10.5065/d6j101d1 Kay, J. and Deser, C. (2016). “The Community Earth System Model (CESM) Large Ensemble Project” UCAR/NCAR Climate Data Gateway.

  • Kay et al. (2015) paper: doi:10.5065/d6j101d1 Kay, J. E., Deser, C., Phillips, A., Mai, A., Hannay, C., Strand, G., Arblaster, J., Bates, S., Danabasoglu, G., Edwards, J., Holland, M. Kushner, P., Lamarque, J.-F., Lawrence, D., Lindsay, K., Middleton, A., Munoz, E., Neale, R., Oleson, K., Polvani, L., and M. Vertenstein (2015), “The Community Earth System Model (CESM) Large Ensemble Project: A Community Resource for Studying Climate Change in the Presence of Internal Climate Variability,” Bulletin of the American Meteorological Society, 96, 1333-1349

Contact

If you have questions or want to submit a data request, please reach out to us on our GitHub Discussions page or via email: rdahelp at ucar dot edu.