Stream: general

Topic: CMIP6 data location

view this post on Zulip Danica Lombardozzi (May 18 2020 at 20:06):

Is anyone else having trouble accessing the CMIP6 catalog? Did the location move? Code that I had been successfully using to pull data from the catalog no longer works

catalog = intake.open_esm_datastore("/glade/collections/cmip/catalog/intake-esm-datastore/catalogs/glade-cmip6.json")
catalog.df.head()

Error message: FileNotFoundError: [Errno 2] No such file or directory: 'glade-cmip6.csv.gz'

view this post on Zulip Anderson Banihirwe (May 18 2020 at 20:07):

Hi @Danica Lombardozzi

view this post on Zulip Anderson Banihirwe (May 18 2020 at 20:07):

I think I know what the issue is

view this post on Zulip Anderson Banihirwe (May 18 2020 at 20:07):

Do you know which version of intake-esm you are using?

view this post on Zulip Anderson Banihirwe (May 18 2020 at 20:08):

You can check it as follows:

$ conda list intake

or 

import intake_esm
print(intake_esm.__version__)

view this post on Zulip Danica Lombardozzi (May 18 2020 at 20:09):

From conda list intake:

# packages in environment at /ncar/usr/jupyterhub/envs/cmip6-201910a:
#
# Name                    Version                   Build  Channel
intake                    0.5.3                      py_0    conda-forge
intake-esm                2019.10.15               pypi_0    pypi
intake-stac               0.2.0                      py_0    conda-forge
intake-xarray             0.3.1                      py_0    conda-forge

Note: you may need to restart the kernel to use updated packages.

view this post on Zulip Anderson Banihirwe (May 18 2020 at 20:10):

Thanks.

intake-esm 2019.10.15 is the culprit... Since you don't own /ncar/usr/jupyterhub/envs/cmip6-201910a environment, let me see if I can update this environment to use the last version of intake-esm 2020.5.1

view this post on Zulip Anderson Banihirwe (May 18 2020 at 20:20):

It turns out that I don't have admin permissions for cmip6-201910a environment, but I do have admin permissions for cmip6-201910. So, I updated the cmip6-201910 environment instead of cmip6-201910a. 

$ conda list intake
# packages in environment at /ncar/usr/jupyterhub/envs/cmip6-201910:
#
# Name                    Version                   Build  Channel
intake                    0.5.5                      py_0    conda-forge
intake-esm                2020.5.1                   py_0    conda-forge

view this post on Zulip Anderson Banihirwe (May 18 2020 at 20:20):

You will need to refresh your browser's tab, and choose the cmip6-201910 kernel instead of cmip6-201910a

view this post on Zulip Danica Lombardozzi (May 18 2020 at 20:25):

Thanks! That seemed to do the trick! I'm not sure what the difference is between the CMIP6 2019.10 and the CMIP5 2019.10a is, so I was just using the one that popped up.

view this post on Zulip Anderson Banihirwe (May 18 2020 at 20:30):

I'm not sure what the difference is between the CMIP6 2019.10 and the CMIP6 2019.10a

Both environments were created last year during CMIP6 Hackathon. At beginning of the hackathon CMIP6 2019.10 was the only environment. At some point during the hackathon it was reported that some packages were missing from it. Instead of updating the CMIP6 2019.10 environment, a new environment CMIP6 2019.10a was created so as to not break other people's code.

view this post on Zulip Anderson Banihirwe (May 18 2020 at 20:32):

As of today, apart from package version differences, both environments contain almost same packages

Last updated: Jan 30 2022 at 12:01 UTC