Stream: general

Topic: intake catalog for CESM2-LE


view this post on Zulip Stephen Yeager (Feb 16 2024 at 17:00):

I have old notebooks that use intake to ingest CESM2-LE data, pointing to this json file that no longer exists: /glade/work/mgrover/intake-esm-catalogs/glade-cesm2-le.json. Can anyone tell me where the CESM2-LE catalog file now resides?

view this post on Zulip Holly Olivarez (Feb 16 2024 at 17:02):

This is what I've got: /glade/campaign/cgd/cesm/CESM2-LE/

view this post on Zulip Stephen Yeager (Feb 16 2024 at 17:10):

Answered my own question. It's here: /glade/collections/cmip/catalog/intake-esm-datastore/catalogs/glade-cesm2-le.json

view this post on Zulip Stephen Yeager (Feb 16 2024 at 17:59):

However, I'm getting an error when trying to use intake v2.0.1 to read in this catalog.

catalog_file = "/glade/collections/cmip/catalog/intake-esm-datastore/catalogs/glade-cesm2-le.json"
col = intake.open_esm_datastore(catalog_file)

returns this error:

super(type, obj): obj must be an instance or subtype of type

This is how I have opened catalogs in the past so I'm not sure what changed.

view this post on Zulip Michael Levy (Feb 16 2024 at 19:32):

@Stephen Yeager and I got to the point where he was getting a different error

pydantic_core._pydantic_core.ValidationError: 1 validation error for ESMCatalogModel
aggregation_control.aggregations.0.options
  Input should be a valid dictionary [type=dict_type, input_value=None, input_type=NoneType]
    For further information visit https://errors.pydantic.dev/2.0.1/v/dict_type

I opened an issue ticket (in intake-esm-datastore because this seems like a problem with the catalog rather than intake or intake-esm); @Anderson Banihirwe @Max Grover do either of you monitor that repository (or Zulip?)

view this post on Zulip Max Grover (Feb 26 2024 at 19:36):

I do about once per week @Michael Levy (Zulip, not that repo). Thanks for opening an issue!

view this post on Zulip Maurício Rebouças Rocha (Feb 27 2024 at 18:28):

Interesting, I use intake and haven't had issues. catalog = intake.open_esm_datastore(
'/glade/collections/cmip/catalog/intake-esm-datastore/catalogs/glade-cesm2-le.json'
)


Last updated: May 16 2025 at 17:14 UTC