Matt Long (Feb 14 2022 at 18:04): Matt Long (Feb 14 2022 at 18:04):I am using intake to point to a data source:
fgapo_CarbonScope_apo99X_v2021:
driver: netcdf
description: "Using an atmospheric inversion technique similar to the Jena CO2 inversion, sea-air oxygen exchanges have been estimated from atmospheric O2/N2 measurements (Rödenbeck et al., 2008). In order to eliminate the influence of land processes on atmospheric oxygen abundance, the tracer Atmospheric Potential Oxygen (APO) has been used (Stephens et al., 1998). DOI: 10.17871/CarboScope-apo99X_v2021"
args:
urlpath: simplecache::https://www.bgc-jena.mpg.de/CarboScope/apo/INVERSION/OUTPUT/apo99X_v2021_daily.nc
xarray_kwargs:
decode_times: false
chunks: {}
storage_options:
simplecache:
same_names: true
cache_storage: "{{ env(INTAKE_LOCAL_CACHE_DIR) }}"
This is a 1.6 GB file and I am getting an error: FSTimeoutError. I presume this means the file transfer is timing out (the transfer does start, but does not complete).
Anybody know how to set an larger upper limit on acceptable time to avoid this error?
Anderson Banihirwe (Feb 14 2022 at 18:51):This looks a lot like the issue you ran into a while ago... Can you try the suggested solution, and see if it addresses the issue?
Matt Long (Feb 14 2022 at 18:52):Ah, right! I forgot.
I tried that at the time and it couldn't get it working. Thanks again, anyway, however!
Anderson Banihirwe (Feb 14 2022 at 18:54):I tried that at the time and it couldn't get it working.
do you mean encoding the timeout in the YAML catalog or creating the timeout object and passing it to intake?
Last updated: May 16 2025 at 17:14 UTC