Stream: dask

Topic: Dask error: Failed to Serialize

view this post on Zulip Stephen Yeager (Nov 18 2021 at 17:13):

I'm analyzing CESM2-LE data using intake-esm as in @Max Grover 's blog post (https://ncar.github.io/esds/posts/2021/intake-cesm2-le-glade-example/index.html). I'm passing two ~50GB dask arrays into the pop.eos() function to compute density. The resulting dask array (sigma2) looks reasonable: Screen-Shot-2021-11-18-at-10.08.10-AM.png

When I try to load(), I get this error which I've not encountered before:
Screen-Shot-2021-11-18-at-10.09.57-AM.png

I'm using dask version 2021.09.0. Any ideas on how to debug this would be greatly appreciated.

Last updated: Jan 30 2022 at 12:01 UTC