Brian Bonnlander (Sep 09 2021 at 15:31): Brian Bonnlander (Sep 09 2021 at 15:31):I'm trying to use Casper to load/save slices of data from Zarr stores. Essentially the workflow is entirely data movement with very little computation. Does anyone know of tricks to optimize data bandwidth on Casper for this kind of workflow?
Haiying Xu (Sep 09 2021 at 15:49):You shall set zarr chunksize around 384MB or 768MB, and run your job at late night when the network has less traffics.
Last updated: May 16 2025 at 17:14 UTC