Stream: dask

Topic: Leftover dask workers removal?

Else Schlerman (Apr 03 2022 at 13:49):

Hi all -- now that I am successfully getting workers, I'm wondering what to do with workers that remain after I am finished using them. Currently my directory is getting pretty filled up with workers from previous days. Thanks! Screen-Shot-2022-04-03-at-9.39.07-AM.png

Anderson Banihirwe (Apr 03 2022 at 23:06):

@Else Schlerman, you can temporary set the log-directoryto some location in your scratch space via

import dask
dask.config.set({'jobqueue.pbs.local-directory': '/glade/scratch/eschlerm'})

If you want to set this permanently, you will need to update the jobqueue.yaml file located in ~/.config/dask/jobqueue.yaml by uncommenting these lines

#   pbs:
#     local-directory: null # remember to set this to `/glade/scratch/eschlerm`

Else Schlerman (Apr 04 2022 at 14:53):

Thanks @Anderson Banihirwe for the suggestions. I've tried putting the additional line dask.config.set... in my script and I also added what you suggested to jobqueue.yaml, however I'm still having workers appear in the directory I'm working in.

I don't know if this is normal, but my jobqueue.yaml file did not have

#   pbs:
#     local-directory: null

but rather had this:

#   pbs:
#     name: dask-worker

Rather than uncommenting that, I just added:

  pbs:
   local-directory: '/glade/scratch/eschlerm'

but I'm not sure if that was the right thing to do.

Else Schlerman (Apr 04 2022 at 14:54):

Also is it okay to delete workers from your file that you're no longer using?

Last updated: May 16 2025 at 17:14 UTC