How to dynamically allocate workers while job is running?

I am creating communicating jobs on a parcluster using createCommunicatingJob then submitting it as is normal. However, once the job has been submitted, and is running, it no longer allows me to change the numWorkersRange property of the job.

Basically, I was wondering if after allocating a limited number of workers to each job, I could then add additional workers to jobs still running as workers free up from other finished jobs, once there are no other jobs left in the queue (which leaves leaves the freed up cores unutilized).

Is this possible and if so how?

Answer 1

[Edric Ellis]

No, it is not possible to add workers to a communicating job after it has been submitted. If you can restructure your jobs to allow you to submit several communicating jobs (or even independent jobs), then you might expect to achieve better cluster utilisation.