Losing access to file server upon entering parfor loop in code

I am processing data by loading files from an external drive, running my processing code, and then saving the processed data to a network drive/file server. In order to get through data faster, I am using a parfor loop to process multiple files at once and save the outputs (I'm using a custom save function to get around parfor issues with using the built-in matlab save function). I was able to run the code sucessfully without problems once and then on subsequent runs when the code gets to the parfor loop matlab loses access to the network drive/file server for saving the files (I did not change the code or parallel preference). I have added the main directory folder for saving the files to the network drive/server to the worker search path in the cluster profile manager as well as all custom functions called by the main code, however the issue still occurs. Occassionally it is fixed/runs appropriately after remapping the network drive/file server or restarting matlab and my computer.

Is there a potential fix for this issue?

[Ethan Blackwood]

Hi Angela,

We are running into a similar problem - did you ever find a fix for this?

Thanks,

Ethan

[Saurabh]

Hi @Ethan Blackwood,

Could you please confirm whether you're using a "local" or "processes" profile? What results do you get if you try using a "Threads" profile instead? If possible, please also provide your MATLAB version as well as your Windows version.

[Ethan Blackwood]

Hi, I think this is actually a duplicate of this newer question: https://www.mathworks.com/matlabcentral/answers/2092071-network-attached-storage-disconnects-on-launching-parpool

I commented there with more details - using the "threads" profile instead did work as a workaround.

[Angie]

Hi Ethan-

I fixed this by totally re-installing matlab on my machine and upgrading to the latest release which at the time was Matlab 2022a. I hope this helps.