Do not use batch and scripts if not needed.
"but then won't run in parallel, and seems to just ignore the parfor loop, or perform the same thing on each processor rather than splitting the tasks between them)"
This indicates the cluster default setting for parallel computing is to NOT autocreate a parpool when encountering a parfor statement for the first time. To check the setting on the cluster try this:
ps = parallel.Settings
ps.Pool.AutoCreate
= 0 %will not start parpool automatically
= 1 %will start pool automatically when encountering parfor
%You can set it to true:
if ~ps.Pool.AutoCreate
ps.Pool.AutoCreate = true; %But this isn't a good practice. See below
end
To ensure the Matlab starts parpool, use the parpool command explicitly. https://www.mathworks.com/help/distcomp/parpool.html
Pool = gcp('nocreate');
if isempty(Pool)
parpool();
end
A = test();
save('A.mat','A','-v7.3');
%test.m is this:
function A = test()
parfor i=1:10000
for j=1:10000
A(i,j) = rand;
end
end
I try to avoid using scripts in parallel computing, as it seems there are unique debugging issues.
