call python function in parfor loop

I have managed to call python function in matlab. However, I would like to know if it is possible to call python function within a parfor loop? If it is not, is there a method to perform parallel computation in my python function?

[Raymond Norris]

Can't see a reason why you couldn't call python from within parfor. I would suggest trying it and reporting back any issue you run into.

[Kevin Zhu]

Here is what I get from the command window:

Warning: Unable to load Python object. Saving (serializing) Python objects into a MAT-file is not supported.
> In parallel.internal.pool.deserialize (line 33)
In parallel.internal.pool.deserializeFunction (line 17)
In remoteParallelFunction (line 29)

[Ive J]

Can you share the snippet as well?

[Kevin Zhu]

what do you mean snippet? I have pasted all the warning message from command window here.

[Takayuki Nagata]

Hi.

I am facing the same problem.

My environment is MATLAB R2023a on Windows 10 with Python 3.8.

I would appreciate it if you could give me some guidance.

My MATLAB script is as follows:

clear all
np = py.importlib.import_module('numpy');

nr=10;
alpha=0.2;

q_sbf = np.loadtxt("xxx.txt");
[v_ic_org,~] = pyrunfile('F_extract_initial_state.py',["v_ic_org","u"],q_sbf=q_sbf);

Z=zeros(size(double(v_ic_org)))';
parfor r=1:nr
    v_ic = alpha*randn(size(double(v_ic_org)));
    tmp = pyrunfile('F_sim_linear_fwd.py',"sol_lin",q_sbf=q_sbf,v_ic=v_ic);
    z = double(tmp);
    Z(:,r) = z(:,end);
end

Thank you!

Answer 1

[Al Danial]

An alternative to parfor is to run the loop in parallel with dask. The function running in parallel, sol_lin(), in your case, can either be sent to the cores on your own computer, or to multiple computers on your network.

https://al.danial.org/posts/parallel_matlab_with_dask/ has examples.