Parallel computing on a cluster

11 views (last 30 days)
I have a script test.m that includes parfor-loops.
In MATLAB 2014a on my personal computer it runs the parallel job perfectly.
On a huge Linux computer cluster it runs test.m perfectly if I have started MATLAB 2014a graphically through X on the frontend.
However, when submitting test.m to the queue it discards the parallelness and runs everything as in for-loops -- on a single core on the given node.
What I write:
>> submat -q q12 test.m
q12 is the queue name.
Anyone with a clue??
Mads on 8 Jul 2014
Hi Kevin
I found out that submat was a wrapper. I didn't know that. So it using PBS for queueing.
This is what
submat -q q12 test.m
#PBS -q q12
#PBS -A mmatlab
#PBS -S /bin/bash -N test -j oe
rel=$(uname -r | tr '-' '.' | awk -F. '{print $3}')
if [ ${rel:-25} -le 18 -a $version == "R2014a" ]; then
echo "NB: Using Matlab version R2010b"
echo ===============================
export PATH=/com/matlab/$version/bin:$PATH
cd /home/msv/Projects/SAR/W6
echo "======= Started at `date` ======="
matlab -nojvm -nodisplay -r "test;exit"
echo "======= Finished at `date` ======="

Sign in to comment.

Accepted Answer

Shashank Prasanna
Shashank Prasanna on 7 Jul 2014
My guess is that when you queue it, it launches MATLAB without Java. Java is required to use PCT. That also explains why it works fine when you X11 forward MATLAB. See below:
"The client session of MATLAB must be running the Java® Virtual Machine (JVM™) to use Parallel Computing Toolbox software."
Johannes Kalliauer
Johannes Kalliauer on 3 Feb 2020
use -noFigureWindows -nosplash -nodesktop -nodisplay instead of -nojvm.

Sign in to comment.

More Answers (2)

Thomas Ibbotson
Thomas Ibbotson on 8 Jul 2014
We would need to see the code for 'submat', but my guess is that an independent job is being created rather than a communicating job. If you want to run a script with parfor loops on a cluster you need a communicating 'pool' job. For example you can submit one with 'batch' like this:
myCluster = parcluster('myClusterProfile');
job = batch(myCluster, 'test', 'Pool', myCluster.NumWorkers - 1);
The 'Pool' argument instructs batch to create a communicating 'pool' job using the given number of workers to create the pool. You need to have at least 1 spare worker to act as the 'client', which is why I subtracted 1 from the total number of workers that the cluster has.
For more information see: Run a batch parallel loop

Mads on 9 Jul 2014
Thanks for all the answers, they were all good, given the incomplete information I provided.
It turned out that turning on java in the job submission did the trick. So I removed the
from the terminal command.
Best wishes

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!