Parallel Processing with Multipul GPUs - fftn

1 view (last 30 days)
Hello, I was wondering it is possible to utilize multipul GPUs to perform several ffts in a manner where each individual fft could be given to an individual GPU to be processed in parallel - or simultaneous calculation of two separate functions.
For instance, something like this.
clear all
Nx = 256;
Ny = 256;
Nz = 512;
A = rand(Nx,Ny,Nz)+1i*rand(Nx,Ny,Nz);
A = gpuArray(A);
B = rand(Nx,Ny,Nz)+1i*rand(Nx,Ny,Nz);
B = gpuArray(B);
% GPU 1 will process this
A = fftn(A);
% GPU 2 will process this while GPU 1 is still processing the above
B = fftn(B);
% program waits for GPUs to finish then proceeds
Is this possible in MATLAB?

Answers (1)

Matt J
Matt J on 15 May 2020
Edited: Matt J on 15 May 2020
You can use gpuDevice() to select different GPUs for different calculations. gpuArray commands run asynchronously without blocking Matlab execution on your host CPU. So, the tasks below will run essentially in parallel with GPU 1 having only a slight head start.
% GPU 1 will process this
A = gpuArray.rand(Nx,Ny,Nz)+1i*gpuArray.rand(Nx,Ny,Nz);
A = fftn(A);
% GPU 2 will process this
B = gpuArray.rand(Nx,Ny,Nz)+1i*gpuArray.rand(Nx,Ny,Nz);
B = fftn(B);
Walter Roberson
Walter Roberson on 16 May 2020
If you use gpuDevice() to select a different device than is currently selected for that process then the existing GPU will be reset, losing information.
When you use parfeval() with a pool size that is no larger than the number of GPUs that you have, then each one will run in its own process and will be granted a GPU of its own. If I recall correctly, gpu selection is automatic for this situation.

Sign in to comment.

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!