Community Profile

photo

Edric Ellis


MathWorks

714 total contributions since 2011

Developer at MathWorks, working on Parallel Computing Toolbox. Professional Interests: parallel computing, distributed arrays, gpu

Contact

Edric Ellis's Badges

  • 36 Month Streak
  • Thankful Level 1
  • Guiding Light
  • Revival Level 2
  • Knowledgeable Level 4
  • First Answer
  • Solver

View details...

Contributions in
View by

Answered
Reported Task State not accurate when running on MS HPC grid
Unfortunately, getting accurate state information back from the cluster can be tricky. This is because there are multiple source...

17 hours ago | 0

Answered
big data 2d matrix percentile calculation using tall
That particular error is an internal error basically because your tall array expression is simply too large - contains too many ...

8 days ago | 1

Answered
Share two variables between workers
I think this should work... I tried a slight modification of your code to make it executable: function repro D = parallel.pool...

13 days ago | 0

| accepted

Answered
CUDA 10.1 not recognized (searching for CUDA 10.0 instead)
Unfortunately, the situation here is admittedly somewhat confusing. There are two relevant pieces of software going on here, bot...

14 days ago | 0

| accepted

Answered
Save fitcsvms running in parfor loop
Your outputs are not available after the parfor loop because the parfor variable classification considers them to be loop tempor...

15 days ago | 0

Answered
Local Parallel Cluster Validation failed at SPMD job test
This might well be a ulimit problem. See here for details on how to fix it: https://uk.mathworks.com/matlabcentral/answers/46548...

15 days ago | 0

Answered
How to call protected functions in parfor?
EDIT: Changed my version to inherit protected method from parent class Hm, I can't reproduce the problem - I tried in R2016b an...

23 days ago | 1

Answered
Parallel.pool.consant slowing down code by a factor of 3, how to distribute many arrays to different variables
parallel.pool.Constant is useful in essentially three different ways: It can offer a performance gain by avoiding repeated tran...

26 days ago | 0

| accepted

Answered
Matlab cannot access my gpu Cuda Device
nvcc is part of the CUDA toolkit, and in fact you do not need any version of that to successfully use gpuArray in MATLAB. It is ...

26 days ago | 0

| accepted

Answered
Parallel computing with shared variables, problem with struct
I must admit I didn't look at your code in great detail - but I did get the distinct impression that there's a lot going on ther...

1 month ago | 1

| accepted

Answered
Parallel processing for asynchronous plotting
One of the restrictions of parfor is that all variable access in the body of the loop must be "transparent". This is to ensure t...

1 month ago | 0

| accepted

Answered
Must have valid initData to build channel
I expect this is a misleading error as a consequence of running out of memory on the workers. You're duplicating Psmat and attem...

2 months ago | 0

Answered
Error using parfor on for loop
Did you try the suggestion from the error message, i.e. parfor j = 1:mf m{j} = feval(fnP, mova, j); end That should work...

2 months ago | 0

| accepted

Answered
Parfor variable cannot be classified
You've tripped over one of the limitations of for loops nested within parfor. This is described in the doc. The requirement is: ...

2 months ago | 1

| accepted

Answered
Parfor becomes serial half-way through computation
parfor uses heuristics to try and divide up loop execution into sub-ranges to maximise worker utilisation, but it sounds like th...

2 months ago | 0

Answered
Parallelizing computation with memory restrictions
Ok, this is somewhat dependent on what it is that you need to do with the results, but here's one way that you can avoid replica...

2 months ago | 1

Answered
How do I execute parallel computing in Matlab without altering my script?
It's not quite clear what you're trying to achieve here. You should launch parpool only if your script uses parallel language fe...

2 months ago | 0

| accepted

Answered
Understanding parfor restrictions with indexing
The indexing restrictions in parfor range from those which are required to make the loop iterations provably order-independent (...

2 months ago | 1

| accepted

Answered
Error using gpuArray/subsasgn
You can avoid this error by ensuring that your subscript contains only unique values, using the MATLAB function unique. For exam...

2 months ago | 0

| accepted

Answered
Parfor waitbar : How to do this more cleanly?
Hm, I've been meaning to tidy up my work-in-progress parallel.pool.DataQueue pool waitbar for quite a while. Here's roughly what...

2 months ago | 0

| accepted

Answered
Unexpectedly slow performance of eig with parfor
As you rightly point out, there are many factors that could be at play here. Here are the factors that spring to mind when looki...

3 months ago | 1

| accepted

Answered
How to speed up a parfor loop with large broadcast variables
It seems from your code that you should be able to slice your large variables idx and W. This would mean that each element of th...

3 months ago | 0

| accepted

Answered
Memory issue with eig function and GPU Array
Using your reproduction steps, I was able to see the problem using R2017b, but this appears to be fixed in R2019a - so please tr...

3 months ago | 1

| accepted

Answered
Parfeval blocks parfor loop evaluation
This is expected behaviour. Unfortunately, there is currently no way to overlap parfeval and parfor. Your best bet is probably t...

3 months ago | 0

| accepted

Answered
[GPU] Why do GFLOPS of element-wise matrix operations (addition, multiplication) seem to scale poorly as compared to e.g. mtimes?
The main factor here is that MTIMES (i.e. matrix-matrix multiplication) is compute bound, where as PLUS and TIMES (element-wise ...

3 months ago | 1

| accepted

Answered
Parallel Computing - how to run jobs from clients on servers with the same version.
Firstly, you need to ensure that the correct version of MATLAB Distributed Computing Server (MDCS) is installed on your cluster....

3 months ago | 0

Answered
Calling sets of INPUTS in a FUNCTION in a PARFOR loop
Did you try something like this: graphs = {graph1, graph2, graph3}; Matrix1s = {Matrix11, Matrix21, Matrix31}; Matrix2s = {Ma...

3 months ago | 1

| accepted

Answered
AttachedFiles in parfor on cluster
Firstly, AutoAddClientPath modifies the path on the workers to match the path on the client. This works only when the client and...

4 months ago | 0

Answered
Sliced variable issue - variable cannot be classified
I augmented your code a tiny bit to make it executable, and it works fine in MATLAB R2019a, and I checked all the way back to R2...

4 months ago | 0

| accepted

Answered
How to use the matfile function to call and slice up a very large structure and use it in parfor without having broadcast variable warning?
In this case, the warning about broadcasting the matfile object is probably safe to ignore. The point is that the matfile object...

4 months ago | 0

| accepted

Load more