hdfread, NFS, and I/O Performance
2 views (last 30 days)
Show older comments
I'm encountering a vexing performance issue.
I have a script that uses the hdfread command to get variables from HDF files stored on a remote directory mounted in Windows via NFS. I wrote a benchmarking script that's telling me that when I try to read data from the network mounted directory, it's taking about 196 seconds per file. If I copy those file to a local directory and point the hdfread command at that directory, it's taking 3 seconds per file.
Here's were things get interesting. Copying and pasting the files in Windows sees them all copied in only a second or two per file. I used the copyfile command to copy the files from the remote directory to a local folder. The per file copy time is 2 seconds per file. It would seem that network I/O doesn't explain the extreme slowness.
Is there something about the hdfread command or its subfunctions that can explain this behavior? Is there some quirk about network file systems at play that I'm not aware of?
0 Comments
Answers (0)
See Also
Categories
Find more on Startup and Shutdown in Help Center and File Exchange
Products
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!