MATLAB Answers

0

Tall array read csv file

Asked by Safwana Razak on 19 Nov 2019 at 9:55
Latest activity Commented on by dpb
on 20 Nov 2019 at 14:16
Hi why i am encounter this error while train my tall array data in machine learning model?
Error using matlab.io.datastore.TabularTextDatastore/readData (line 77)
Mismatch between file and format character vector.
Trouble reading 'Numeric' field from file (row number 6738, field number 4) ==> I/O Timeout,I/O Timeout,I/O
Timeout,I/O Timeout,I/O Timeout,I/O Timeout,I/O Timeout,I/O Timeout,I/O Timeout,I/O Timeout,I/O Timeout,I/O
Timeout,I/O Timeout,I/O Timeout,I/O Timeout,I/O Timeout,I/O Time...
Learn more about errors encountered during GATHER.
FYI my csv file go (200000x344). i tried to remove row number 6738 but the error still occur.
please advise.

  5 Comments

dpb
on 20 Nov 2019 at 3:22
That would all depend upon what created the file and how. You also didn't show us the code line used to do the read so we can't know what function was used and thereby know what it uses for parsing...some of the higher-level routines have quite a bit of internal data content analysis built into them.
Open the input file in the editor and save 7000 or so records to a new file and attach it...trying to diagnose w/o data is just guessing at what might be...
Safwana Razak on 20 Nov 2019 at 4:45
hi,
i already found the problem. my file contain the worng data in row 56892 but it the error its stated 6738, maybe because tall array already chucked my data.
Annotation 2019-11-20 091838.png
BTW, thanks for your reply.
dpb
on 20 Nov 2019 at 14:16
"the worng data in row 56892 but it the error its stated 6738, "
I've not used the tall array stuff, but apparently the error message line count is coming from the segment in use rather than being referenced back to the beginning of the file. That's probably worth a "Quality of Implementation" bug report to TMW to make debugging easier.
The klew to what was wrong is that it did echo the offending record content so a search for that string in the file would locate it...

Sign in to comment.

Products


Release

R2019b

0 Answers