How to Text Scan and remove columns full of zeros?
2 views (last 30 days)
I am scanning in large data sets and many of them have multiple fields that don't have data (recorded as 0). How would I use text scan to get the data into Matlab and remove any columns with 0s and move all columns over to not leave empty space in the resulting array? I attached a sample text file (tab delimited). The columns with zeros are not always the same, I need to somehow dynamically figure out which columns have 0s and remove them (the entire column needs to be removed, including the header)
Cam Salzberger on 15 May 2017
I'd highly recommend "readtable" over "textscan" in this case. This will also allow you to keep track of which columns are which, since tables keep header names. Otherwise, how would you know which columns were removed, and what are the columns that are left?
T = readtable('sample.txt');
for k = size(T,2):-1:1
T(:,k) = ;
I went backwards so that if I removed a variable, it wouldn't skip checking the next one, or require weird while loop syntax. There are other ways to access the different variables in a table, but this was one of the easiest to do while in a loop.