How to Text Scan and remove columns full of zeros?

1 view (last 30 days)
I am scanning in large data sets and many of them have multiple fields that don't have data (recorded as 0). How would I use text scan to get the data into Matlab and remove any columns with 0s and move all columns over to not leave empty space in the resulting array? I attached a sample text file (tab delimited). The columns with zeros are not always the same, I need to somehow dynamically figure out which columns have 0s and remove them (the entire column needs to be removed, including the header)

Accepted Answer

Cam Salzberger
Cam Salzberger on 15 May 2017
Hello Ibro,
I'd highly recommend "readtable" over "textscan" in this case. This will also allow you to keep track of which columns are which, since tables keep header names. Otherwise, how would you know which columns were removed, and what are the columns that are left?
T = readtable('sample.txt');
for k = size(T,2):-1:1
if ~any(T{:,k})
T(:,k) = [];
end
end
I went backwards so that if I removed a variable, it wouldn't skip checking the next one, or require weird while loop syntax. There are other ways to access the different variables in a table, but this was one of the easiest to do while in a loop.
-Cam
  2 Comments
Ibro Tutic
Ibro Tutic on 15 May 2017
I'm getting an error that says Undefined function 'any' for input arguments of type 'cell'.
Ibro Tutic
Ibro Tutic on 15 May 2017
Got it to work, just added a tab delimiter.

Sign in to comment.

More Answers (1)

Andrei Bobrov
Andrei Bobrov on 15 May 2017
T = T(:,any(T{:,:}));

Categories

Find more on Data Import and Export in Help Center and File Exchange

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!