MATLAB Answers

0

I have a large array of small integer inputs and want to create a small array of Double outputs. Best machine learning approach?

Asked by Doug Rank on 26 Sep 2019
Latest activity Answered by Doug Rank on 10 Oct 2019
I have a large amount of training data (about 10,000) wherein I have a large array (~500,000) of small integer inputs (typically 0 or 1 with a tail that falls off exponentially toward 10) and a relatively small array (~30) of Double values between 0 and 1 as outputs.
In general the elements of the input array are uncorrelated with each other (meaning they will independently affect the output). Technically there are some correlations, but I'd be willing to ignore them as they are not terribly important.
I can add a few categorical and numeric engineered features to the input that would have a significant affect on the output.
I would like to try a machine learning approach to this problem within Matlab, but I am worried about the large amount of inputs. Is there an approach that's viable, or would some dimensionality reduction be absolutely necessary before proceeding? Any sort of dimensionality reduction would destroy the corellations between inputs - but I can live with that.

  0 Comments

Sign in to comment.

2 Answers

Answer by Dheeraj Singh on 30 Sep 2019
 Accepted Answer

As the number of data samples are less than no of features, if we use all the features then it can degrade the prediction performance even when all the features are relevant and contain information about the response variable.
You need to do feature selection to reduce the dimensionality of your data.
You can refer to know more about the different feature selection techniques:

  0 Comments

Sign in to comment.


Answer by Doug Rank on 10 Oct 2019

Thank you! I will check out those options and see which are appropriate.

  0 Comments

Sign in to comment.