How to determine feature importance using gradient boosting?

17 views (last 30 days)
When using XGBoost in Python you can train a model and then use the embedded feature importance of XGBoost to determine which features are the most important.
In Matlab there is no implementation of XGBoost, but there is fitrensemble which is similar (afaik). Is there a way to use it for detemination of feature importance? Or is there maybe another way to do feature importance the way XGBoost does it?

Accepted Answer

the cyclist
the cyclist on 24 Jun 2024
The model that is output from fitrensemble has a predictorImportance method for global predictor importance.
You can also use shapley for local feature importance.
  1 Comment
the cyclist
the cyclist on 24 Jun 2024
Also, note that XGBoost is not an algorithm. It's just an efficient implementation of gradient boosting. You might find this question/answer from the MathWorks support team to be interesting.

Sign in to comment.

More Answers (0)

Categories

Find more on Get Started with Statistics and Machine Learning Toolbox in Help Center and File Exchange

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!