Clear Filters
Clear Filters

How to tune the regularization parameter in extreme learning machine?

4 views (last 30 days)
I train ELM on my dataset and gives test accuracy of 92.13. I wonder how to tune parameters to gain more test accuracy?
  1 Comment
BERGHOUT Tarek
BERGHOUT Tarek on 3 Feb 2019
if you want to get beter trainig accuracy in basic SLFN traind by ELM you should do this:
1- invrease the nuber of neurons one by one using incrimental ELM until the networks gives a stable accuracy
2- after that you can change the formula of beta "B=pinv(H)*T" to this one
(B=(inv((I/C)+H'*H)*H'*T);
wher I is the identity matrix you can type "help eye " in Matlab;
and try yo make your hidden layers as a squered matrix.
and after that you can increase your regularization parameter C incrimentaly until you get the minimam training error.

Sign in to comment.

Accepted Answer

BERGHOUT Tarek
BERGHOUT Tarek on 4 Feb 2019
if you want to get beter trainig accuracy in basic SLFN traind by ELM you should do this:
1- invrease the nuber of neurons one by one using incrimental ELM until the networks gives a stable accuracy
2- after that you can change the formula of beta "B=pinv(H)*T" to this one
(B=(inv((I/C)+H'*H)*H'*T);
wher I is the identity matrix you can type "help eye " in Matlab;
and try yo make your hidden layers as a squered matrix.
and after that you can increase your regularization parameter C incrimentaly until you get the minimam training error.

More Answers (0)

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!