Estimator standard errors using fmincon (portfolio optimization context)
32 views (last 30 days)
Show older comments
I'm trying to get standard errors of the estimators in my optimization. I use the fmincon function with the active-set algorithm and dfp updating scheme. I am working on a portfolio optimization problem and what I would like to do is determine the statistical significance of the estimators in determining model performance (so which variables actually matter in determining model outperformance relative to the benchmark).
I have already ran a CAPM regression using Newey-West robust standard errors, however this just gives you a value for market beta and an alpha. I did this by taking my model returns as the dependent variable and taking the a vector of ones and the market returns as the independent variables.
Would it be correct to run a regression incorporating the other variables I believe to be useful (again with model returns as dependent variable), or do I need to do something else? I am wondering about this, since when I search for standard errors of the estimators on Google/the Matlab website, I just find a lot about calculating the Hessian.
Thanks in advance.
Martin Pott
0 Comments
Accepted Answer
Roger Wohlwend
on 5 Sep 2014
The key to the standard errors is the Hessian matrix. The variance-covariance-matrix of the coefficients is the inverse of the Hessian matrix. So the standard errors are the square root of the values on the diagonal of the inverse Hessian matrix.
err = sqrt(diag(inv(Hessian)))
The Hessian matrix is the 7th output variable of the fmincon function.
2 Comments
Matt J
on 5 Sep 2014
Edited: Matt J
on 5 Sep 2014
The Hessian output of fmincon is inaccurate, see
It is also unclear whether an accurate Hessian leads to meaningful statistical error estimates in constrained problems. According to Alan Weiss' remarks here, however, fminunc does generate accurate Hessians.
Joshua Scott
on 9 Nov 2022
Edited: Joshua Scott
on 9 Nov 2022
Hi Roger,
I realize your comment was a long time ago, but I am hoping you can help.
I am similarly trying to use the variance and/or standard error that resides in the hessian matrix. I want to put the results of "err" into a vector/matrix I can call on later. However, when I try versions of this, "err" isn't recognized.
Do you happen to know why?
More Answers (3)
Matt J
on 6 Sep 2014
Edited: Matt J
on 6 Sep 2014
I have set an upper and lower bound vector with values of -10 and 10, for which some coefficients are at the bounds when estimated.
I don't know of any extension of the Cramer-Rao bound to constrained problems. One option might be to rewrite the problem as an unconstrained one. E.g., if you have a parameter x that varies between bounds -10 and 10, rewrite that particular parameter using the change of variables.
x=10*sin(y)
Finding the inv(Hessian) of this transformed objective will give you standard errors on the new parameter y.
Note: since you've already solved the problem in the space of x, you need merely transform the objective and calculate the Hessian at that solution. No need to redo the optimization.
1 Comment
Matt J
on 9 Sep 2014
Martin Pott Commented:
Dear Matt,
I am currently working on some improvements in the optimization, so I'm not able to try it out at the moment.
I will try your method as soon as possible. Thank you for your response.
Martin
Martin Pott
on 15 Sep 2014
3 Comments
atreyu
on 30 Jun 2016
Edited: atreyu
on 30 Jun 2016
Was this true at the time? The documentation now says that it is in fact the Hessian at the solution.
Matt J
on 3 Jul 2016
The documentation that I am seeing,
says that it is still true.
See Also
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!