Main Content

[1] Biggs, M.C., “Constrained Minimization
Using Recursive Quadratic Programming,” *Towards
Global Optimization* (L.C.W. Dixon and G.P. Szergo, eds.),
North-Holland, pp 341–349, 1975.

[2] Brayton, R.K., S.W. Director, G.D. Hachtel,
and L. Vidigal, “A New Algorithm for Statistical Circuit Design
Based on Quasi-Newton Methods and Function Splitting,” *IEEE
Transactions on Circuits and Systems*, Vol. CAS-26, pp
784–794, Sept. 1979.

[3] Broyden, C.G., “The Convergence of
a Class of Double-rank Minimization Algorithms,”; *J.
Inst. Maths. Applics*., Vol. 6, pp 76–90, 1970.

[4] Conn, N.R., N.I.M. Gould, and Ph.L. Toint, *Trust-Region
Methods*, MPS/SIAM Series on Optimization, SIAM and MPS,
2000.

[5] Dantzig, G., *Linear Programming
and Extensions*, Princeton University Press, Princeton,
1963.

[6] Dantzig, G.B., A. Orden, and P. Wolfe, “Generalized
Simplex Method for Minimizing a Linear Form Under Linear Inequality
Restraints,” *Pacific Journal Math.,* Vol.
5, pp. 183–195, 1955.

[7] Davidon, W.C., “Variable Metric Method
for Minimization,” *A.E.C. Research and Development
Report*, ANL-5990, 1959.

[8] Dennis, J.E., Jr., “Nonlinear least-squares,” *State
of the Art in Numerical Analysis* ed. D. Jacobs, Academic
Press, pp 269–312, 1977.

[9] Dennis, J.E., Jr. and R.B. Schnabel, *Numerical
Methods for Unconstrained Optimization and Nonlinear Equations*,
Prentice-Hall Series in Computational Mathematics, Prentice-Hall,
1983.

[10] Fleming, P.J., “Application of Multiobjective
Optimization to Compensator Design for SISO Control Systems,” *Electronics
Letters*, Vol. 22, No. 5, pp 258–259, 1986.

[11] Fleming, P.J., “Computer-Aided Control
System Design of Regulators using a Multiobjective Optimization Approach,” *Proc.
IFAC Control Applications of Nonlinear Prog. and Optim*.,
Capri, Italy, pp 47–52, 1985.

[12] Fletcher, R., “A New Approach to Variable
Metric Algorithms,” *Computer Journal*,
Vol. 13, pp 317–322, 1970.

[13] Fletcher, R., “Practical Methods of Optimization,” John Wiley and Sons, 1987.

[14] Fletcher, R. and M.J.D. Powell, “A
Rapidly Convergent Descent Method for Minimization,” *Computer
Journal*, Vol. 6, pp 163–168, 1963.

[15] Forsythe, G.F., M.A. Malcolm, and C.B. Moler, *Computer
Methods for Mathematical Computations*, Prentice Hall,
1976.

[16] Gembicki, F.W., “Vector Optimization for Control with Performance and Parameter Sensitivity Indices,” Ph.D. Thesis, Case Western Reserve Univ., Cleveland, Ohio, 1974.

[17] Gill, P.E., W. Murray, M.A. Saunders, and
M.H. Wright, “Procedures for Optimization Problems with a
Mixture of Bounds and General Linear Constraints,” *ACM
Trans. Math. Software*, Vol. 10, pp 282–298, 1984.

[18] Gill, P.E., W. Murray, and M.H. Wright,* Numerical
Linear Algebra and Optimization*, Vol. 1, Addison Wesley,
1991.

[19] Gill, P.E., W. Murray, and M.H.Wright, *Practical
Optimization*, London, Academic Press, 1981.

[20] Goldfarb, D., “A Family of Variable
Metric Updates Derived by Variational Means,” *Mathematics
of Computing*, Vol. 24, pp 23–26, 1970.

[21] Grace, A.C.W., “Computer-Aided Control System Design Using Optimization Techniques,” Ph.D. Thesis, University of Wales, Bangor, Gwynedd, UK, 1989.

[22] Han, S.P., “A Globally Convergent
Method for Nonlinear Programming,” *J. Optimization
Theory and Applications*, Vol. 22, p. 297, 1977.

[23] Hock, W. and K. Schittkowski, “A Comparative
Performance Evaluation of 27 Nonlinear Programming Codes,” *Computing*,
Vol. 30, p. 335, 1983.

[24] Hollingdale, S.H., *Methods of
Operational Analysis in Newer Uses of Mathematics* (James
Lighthill, ed.), Penguin Books, 1978.

[25] Levenberg, K., “A Method for the Solution
of Certain Problems in Least Squares,” *Quart. Appl.
Math*. Vol. 2, pp 164–168, 1944.

[26] Madsen, K. and H. Schjaer-Jacobsen, “Algorithms
for Worst Case Tolerance Optimization,” *IEEE Transactions
of Circuits and Systems*, Vol. CAS-26, Sept. 1979.

[27] Marquardt, D., “An Algorithm for Least-Squares
Estimation of Nonlinear Parameters,” *SIAM J. Appl.
Math*. Vol. 11, pp 431–441, 1963.

[28] Moré, J.J., “The Levenberg-Marquardt
Algorithm: Implementation and Theory,” *Numerical
Analysis*, ed. G. A. Watson, Lecture Notes in Mathematics
630, Springer Verlag, pp 105–116, 1977.

[29] *NAG Fortran Library Manual,* Mark
12, Vol. 4, E04UAF, p. 16.

[30] Nelder, J.A. and R. Mead, “A Simplex
Method for Function Minimization,”* Computer J.,* Vol.7,
pp 308–313, 1965.

[31] Nocedal, J. and S. J. Wright. *Numerical
Optimization*, Second Edition. Springer Series in Operations
Research, Springer Verlag, 2006.

[32] Powell, M.J.D., “The Convergence of
Variable Metric Methods for Nonlinearly Constrained Optimization
Calculations,” *Nonlinear Programming 3*,
(O.L. Mangasarian, R.R. Meyer and S.M. Robinson, eds.), Academic Press,
1978.

[33] Powell, M.J.D., “A Fast Algorithm
for Nonlinearly Constrained Optimization Calculations,” *Numerical
Analysis*, G.A.Watson ed., Lecture Notes in Mathematics,
Springer Verlag, Vol. 630, 1978.

[34] Powell, M.J.D., “A Fortran Subroutine
for Solving Systems of Nonlinear Algebraic Equations,” *Numerical
Methods for Nonlinear Algebraic Equations*, (P. Rabinowitz,
ed.), Ch.7, 1970.

[35] Powell, M.J.D., “Variable Metric Methods
for Constrained Optimization,” *Mathematical Programming:
The State of the Art*, (A. Bachem, M. Grotschel and B.
Korte, eds.) Springer Verlag, pp 288–311, 1983.

[36] Schittkowski, K., “NLQPL: A FORTRAN-Subroutine
Solving Constrained Nonlinear Programming Problems,” *Annals
of Operations Research*, Vol. 5, pp 485-500, 1985.

[37] Shanno, D.F., “Conditioning of Quasi-Newton
Methods for Function Minimization,” *Mathematics
of Computing*, Vol. 24, pp 647–656, 1970.

[38] Waltz, F.M., “An Engineering Approach:
Hierarchical Optimization Criteria,” *IEEE Trans*.,
Vol. AC-12, pp 179–180, April, 1967.

[39] Branch, M.A., T.F. Coleman, and Y. Li, “A
Subspace, Interior, and Conjugate Gradient Method for Large-Scale
Bound-Constrained Minimization Problems,” *SIAM
Journal on Scientific Computing*, Vol. 21, Number 1, pp
1–23, 1999.

[40] Byrd, R.H., J. C. Gilbert, and J. Nocedal,
“A Trust Region Method Based on Interior Point Techniques for
Nonlinear Programming,” *Mathematical Programming*,
Vol 89, No. 1, pp. 149–185, 2000.

[41] Byrd, R.H., Mary E. Hribar, and Jorge Nocedal,
“An Interior Point Algorithm for Large-Scale Nonlinear Programming,” *SIAM
Journal on Optimization*, Vol 9, No. 4, pp. 877–900,
1999.

[42] Byrd, R.H., R.B. Schnabel, and G.A. Shultz,
“Approximate Solution of the Trust Region Problem by Minimization
over Two-Dimensional Subspaces,” *Mathematical Programming*,
Vol. 40, pp 247–263, 1988.

[43] Coleman, T.F. and Y. Li, “On the Convergence
of Reflective Newton Methods for Large-Scale Nonlinear Minimization
Subject to Bounds,” *Mathematical Programming*,
Vol. 67, Number 2, pp 189–224, 1994.

[44] Coleman, T.F. and Y. Li, “An Interior,
Trust Region Approach for Nonlinear Minimization Subject to Bounds,” *SIAM
Journal on Optimization*, Vol. 6, pp 418–445, 1996.

[45] Coleman, T.F. and Y. Li, “A Reflective
Newton Method for Minimizing a Quadratic Function Subject to Bounds
on some of the Variables,” *SIAM Journal on Optimization*,
Vol. 6, Number 4, pp 1040–1058, 1996.

[46] Coleman, T.F. and A. Verma, “A Preconditioned
Conjugate Gradient Approach to Linear Equality Constrained Minimization,” *Computational
Optimization and Applications*, Vol. 20, No. 1, pp. 61–72,
2001.

[47] Mehrotra, S., “On the Implementation
of a Primal-Dual Interior Point Method,” *SIAM Journal
on Optimization*, Vol. 2, pp 575–601, 1992.

[48] Moré, J.J. and D.C. Sorensen, “Computing
a Trust Region Step,” *SIAM Journal on Scientific
and Statistical Computing*, Vol. 3, pp 553–572,
1983.

[49] Sorensen, D.C., “Minimization of a Large Scale Quadratic Function Subject to an Ellipsoidal Constraint,” Department of Computational and Applied Mathematics, Rice University, Technical Report TR94-27, 1994.

[50] Steihaug, T., “The Conjugate Gradient
Method and Trust Regions in Large Scale Optimization,” *SIAM
Journal on Numerical Analysis*, Vol. 20, pp 626–637,
1983.

[51] Waltz, R. A. , J. L. Morales, J. Nocedal,
and D. Orban, “An interior algorithm for nonlinear optimization
that combines line search and trust region steps,” *Mathematical
Programming*, Vol 107, No. 3, pp. 391–408, 2006.

[52] Zhang, Y., “Solving Large-Scale Linear Programs by Interior-Point Methods Under the MATLAB Environment,” Department of Mathematics and Statistics, University of Maryland, Baltimore County, Baltimore, MD, Technical Report TR96-01, July, 1995.

[53] Hairer, E., S. P. Norsett, and G. Wanner, *Solving
Ordinary Differential Equations I - Nonstiff Problems*,
Springer-Verlag, pp. 183–184.

[54] Chvatal, Vasek, *Linear Programming*,
W. H. Freeman and Company, 1983.

[55] Bixby, Robert E., “Implementing the Simplex Method: The Initial Basis,” ORSA Journal on Computing, Vol. 4, No. 3, 1992.

[56] Andersen, Erling D. and Knud D. Andersen, “Presolving in Linear Programming,” Mathematical Programming, Vol. 71, pp. 221–245, 1995.

[57] Lagarias, J. C., J. A. Reeds, M. H. Wright,
and P. E. Wright, “Convergence Properties of the Nelder-Mead
Simplex Method in Low Dimensions,” *SIAM Journal
of Optimization*, Vol. 9, Number 1, pp. 112–147,
1998.

[58] Dolan, Elizabeth D. , Jorge J. Moré and Todd S. Munson, “Benchmarking Optimization Software with COPS 3.0,” Argonne National Laboratory Technical Report ANL/MCS-TM-273, February 2004.

[59] Applegate, D. L., R. E. Bixby, V. Chvátal
and W. J. Cook, *The Traveling Salesman Problem: A Computational
Study*, Princeton University Press, 2007.

[60] Spellucci, P., “A new technique for
inconsistent QP problems in the SQP method,” *Journal
of Mathematical Methods of Operations Research*, Volume
47, Number 3, pp. 355–400, October 1998.

[61] Tone, K., “Revisions of constraint
approximations in the successive QP method for nonlinear programming
problems,” *Journal of Mathematical Programming*,
Volume 26, Number 2, pp. 144–152, June 1983.

[62] Gondzio, J. “Multiple centrality
corrections in a primal dual method for linear programming.” *Computational
Optimization and Applications*, Volume 6, Number 2, pp.
137–156, 1996.

[63] Gould, N. and P. L. Toint. “Preprocessing
for quadratic programming.” *Math. Programming*,
Series B, Vol. 100, pp. 95–132, 2004.

[64] Schittkowski, K., “More Test Examples
for Nonlinear Programming Codes,” *Lecture Notes
in Economics and Mathematical Systems*, Number 282, Springer,
p. 45, 1987.