A New Quasi-Newton Equation on the Gradient Methods for Optimization Minimization Problem

Basim Abbas Hassan, Ghada Al-Naemi

Abstract


The quasi-Newton equation is the very foundation of an assortment of the quasi-Newton methods for optimization minimization problem. In this paper, we deriving a new quasi-Newton equation based on the second-order Taylor’s series expansion. The global convergence is established underneath suitable conditions and numerical results are reported to show that the given algorithm is more effective than those of the normal BFGS method.


Keywords


Quasi-Newton method; Quasi-Newton equation; global convergence

References


Bertsekas D.P., (1996), Nonlinear Programming, Belmont, Massachusetts: Athena Scientific.

Yuan G. and Wei Z., (2010), ' Convergence analysis of a modified BFGS method on convex minimizations', Comp. Optim. Appl., 47, pp. 237-255.

Dai, Y. (2003), Convergence properties of the BFGS algorithm. SIAM J. Optim. 13, 693–701.

Yunhai Xiao , ZengxinWei1 and Li Zhang, (2006), ' A Modified BFGS Method Without Line Searches for Nonconvex Unconstrained Optimization', Advances in Theoretical and Applied Mathematics ,1, pp. 149-162.

Yuan G., Sheng Z., Wang B., Hu W. and , Li C., (2018), ' The global convergence of a modified BFGS method for nonconvex functions, Journal of Computational and Applied Mathematics, 327, pp. 274-294.

Biglari F., Hassan M.A., and Leong W. J.,(2011),' New quasi-Newton methods via higher order tensor models, J. Comput. Appl. Math. , (8) pp. 2412-2422.

Chen L.H., Deng N.Y., and. Zhang J.Z, (2006),'A modified quasi-Newton method for structured optimization with partial information on the Hessian, Comput. Optim. Appl. 35, pp. 5-18.

Wei Z., Li G., and Qi L.,(2006),' New quasi-Newton methods for unconstrained optimization problems, Appl. Math. Comput.,175, pp. 1156–1188.

Basim A. H. , A modified quasi-Newton methods for unconstrained Optimization, Italian journal of pure and applied mathematics, 2019; 42, 504-511.

Basim A. H. , Hussein K. K. A new class of BFGS updating formula based on the new quasi-newton equation, Indonesian Journal of Electrical Engineering and Computer Science,2019; 3: 945-953.

Dehghani R., Hosseini M and Bidabadi N., (2017),' The modified quasi-Newton methods for solving unconstrained optimization problems, WILEY, PP.1-8.

Powell M.J.D.,(1976),' Some global convergence properties of a variable metric algorithm for minimization without exact line searches, in Nonlinear Programming, SIAM-AMS Proceedings, Lemke, eds., SIAM, 1976, pp.53-72.

More J., Garbow B., and Hillstrome K., (1981),' Testing unconstrained optimization software, ACM Trans. Math. Software, 7,pp. 17-41.

Yuan Y. and Sun W., (1999),' Theory and Methods of Optimization, Science Press of China.




DOI: http://doi.org/10.11591/ijeecs.v19.i2.pp%25p
Total views : 16 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

shopify stats IJEECS visitor statistics