Loading...
Search for: gradient-methods
0.007 seconds
Total 49 records

    Iteratively Constructing Preconditioners via the Conjugate Gradient Method

    , M.Sc. Thesis Sharif University of Technology Mousa Abadian, Mohammad (Author) ; Farhadi, Hamid Reza (Supervisor)
    Abstract
    The main goal of this work is solving system of linear equations Ax = b, where A is a n_n square matrix, b is a n_1 vector and x is the vector of unknowns. When n is large, using direct methods is not economical. Thus, the system is solved by iterative methods. At first, projection method onto subspace K _ Rn with dimension m _ n is described, and then this subspace K is equalized with the krylov subspace. Then,some samples of projection methods onto the krylov subspace, such as FOM, GMRES and CG (Conjugate Gradient), are considered. The preconditioning of the linear system is explained, that is, instead of solving system Ax = b, the system PAx = Pb (P nonsingular), is solved, such that the... 

    Correction of Time-Dependent Origin-Destination Demand in Dynamic Traffic Assignment

    , M.Sc. Thesis Sharif University of Technology Shafiei, Mohammad Sajjad (Author) ; Zakaei Ashtiani, Hedayat (Supervisor)
    Abstract
    Time-dependent origin-destination demand is a key input in dynamic traffic assignment in advanced traffic management systems, and the result of dynamic traffic assignment is dependent on the accuracy of this information. One method to achieve time dependent demand matrices is using a primary demand matrix and volume traffic counts in some links of network. In this thesis a bi-level model is used to correct the demand matrix and the extended gradient method is suggested to solve the problem. The extended gradient is an iterative method that in each iteration, corrects the demand matrix in a way that the estimated traffic flow be close to the observed traffic flow. Execution of this method in... 

    Two modified hybrid conjugate gradient methods based on a hybrid secant equation

    , Article Mathematical Modelling and Analysis ; Volume 18, Issue 1 , 2013 , Pages 32-52 ; 13926292 (ISSN) Babaie Kafaki, S ; Mahdavi Amiri, N ; Sharif University of Technology
    2013
    Abstract
    Taking advantage of the attractive features of Hestenes-Stiefel and Dai-Yuan conjugate gradient methods, we suggest two globally convergent hybridizations of these methods following Andrei's approach of hybridizing the conjugate gradient parameters convexly and Powell's approach of nonnegative restriction of the conjugate gradient parameters. In our methods, the hybridization parameter is obtained based on a recently proposed hybrid secant equation. Numerical results demonstrating the efficiency of the proposed methods are reported  

    Estimating time-dependent origin-destination demand from traffic counts: Extended gradient method

    , Article Transportation Letters ; Volume 7, Issue 4 , 2015 , Pages 210-218 ; 19427867 (ISSN) Shafiei, M ; Nazemi, M ; Seyedabrishami, S ; Sharif University of Technology
    Maney Publishing  2015
    Abstract
    Time-dependent origin-destination (TDOD) demand is a key input of dynamic traffic assignment (DTA) in advanced traffic management systems. Model reliability is highly dependent on the accuracy of this information. One method to achieve TDOD demand matrices is to use a primary demand matrix and traffic volume counts in some links of a network. This paper proposes a bi-level model to correct the TDOD demand matrix. The extended gradient method (EGM) - an iterative method that minimizes the discrepancy between the counted and estimated traffic volumes - is a suggested means to solve this problem. The methodology is first tested on a small synthetic network to verify its performance. Then, it is... 

    Optimal control of multiple-arm robotic systems using gradient method

    , Article 2004 IEEE Conference on Robotics, Automation and Mechatronics, 1 December 2004 through 3 December 2004 ; 2004 , Pages 312-317 ; 0780386469 (ISBN); 9780780386464 (ISBN) Babazadeh, A ; Sadati, N ; Sharif University of Technology
    2004
    Abstract
    Optimal control frameworks are very important in optimization of multiple-arm robotic systems, although complexity, non-linearity and having large scales usually cause some computational problems in the capacity and time needed. In this paper, coordination of multiple-arm robotic systems in order to carry a rigid object is considered and the state space equations for the overall system are developed. Coordination of the robot arms is done through minimizing a related cost function based on the gradient method. This method is simple and easy to be used  

    Energy management through topology optimization of composites microstructure using projected gradient method

    , Article Structural and Multidisciplinary Optimization ; Volume 52, Issue 6 , December , 2015 , Pages 1121-1133 ; 1615147X (ISSN) Homayounfar, S. Z ; Tavakoli, R ; Bagheri, R ; Sharif University of Technology
    Springer Verlag  2015
    Abstract
    In this paper the projected gradient method is applied as an effective gradient-based topology optimization algorithm in order to direct energy propagation through the desired region of composites microstructure. Rayleigh Damping model is also used in order to take the effect of internal damping mechanisms into account and thus, to fill in the gap between the designed layouts and those in reality. The success of the proposed algorithm is illustrated through several numerical experiments by revealing a set of various designed optimal layouts besides their corresponding energy distributions  

    A modified two-point stepsize gradient algorithm for unconstrained minimization

    , Article Optimization Methods and Software ; Volume 28, Issue 5 , 2013 , Pages 1040-1050 ; 10556788 (ISSN) Babaie Kafaki, S ; Fatemi, M ; Sharif University of Technology
    2013
    Abstract
    Based on a modified secant equation proposed by Li and Fukushima, we derive a stepsize for the Barzilai-Borwein gradient method. Then, using the newly proposed stepsize and another effective stepsize proposed by Dai et al. in an adaptive scheme that is based on the objective function convexity, we suggest a modified two-point stepsize gradient algorithm. We also show that the limit point of the sequence generated by our algorithm is first-order critical. Finally, our numerical comparisons done on a set of unconstrained optimization test problems from the CUTEr collection are presented. At first, we compare the performance of our algorithm with two other two-point stepsize gradient algorithms... 

    Two new conjugate gradient methods based on modified secant equations

    , Article Journal of Computational and Applied Mathematics ; Volume 234, Issue 5 , 2010 , Pages 1374-1386 ; 03770427 (ISSN) Babaie Kafaki, S ; Ghanbari, R ; Mahdavi Amiri, N ; Sharif University of Technology
    2010
    Abstract
    Following the approach proposed by Dai and Liao, we introduce two nonlinear conjugate gradient methods for unconstrained optimization problems. One of our proposed methods is based on a modified version of the secant equation proposed by Zhang, Deng and Chen, and Zhang and Xu, and the other is based on the modified BFGS update proposed by Yuan. An interesting feature of our methods is their account of both the gradient and function values. Under proper conditions, we show that one of the proposed methods is globally convergent for general functions and that the other is globally convergent for uniformly convex functions. To enhance the performance of the line search procedure, we also... 

    Analysis of displacement and strain fields of a screw dislocation in a nanowire using gradient elasticity theory

    , Article Scripta Materialia ; Volume 59, Issue 3 , August , 2008 , Pages 368-371 ; 13596462 (ISSN) Shodja, H. M ; Davoudi, K. M ; Gutkin, M. Y ; Sharif University of Technology
    2008
    Abstract
    Displacement and strain fields of a screw dislocation in a nanowire are considered within the theory of gradient elasticity. The gradient solution of the corresponding boundary value problem is derived and discussed in detail. It is shown that the dislocation fields do not contain classical jumps and singularities at the dislocation line. The maximum values of the dislocation displacement and elastic strain strongly depend on both the dislocation position and nanowire radius, thus demonstrating a nonclassical size effect. © 2008 Acta Materialia Inc  

    A new method for separation of speech signals in convolutive mixtures

    , Article 13th European Signal Processing Conference, EUSIPCO 2005, Antalya, 4 September 2005 through 8 September 2005 ; 2005 , Pages 2210-2213 ; 1604238216 (ISBN); 9781604238211 (ISBN) Ferdosizadeh, M ; Babaie Zadeh, M ; Marvasti, F. A ; Sharif University of Technology
    2005
    Abstract
    In this paper, the performance of the gradient method based on Score Function Difference (SFD) in the separation of i.i.d. and periodic signals will be investigated. We will see that this algorithm will separate periodic signals better than i.i.d. ones. By using this experimental result and the fact that voiced frames of speech signals are approximately periodic, a modified algorithm named VDGaradient has been proposed for separation of speech signals in synthetic convolutive mixtures. In this method, voiced frames of speech signal will be used as the input to the gradient method, then the resulting separating system will be applied to separate sources completely  

    A nonmonotone PRP conjugate gradient method for solving square and under-determined systems of equations

    , Article Computers and Mathematics with Applications ; Volume 73, Issue 2 , 2017 , Pages 339-354 ; 08981221 (ISSN) Ataee Tarzanagh, D ; Nazari, P ; Peyghami, M. R ; Sharif University of Technology
    Elsevier Ltd  2017
    Abstract
    In this paper, we propose a new derivative-free preconditioned conjugate gradient method in order for solving large-scale square and under-determined nonlinear systems of equations. The proposed method is also equipped with a relaxed nonmonotone line search technique. Under some suitable assumptions, the global convergence property is established. Numerical results on some square and under-determined test systems show the efficiency and effectiveness of the new method in practice. An application of the new method for solving nonlinear integro-differential equations is also provided. © 2016 Elsevier Ltd  

    Properties and Numerical Performance of Nonlinear Conjugate Gradient Methods Whit Modified Secant Equations and New Conjugacy Conditions

    , M.Sc. Thesis Sharif University of Technology Abdi, Javad (Author) ; Mahdavi Amiri, Nezamedin (Supervisor)
    Abstract
    Conjugate gradient methods are appealing for large scale nonlinear optimization problems, because they avoid the storage of matrices. Recently, a new conjugacy condition proposed by Dai and Liao, considers an inexact line search scheme that reduces to the old one if the line search is exact. Based on this condition, a new conjugate gradient method was proposed that has fast convergence. Later, Yabe and Takano, based on new conjugacy condition and modified secant condition, proposed another conjugate gradient method. This method takes both the available gradient and function value information and achieves a high-order accuracy in approximating the second-order curvature of the objective... 

    New Conjugate Gradient Methods for Unconstrained Optimization

    , Ph.D. Dissertation Sharif University of Technology (Author) ; Mahdavi Amiri, Nezamoddin (Supervisor)
    Abstract
    We discuss conjugate gradient methods for which both the gradient and func-tion values are considered in computing the conjugate gradient parameter. We pro-pose new conjugate gradient methods as members of Dai-Liao’s family of conjugate gradient methods and Andrei’s family of hybrid conjugate gradient methods. For computing the conjugate gradient parameter in our methods, three modified secant equations proposed by Zhang, Deng and Chen, Li and Fukushima, and Yuan are used. It is shown that under proper conditions, three of the proposed methods are globally convergent for uniformly convex functions and two other methods are glob-ally convergent for general functions. It is also shown that... 

    Accelerated Hybrid Conjugate Gradient Algorithm with Modified Secant Condition

    , M.Sc. Thesis Sharif University of Technology Soleimani Kourandeh, Aria (Author) ; Mahdavi Amiri, Nezamoddin (Supervisor)
    Abstract
    Conjugate gradient methods are useful for large scale nonlinear optimization problem, because they avoid the storage of any matrices. In this thesis, we have investigated an accelerated hybrid conjugate gradient algorithm, recently proposed in the literature. The combining parameter is calculated so that the corresponding direction to the conjugate gradient algorithm, while satisfies the modified secant condition, is a Newton direction. It is shown that for uniformly convex functions and for general nonlinear functions the algorithm with strong Wolfe line search is globally convergent. The algorithm uses an accelerated approach for the reduction of the objective function values by modifying... 

    An Implementation of an Interior Point Algorithm for Nonlinear Optimization Combining line Search and Trust Region Steps

    , M.Sc. Thesis Sharif University of Technology Khajuei Jahromi, Mona (Author) ; Mahdavi-Amiri, Nezamoddin (Supervisor)
    Abstract
    An interior point method for nonlinear programming problem recently proposed by Waltz, Morales, Nocedal and Orban is described and implemented [2].The steps are computed by line search based on the primal-dual equations, or trust region based on the conjugate gradient iteration. Steps computed by line search are tried first, but if they are determinded to be ineffective, a trust region iteration that guarantees progress toward a stationary point is used. In order to reduce the calculations, here we propose some modifications. The algorithms are implemented and the programs are tested on a variety of problems. Numerical results based on Dolan-More’ confirm the effectiveness of the algorithms  

    Implicit Solution of 2-dimensional Compressible Flow, Using Parallel Krylov Method

    , M.Sc. Thesis Sharif University of Technology Ansarian, Hossein (Author) ; Taeibi Rahni, Mohammad (Supervisor) ; Sabetghadam, Fereidoon (Supervisor)
    Abstract
    Numerical Simulation of two-dimensional steady compressible fluid flow on unstructured grids was accomplished using a fast implicit algorithm. To solve the copmlete two-dimensional Navier-Stokes equations, implicit time stepping was used which results in a large sparse linear system in each iteration. To solve the linear system, the biconjugate gradient method which belongs to Krylov subspace methods family, with an ILU(0) preconditioner was used. For accelerating the solution in large problems, parallel processing was used for linear system to be solved faster. Two upwind methods, namely Roe’s and AUSM+ methods were used for spatial descritizaion of inviscid fluxes with a MUSCL algorithm... 

    Implementation of New Hybrid Conjugate Gradient Algorithms
    Based on Modified BFGS Updates

    , M.Sc. Thesis Sharif University of Technology Moshtagh, Mehrdad (Author) ; Mahdavi-Amiri, Nezam (Supervisor)
    Abstract
    We describe two modified secant equations proposed by Yuan, Li and Fukushima. First, we study the approach proposed by Andrei. Then, we explain two hybrid conjugate gradient methods for unconstrained optimization problems. The methods are hybridizations of Hestenes-Stiefel and Dai-Yuan conjugate gradient methods. It is shown that one of the algorithms is globally convergent for uniformly convex functions and the other is globally convergent for general functions. Two approaches for computing the initial value of the steplength proposed by Babaie, Fatemi, and Mahdavi-Amiri and Andrei are used for accelerating the performance of the line search. We implement the algorithms and compare the... 

    Boundedness and regularity with nonlinear dependence of Hessian and gradient

    , Article Scientia Iranica ; Volume 15, Issue 6 , 2008 , Pages 553-557 ; 10263098 (ISSN) Mehri, B ; Nojumi, M. H ; Sharif University of Technology
    Sharif University of Technology  2008
    Abstract
    Sufficient conditions for the boundedness and regularity of a function, whose partial derivatives satisfy a certain set of equations, are presented. Energy methods are used to establish these results. The asymptotic behavior of the gradient toward a constant function is also investigated. © Sharif University of Technology  

    Accelerating federated edge learning

    , Article IEEE Communications Letters ; Volume 25, Issue 10 , 2021 , Pages 3282-3286 ; 10897798 (ISSN) Nguyen, T. D ; Balef, A. R ; Dinh, C. T ; Tran, N. H ; Ngo, D. T ; Anh Le, T ; Vo, P. L ; Sharif University of Technology
    Institute of Electrical and Electronics Engineers Inc  2021
    Abstract
    Transferring large models in federated learning (FL) networks is often hindered by clients' limited bandwidth. We propose $ extsf {FedAA}$ , an FL algorithm which achieves fast convergence by exploiting the regularized Anderson acceleration (AA) on the global level. First, we demonstrate that FL can benefit from acceleration methods in numerical analysis. Second, $ extsf {FedAA}$ improves the convergence rate for quadratic losses and improves the empirical performance for smooth and strongly convex objectives, compared to FedAvg, an FL algorithm using gradient descent (GD) local updates. Experimental results demonstrate that employing AA can significantly improve the performance of FedAvg,... 

    Robust adaptive fractional order proportional integral derivative controller design for uncertain fractional order nonlinear systems using sliding mode control

    , Article Proceedings of the Institution of Mechanical Engineers. Part I: Journal of Systems and Control Engineering ; Volume 232, Issue 5 , 1 May , 2018 , Pages 550-557 ; 09596518 (ISSN) Yaghooti, B ; Salarieh, H ; Sharif University of Technology
    SAGE Publications Ltd  2018
    Abstract
    This article presents a robust adaptive fractional order proportional integral derivative controller for a class of uncertain fractional order nonlinear systems using fractional order sliding mode control. The goal is to achieve closed-loop control system robustness against the system uncertainty and external disturbance. The fractional order proportional integral derivative controller gains are adjustable and will be updated using the gradient method from a proper sliding surface. A supervisory controller is used to guarantee the stability of the closed-loop fractional order proportional integral derivative control system. Finally, fractional order Duffing–Holmes system is used to verify...