Browse by Domains

gradient descent

gradient descent

An Easy Guide to Gradient Descent in Machine Learning

Introduction Gradient Descent is an iterative approach for locating a function’s minima. This is an optimisation approach for locating the parameters or coefficients of a function with the lowest value. This function, however, does not always discover a global minimum and can become trapped at a local minimum. Take a look at the diagram above […]

An Easy Guide to Gradient Descent in Machine Learning Read More »

Stochastic Gradient Descent

Introduction to Stochastic Gradient Descent

Stochastic: “Process involving a randomly determined sequence of observations, each of which is considered as a sample of one element from a probability distribution.”  Or, in simple terms, “Random selection.” Contributed by: Sarveshwaran Points discussed: Optimization Optimization Function Loss Function Derivative Optimization Methods Gradient Descent Stochastic Gradient Descent What is the need of Optimization? Any

Introduction to Stochastic Gradient Descent Read More »

Scroll to Top