https://arxiv.org/abs/2403.01204
[2403.01204] Stochastic gradient descent for streaming linear and rectified linear systems with...
Abstract page for arXiv paper 2403.01204: Stochastic gradient descent for streaming linear and rectified linear systems with adversarial corruptions
stochastic gradient descentfor streaming
https://is.mpg.de/en/publications/linetal23
Sampling from Gaussian Process Posteriors using Stochastic Gradient Descent | MPI-IS
Our goal is to understand the principles of Perception, Action and Learning in autonomous systems that successfully interact with complex environments and to...
stochastic gradient descentgaussian processsampling
https://home.work.caltech.edu/library/094.html
Gradient Descent (Abu-Mostafa)
gradient descentabumostafa
https://collaborate.princeton.edu/en/publications/efficient-displacement-convex-optimization-with-particle-gradient/fingerprints/
Efficient displacement convex optimization with particle gradient descent - Fingerprint - Princeton...
convex optimizationgradient descentefficientdisplacementparticle
https://research.ibm.com/publications/practical-efficiency-of-asynchronous-stochastic-gradient-descent
Practical efficiency of asynchronous stochastic gradient descent for MLHPC 2016 - IBM Research
Practical efficiency of asynchronous stochastic gradient descent for MLHPC 2016 by Onkar Bhardwaj et al.
stochastic gradient descent
https://pure.psu.edu/en/publications/fast-alternating-projected-gradient-descent-algorithms-for-recove/
Fast alternating projected gradient descent algorithms for recovering spectrally sparse signals -...
gradient descentfastalternatingprojected
https://wes.copernicus.org/articles/8/1235/2023/
WES - Stochastic gradient descent for wind farm optimization
Abstract. It is important to optimize wind turbine positions to mitigate potential wake losses. To perform this optimization, atmospheric conditions, such as...
stochastic gradient descentwind farmwesoptimization
https://neuroticgradientdescent.blogspot.com/2020/07/a-brief-note-on-trauma-work.html
Neurotic Gradient Descent: A Brief Note on Trauma Work
People doing trauma work in themselves or others often talk about digesting shadow sides to things. I think I have a better understanding...
gradient descentbrief noteneurotictraumawork
https://bclarkson-code.com/index.html
Gradient Descent into Madness - Posts
gradient descentmadnessposts
https://in.mathworks.com/help/images/ref/registration.optimizer.regularstepgradientdescent.html
RegularStepGradientDescent - Regular step gradient descent optimizer configuration - MATLAB
A RegularStepGradientDescent object describes a regular step gradient descent optimization configuration that you pass to the function imregister to solve...
gradient descentregularstepoptimizerconfiguration
https://www.mit.edu/~gfarina/2025/67220s25_L15_sgd/
Gabriele Farina - Stochastic gradient descent and empirical risk minimization
Practical importance of stochastic gradient descent with momentum in tranining deep learning models; empirical risk minimization problems; minibatches;...
stochastic gradient descentgabrielefarinaempiricalrisk
https://fr.mathworks.com/help/images/ref/registration.optimizer.regularstepgradientdescent.html
RegularStepGradientDescent - Regular step gradient descent optimizer configuration - MATLAB
A RegularStepGradientDescent object describes a regular step gradient descent optimization configuration that you pass to the function imregister to solve...
gradient descentregularstepoptimizerconfiguration
https://www.work.caltech.edu/library/095.html
Gradient Descent (Abu-Mostafa)
gradient descentabumostafa
https://uwspace.uwaterloo.ca/items/4416bb93-2cb6-48ff-8a6d-e2519bd7044c/full
Simple Termination Criteria for Stochastic Gradient Descent Algorithm
Stochastic gradient descent (SGD) algorithm is widely used in modern mathematical optimization. Because of its scalability and ease of implementation, SGD is...
stochastic gradient descentsimpleterminationcriteriaalgorithm
https://infoscience.epfl.ch/entities/publication/e26577e0-f20c-4fa3-87bd-63a1f804ae91
Rigorous Dynamical Mean-Field Theory for Stochastic Gradient Descent Methods
We prove closed-form equations for the exact high-dimensional asymptotics of a family of first-order gradient-based methods, learning an estimator (e.g.,...
stochastic gradient descentfield theoryrigorousmeanmethods
https://repository.gatech.edu/entities/publication/3d59dba5-54aa-44e3-999f-9fb4ae77cb11
Gradient Descent: The Mother of All Algorithms?
More than a half of century of research in theoretical computer science brought us a great wealth of advanced algorithmic techniques. These techniques can then...
gradient descentthe motheralgorithms
https://en.wikipedia.org/wiki/Gradient_descent
Gradient descent - Wikipedia
gradient descentwikipedia
https://collaborate.princeton.edu/en/publications/gradient-descent-with-random-initialization-fast-global-convergen/
Gradient descent with random initialization: fast global convergence for nonconvex phase retrieval...
gradient descent
https://yuangang-cs.vercel.app/publication/fedbcgd/
Fedbcgd: Communication-efficient accelerated block coordinate gradient descent for federated...
Jul 1, 2024 - A communication efficient method for federated learning (ACM MM 2024).
gradient descentcommunicationefficientacceleratedblock
https://openmx.ssri.psu.edu/docs/OpenMx/2.0.0-4004/_static/Rdoc/mxComputeGradientDescent.html
R: Optimize parameters using a gradient descent optimizer
gradient descentoptimizeparametersusing
https://de.mathworks.com/help/deeplearning/ref/traingda.html
traingda - (To be removed) Gradient descent with adaptive learning rate backpropagation - MATLAB
This MATLAB function sets the network trainFcn property.
to be removedgradient descent
https://www.kaggle.com/code/pocahontas1010/implementing-gradient-descent-algorithm
Implementing Gradient Descent Algorithm | Kaggle
Explore and run AI code with Kaggle Notebooks | Using data from multiple data sources
gradient descentimplementingalgorithmkaggle
https://scholars.cityu.edu.hk/en/publications/symmetry-guided-gradient-descent-for-quantum-neural-networks/
Symmetry-guided gradient descent for quantum neural networks - CityUHK Scholars
gradient descentneural networkssymmetryguidedquantum
https://pure.psu.edu/en/publications/implicit-regularization-of-decentralized-gradient-descent-for-dec/
Implicit Regularization of Decentralized Gradient Descent for Decentralized Sparse Regression -...
gradient descentimplicitregularizationdecentralizedsparse
https://www.infoq.com/presentations/deep-learning-programming/
The Joy of Stochastic Gradient Descent - InfoQ
Carin Meier takes a look at the joys of Deep Learning, discussing how Deep Learning is changing how people approach programming, communicate with each other,...
stochastic gradient descentthe joyinfoq
https://collaborate.princeton.edu/en/publications/gradient-descent-follows-the-regularization-path-for-general-loss/
Gradient descent follows the regularization path for general losses - Princeton University
gradient descentfor generalfollowsregularization
https://www.freecodecamp.org/news/an-overview-of-the-gradient-descent-algorithm-8645c9e4de1e/
An overview of the Gradient Descent algorithm
Aug 19, 2024 - By Nishit Jain The subtle yet powerful algorithm that optimizes parameters Optimizing parameters is the ultimate goal of every machine learning algorithm. You...
an overviewof thegradient descentalgorithm
https://arxiv.org/abs/2601.16514
[2601.16514] Finite-Time Analysis of Gradient Descent for Shallow Transformers
Abstract page for arXiv paper 2601.16514: Finite-Time Analysis of Gradient Descent for Shallow Transformers
gradient descentfinitetimeanalysis
https://www.freecodecamp.org/news/tag/gradient-descent/
Gradient-Descent - freeCodeCamp.org
Browse thousands of programming tutorials written by experts. Learn Web Development, Data Science, DevOps, Security, and get developer career advice.
gradient descentfreecodecamp
https://docs.amd.com/r/2023.2-English/Vitis_Libraries/data_analytics/guide_L2/internals/SGD.html?contentId=bWAz4kTNRBg5am3xohYz7A
Stochastic Gradient Descent Framework - Stochastic Gradient Descent Framework - 2023.2 English
Stochasitc gradient descent is a method to optimize an objective function has certain properties. It is similar to gradient descent but different in data...
stochastic gradient descentframeworkenglish
https://www.work.caltech.edu/library/101.html
Stochastic Gradient Descent (Abu-Mostafa)
stochastic gradient descentabumostafa
https://github.com/CGudapati/BinaryClassification
GitHub - CGudapati/BinaryClassification: C++ implementation of Gradient Descent, Stochastic...
C++ implementation of Gradient Descent, Stochastic Gradient Descent for Sparse Data - CGudapati/BinaryClassification
c implementationgradient descentgithubstochastic
https://research-portal.uu.nl/en/publications/cpro-circular-projections-using-gradient-descent/
cPro: Circular Projections Using Gradient Descent - Utrecht University
gradient descentcprocircularprojectionsusing
https://bclarkson-code.com/
Gradient Descent into Madness - Posts
gradient descentmadnessposts
https://arxiv.org/abs/2509.11361
[2509.11361] MAPGD: Multi-Agent Prompt Gradient Descent for Collaborative Prompt Optimization
Abstract page for arXiv paper 2509.11361: MAPGD: Multi-Agent Prompt Gradient Descent for Collaborative Prompt Optimization
multi agentgradient descent
https://repository.gatech.edu/entities/publication/29a71fd3-6938-4b6a-9e31-b7f5e71383df
Polymatrix Competitive Gradient Descent for Reinforcement Learning
We explore the application of a new optimizer for reinforcement learning tasks: Polymatrix Competitive Gradient Descent (PCGD). We discuss its game-theoretic...
gradient descentcompetitivereinforcementlearning
https://arxiv.org/abs/1608.03983v5
[1608.03983v5] SGDR: Stochastic Gradient Descent with Warm Restarts
Abstract page for arXiv paper 1608.03983v5: SGDR: Stochastic Gradient Descent with Warm Restarts
stochastic gradient descentwarm
https://www.mit.edu/~gfarina/2025/67220s25_L14_mirror_descent/
Gabriele Farina - Projected gradient descent and mirror descent
The projected gradient descent (PGD) algorithm; distance-generating functions and Bregman divergences; proximal steps and their properties; the mirror descent...
gradient descentgabrielefarinaprojectedmirror
https://ar5iv.labs.arxiv.org/html/1609.04747
[1609.04747] An overview of gradient descent optimization algorithmsThis paper originally appeared...
Gradient descent optimization algorithms, while increasingly popular, are often used as black-box optimizers, as practical explanations of their strengths and...
an overviewgradient descent
https://infoscience.epfl.ch/entities/publication/eaf44ed8-e47d-46a4-bed4-ba3bb4d034b5
CPGD: Cadzow Plug-and-Play Gradient Descent for Generalised FRI
Finite rate of innovation (FRI) is a powerful reconstruction framework enabling the recovery of sparse Dirac streams from uniform low-pass filtered samples. An...
plug and playgradient descentgeneralisedfri
https://end-to-end-machine-learning.teachable.com/courses/advanced-neural-network-methods/lectures/12015824
1.2 Executing Regularization during Stochastic Gradient Descent | End
Take a neural network from bare-bones to state-of-the-art
stochastic gradient descentexecutingregularizationend
https://collaborate.princeton.edu/en/publications/distributed-gradient-descent-nonconvergence-to-saddle-points-and-/
Distributed Gradient Descent: Nonconvergence to Saddle Points and the Stable-Manifold Theorem -...
gradient descent
https://arxiv.org/html/2309.05516v3
Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
gradient descent
https://kth.diva-portal.org/smash/record.jsf?pid=diva2:1854149
Elastic Gradient Descent, an Iterative Optimization Method Approximating the Solution Paths of the...
gradient descent
https://collaborate.princeton.edu/en/publications/finding-approximate-local-minima-faster-than-gradient-descent/
Finding approximate local minima faster than gradient descent - Princeton University
gradient descentfindingapproximatelocalminima
https://uk.mathworks.com/matlabcentral/answers/424002-is-there-any-gradient-descent-method-available
Is there any gradient descent method available? - MATLAB Answers - MATLAB Central
Is there any gradient descent method available? . Learn more about gradient descent, minimization, gradient evaluation Optimization Toolbox
gradient descentmethodavailablematlabanswers
https://nl.mathworks.com/matlabcentral/answers/424002-is-there-any-gradient-descent-method-available
Is there any gradient descent method available? - MATLAB Answers - MATLAB Central
Is there any gradient descent method available? . Learn more about gradient descent, minimization, gradient evaluation Optimization Toolbox
gradient descentmethodavailablematlabanswers
https://dspace.mit.edu/handle/1721.1/136301.2?show=full
Complexity control by gradient descent in deep networks
gradient descentin deepcomplexitycontrolnetworks
https://collaborate.princeton.edu/en/publications/a-primal-dual-gradient-descent-approach-to-the-connectivity-const/fingerprints/
A Primal-Dual Gradient Descent Approach to the Connectivity Constrained Sensor Coverage Problem -...
https://transport-systems.imperial.ac.uk/resources/cive70111/lec02b_gradient-descent/content.html
Gradient Descent
gradientdescent
https://infoscience.epfl.ch/entities/publication/ad9b9cc7-44a9-4883-a63a-6f238bc845e3?ln=en
Iterative pre-conditioning for expediting the distributed gradient-descent method: The case of...
This paper considers the multi-agent linear least-squares problem in a server-agent network architecture. The system comprises multiple agents, each with a set...
https://arxiv.org/abs/2512.04268
[2512.04268] The Initialization Determines Whether In-Context Learning Is Gradient Descent
Abstract page for arXiv paper 2512.04268: The Initialization Determines Whether In-Context Learning Is Gradient Descent
https://arxiv.org/abs/1710.06382
[1710.06382] Convergence diagnostics for stochastic gradient descent with constant step size
Abstract page for arXiv paper 1710.06382: Convergence diagnostics for stochastic gradient descent with constant step size
stochastic gradient descent
https://collaborate.princeton.edu/en/publications/gradient-descent-learns-one-hidden-layer-cnn-dont-be-afraid-of-sp/
Gradient Descent Learns One-hidden-layer CNN: Don't be Afraid of Spurious Local Minima - Princeton...
https://arxiv.org/abs/2209.15594
[2209.15594] Self-Stabilization: The Implicit Bias of Gradient Descent at the Edge of Stability
Abstract page for arXiv paper 2209.15594: Self-Stabilization: The Implicit Bias of Gradient Descent at the Edge of Stability
https://arxiv.org/abs/2411.01350
[2411.01350] The Implicit Bias of Gradient Descent on Separable Multiclass Data
Abstract page for arXiv paper 2411.01350: The Implicit Bias of Gradient Descent on Separable Multiclass Data
implicit bias
https://arxiv.org/abs/2505.13122
[2505.13122] When majority rules, minority loses: bias amplification of gradient descent
Abstract page for arXiv paper 2505.13122: When majority rules, minority loses: bias amplification of gradient descent
https://ai.meta.com/research/publications/where-did-my-optimum-go-an-empirical-analysis-of-gradient-descent-optimization-in-policy-gradient-methods/
Where Did My Optimum Go?: An Empirical Analysis of Gradient Descent Optimization in Policy Gradient...
Recent analyses of certain gradient descent optimization methods have shown that performance can degrade in some settings -- such as with stochasticity...
https://research.ibm.com/publications/cpgd-cadzow-plug-and-play-gradient-descent-for-generalised-fri
CPGD: Cadzow Plug-and-Play Gradient Descent for Generalised FRI for IEEE TSP - IBM Research
CPGD: Cadzow Plug-and-Play Gradient Descent for Generalised FRI for IEEE TSP by Matthieu Simeoni et al.
https://nl.mathworks.com/matlabcentral/answers/437653-something-is-wrong-in-my-line-search-gradient-descent-code-it-gets-stuck
Something is wrong in my line search gradient descent code. It gets stuck! - MATLAB Answers -...
Something is wrong in my line search gradient... Learn more about optimization, nonlinear, programming
https://arxiv.org/abs/2108.09507v1
[2108.09507v1] How Can Increased Randomness in Stochastic Gradient Descent Improve Generalization?
Abstract page for arXiv paper 2108.09507v1: How Can Increased Randomness in Stochastic Gradient Descent Improve Generalization?
stochastic gradient descenthow can
https://uwaterloo.ca/hybrid-systems-lab/references/convergence-analysis-continuous-time-distributed-gradient
Convergence Analysis of a Continuous-Time Distributed Gradient Descent Algorithm | Hybrid Systems...
convergence analysis
https://research-portal.st-andrews.ac.uk/en/datasets/geometrically-inspired-kernel-machines-for-collaborative-learning/
Geometrically Inspired Kernel Machines for Collaborative Learning Beyond Gradient Descent -...
collaborative learninggeometricallyinspiredkernelmachines
https://collaborate.princeton.edu/en/publications/provable-efficient-online-matrix-completion-via-non-convex-stocha/fingerprints/
Provable efficient online matrix completion via non-convex stochastic gradient descent -...
matrix completionprovableefficientonline
https://collaborate.princeton.edu/en/publications/provable-efficient-online-matrix-completion-via-non-convex-stocha/
Provable efficient online matrix completion via non-convex stochastic gradient descent - Princeton...
stochastic gradient descentmatrix completion
https://igl.ethz.ch/projects/alps/
igl | Interactive Geometry Lab | ETH Zurich | Gradient Descent in the ALPS: Abstracted Low-Poly...
Abstract, paper, video, conference presentation and demo and source code.
https://collaborate.princeton.edu/en/publications/gradient-descent-on-two-layer-nets-margin-maximization-and-simpli/
Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias - Princeton University
https://www.shramos.com/
gradient_descent
gradientdescent
https://arxiv.org/abs/2307.04702
[2307.04702] Vocal Tract Area Estimation by Gradient Descent
Abstract page for arXiv paper 2307.04702: Vocal Tract Area Estimation by Gradient Descent
vocaltractareaestimationgradient