Steps for gradient descent on a quadratic
You minimise on with using gradient descent with a fixed step size : . You choose to make the worst-case contraction factor per step as small as possible.
With that , what is the smallest number of steps that guarantees for every starting point ?
Show hints (3)+
- Each step multiplies the eigen-components by .
- Pick to equalise and .
- Then solve for the smallest integer .
Answer
Reveal answer →Final answer
62
Create a free account to see the full worked solution and track your progress.
Interview format: Prop Trading, Systematic & Data-Driven Trading