Class 5

  1. Line Search Methods (Chapter 3), of type where pk is the search direction and alphak is the step length
    1. Step Length
      1. Wolfe conditions (geometric interpretations)
          sufficient decrease - step is not too large curvature condition - step is not too small
      2. Lemma 3.1 (existence of step lengths)
    2. Convergence of Line Search Methods
      1. Theorem 3.2 (cos theta geometric interpretation)