A Provably Convergent and Practical Algorithm for Min-max Optimization with Applications to GANs

Sushant Vijayan
Friday, 23 Oct 2020, 17:15 to 18:15
Algorithms for finding min-max equilibrium points in a zero sum game often exhibit cyclic behavior and non-convergence. The authors define a new solution concept for the zero sum gameĀ  played through stochastic gradient descent (and similar such methods) and propose an algorithm which converges with very high probability. The equilibrium point is reached in time polynomial in dimension and smoothness parameters of the function. Importantly no convexity or concavity in either players control is assumed and the convergence is independent of the initialization point.

Zoom link:https://zoom.us/j/98132227553?pwd=K2cyQllKVjExdUhlRm0vc0ZHcEt0Zz09