The Azimuth Project
Co-ordinate descent (Rev #1, changes)

Showing changes from revision #0 to #1: Added | Removed | Changed

Contents

Idea

Co-ordinate descent is a technique for optimizing a multivariate function by simply repeatedly optimizing along each co-ordinate axis in turn. Although this is a less “intelligent” choice than utilising the gradient direction, it sometimes turns out allow closed form optimisations in that direction, resulting in being overall faster.