Joint and Separate Convexity of the Bregman Distance

Bauschke, Heinz H. and Borwein, Jonathan M. (2001) Joint and Separate Convexity of the Bregman Distance. Studies in Computational Mathematics, 8 . pp. 23-36.

Download (191Kb) | Preview
    Download (183Kb) | Preview


      Algorithms involving Bregman projections for solving optimization problems have been receiving much attention lately. Several of these methods rely crucially on the joint convexity of the Bregman distance.In this note, we study joint and separate convexity of Bregman distances.To bring out the main ideas more clearly, we consider first functions defined on an open interval.Our main result states that the Bregman distance of a given function is jointly convex if and only if the reciprocal of its second derivative is concave. We observe that Bregman distances induced by the two most popular choices --- the \emph{energy} and the \emph{Boltzmann-Shannon entropy} --- are limiting cases in a profound sense.This result is generalized by weakening assumptions on differentiability and strict convexity.We then consider general, not necessarily separable, convex functions.The characterization of joint convexity has a natural and beautiful analog. Finally, we discuss spectral functions,where the situation is less clear.Throughout, we provide numerous examples to illustrate our results.

      Item Type: Article
      Additional Information: pubdom FALSE
      Uncontrolled Keywords: Bregman distance, convex function, joint convexity, separate convexity
      Subjects: 26-xx Real functions > 26Axx Functions of one variable
      Faculty: UNSPECIFIED
      Depositing User: Users 1 not found.
      Date Deposited: 28 Nov 2003
      Last Modified: 28 Sep 2014 14:28

      Actions (login required)

      View Item