← Visual companionIn-app Blueprint viewLean 4 source indexPDFDependency graph

Erratum: Deep Equilibrium Models for Poisson Imaging Inverse Problems via Mirror Descent

1 Variational Analysis and Abstract KŁ Convergence

Let \(\mathcal{E}_n := \mathbb {R}^n\) equipped with the standard Euclidean inner product \(\langle \cdot , \cdot \rangle \) and norm \(\| \cdot \| \). We work with extended-real functions \(f : \mathcal{E}_n \to \mathbb {R}\cup \{ -\infty , +\infty \} \).

Definition 1 Effective domain and properness
✓

For \(f : \mathcal{E}_n \to (-\infty , +\infty ]\), the effective domain is

\[ \mathrm{dom}(f) := \{ x \in \mathcal{E}_n \mid f(x) \ne +\infty \text{ and } f(x) \ne -\infty \} . \]

The function \(f\) is proper if \(\mathrm{dom}(f) \ne \emptyset \) and \(f(x) \ne -\infty \) for all \(x \in \mathcal{E}_n\).

Definition 2 Fréchet subdifferential, limiting subdifferential, and normal cone
✓

Let \(f : \mathcal{E}_n \to (-\infty , +\infty ]\) and \(x \in \mathrm{dom}(f)\). A vector \(v \in \mathcal{E}_n\) belongs to the Fréchet subdifferential \(\widehat{\partial } f(x)\) if

\[ \liminf _{\substack {y \to x \\ y \ne x}} \frac{f(y) - f(x) - \langle v, y - x \rangle }{\| y - x\| } \ge 0. \]

The limiting (Mordukhovich) subdifferential \(\partial f(x)\) is the set of \(v \in \mathcal{E}_n\) for which there exist sequences \(x_k \to x\) and \(v_k \in \widehat{\partial } f(x_k)\) with \(f(x_k) \to f(x)\) and \(v_k \to v\). Critical points are defined by \(\mathrm{crit}(f) := \{ x \in \mathcal{E}_n \mid 0 \in \partial f(x)\} \). For a subset \(C \subseteq \mathcal{E}_n\) and \(x \in C\), the convex normal cone is

\[ N_C(x) := \{ v \in \mathcal{E}_n \mid \forall z \in C,\; \langle v, z - x \rangle \le 0\} . \]
Lemma 3 Closedness of the limiting subdifferential
✓

If \(x_k \to \bar{x}\), \(f(x_k) \to f(\bar{x})\) with \(\bar{x} \in \mathrm{dom}(f)\), and \(\omega _k \in \partial f(x_k)\) satisfies \(\omega _k \to \bar{\omega }\), then \(\bar{\omega } \in \partial f(\bar{x})\).

Proof ▶

Each \(\omega _k\) is approximated arbitrarily closely in both argument, attentive value \(f(x_k)\), and subgradient by elements \((x'_{k}, \omega '_k)\) of the Fréchet subdifferential graph. A diagonal extraction yields \((y_k, v_k) \in \mathrm{gph}(\widehat{\partial } f)\) with \(y_k \to \bar{x}\), \(f(y_k) \to f(\bar{x})\), and \(v_k \to \bar{\omega }\), proving \(\bar{\omega } \in \partial f(\bar{x})\).

Lemma 4 Smooth sum rule on an open neighborhood
✓

Suppose \(U \subseteq \mathcal{E}_n\) is open, \(x \in U\), \(g : \mathcal{E}_n \to \mathbb {R}\) is \(C^1\) on \(U\), \(h : \mathcal{E}_n \to (-\infty , +\infty ]\) is proper, and \(f = g + h\) on \(U\). Then

\[ \partial f(x) = \{ \nabla g(x) + w \mid w \in \partial h(x)\} . \]
Proof ▶

First prove the local Fréchet subdifferential sum rule \(\widehat{\partial } f(y) = \nabla g(y) + \widehat{\partial } h(y)\) for every \(y \in U\) via the first-order Taylor remainder bound for \(g\) at \(y\). Because \(g\) and \(\nabla g\) are continuous on \(U\), attentive convergence \(y_k \to x\) with \(f(y_k) \to f(x)\) is equivalent to \(h(y_k) \to h(x)\), and \(\nabla g(y_k) + v_k \to \bar{\omega }\) corresponds bijectively to \(v_k \to \bar{\omega } - \nabla g(x)\).

Lemma 5 Limiting subdifferential of closed convex box indicator
✓

If \(C \subseteq \mathcal{E}_n\) is closed and convex, then for all \(x \in \mathcal{E}_n\), \(\partial \iota _C(x) = N_C(x)\).

Proof ▶

Convexity implies \(\widehat{\partial }\iota _C(y) = N_C(y)\) for all \(y \in C\), and closedness of \(C\) together with the linear-inequality definition of \(N_C\) makes the graph of \(N_C\) closed.

Definition 6 Desingularizing functions and the KŁ property
✓
#

For \(\eta {\gt} 0\), a function \(\varphi : \mathbb {R}\to \mathbb {R}\) is a desingularizing function in \(\Phi _\eta \) if \(\varphi (0) = 0\), \(\varphi \) is continuous on \([0, \eta )\), \(C^1\) and concave on \((0, \eta )\), and satisfies \(\varphi '(s) {\gt} 0\) on \((0, \eta )\).

Definition 7 Kurdyka–Łojasiewicz property
✓

A proper extended-real function \(f\) satisfies the KŁ property at \(\bar{x} \in \mathrm{dom}(\partial f)\) if there exist \(\eta {\gt} 0\), a neighborhood \(U\) of \(\bar{x}\), and \(\varphi \in \Phi _\eta \) such that for every \(x \in U\) with \(f(\bar{x}) {\lt} f(x) {\lt} f(\bar{x}) + \eta \),

\[ \varphi '\! \left((f(x) - f(\bar{x}))_{\mathbb {R}}\right) \cdot \operatorname {dist}(0, \partial f(x)) \ge 1. \]

We say \(f\) satisfies the KŁ property (\(\mathrm{HasKL}(f)\)) if it has the KŁ property at every \(\bar{x} \in \mathrm{dom}(\partial f)\).

Definition 8 Omega-limit set
✓
#

The \(\omega \)-limit set \(\omega (x^0)\) of a sequence \((x_k)_{k \in \mathbb {N}}\) in \(\mathcal{E}_n\) is the set of all cluster points \(\bar{x}\) for which there exists a strictly increasing extraction \(\psi : \mathbb {N}\to \mathbb {N}\) with \(x_{\psi (j)} \to \bar{x}\).

Lemma 9 Compactness and attraction of the \(\omega \)-limit set
✓

If \((x_k)_{k \in \mathbb {N}}\) is bounded, then \(\omega (x^0)\) is nonempty, closed, and compact, and \(\operatorname {dist}(x_k, \omega (x^0)) \to 0\) as \(k \to \infty \).

Proof ▶

Bolzano–Weierstrass in finite-dimensional Euclidean space yields nonemptiness and sequential compactness inside the closure of the range. Closedness follows from a diagonal subsequence argument, and if \(\operatorname {dist}(x_k, \omega (x^0))\) failed to tend to zero, an \(\varepsilon \)-separated subsequence would produce a cluster point outside \(\omega (x^0)\).

Theorem 10 Uniformized KŁ property
✓
#

Let \(\Omega \subseteq \mathcal{E}_n\) be nonempty and compact, and suppose \(f\) is constant on \(\Omega \) with finite value \(f_\star \) and satisfies the KŁ property at every \(z \in \Omega \). Then there exist \(\varepsilon {\gt} 0\), \(\eta {\gt} 0\), and a common desingularizing function \(\varphi \in \Phi _\eta \) such that for all \(x \in \mathcal{E}_n\) with \(\operatorname {dist}(x, \Omega ) {\lt} \varepsilon \) and \(f_\star {\lt} f(x) {\lt} f_\star + \eta \),

\[ \varphi '\! \left((f(x) - f_\star )_{\mathbb {R}}\right) \cdot \operatorname {dist}(0, \partial f(x)) \ge 1. \]
Proof ▶

Cover compact \(\Omega \) by finitely many balls \(B(z_i, \delta _i/2)\) extracted from the local KŁ neighborhoods \((U_{z_i}, \eta _{z_i}, \varphi _{z_i})\), pick \(\varepsilon {\gt} 0\) via the Lebesgue number of the open cover, set \(\eta := \min _i \eta _{z_i}\), and form the finite sum \(\varphi (s) := \sum _{i \in S} \varphi _{z_i}(s)\). Concavity and positivity of derivatives are preserved under finite sums, and \(\varphi '(s) \ge \varphi _{z_i}'(s)\) gives the uniform KŁ inequality without requiring Lebesgue integration.

Theorem 11 Abstract KŁ convergence — Theorem A.8 of [3]
✓
#

Let \(f : \mathcal{E}_n \to (-\infty , +\infty ]\) be proper, lower semicontinuous, bounded below, and satisfy the KŁ property. Let \((x_k)_{k \in \mathbb {N}}\) be a bounded sequence starting at \(x_0 \in \mathrm{dom}(f)\) satisfying for constants \(c_1, b {\gt} 0\):

  1. \(f(x_{k+1}) + c_1 \| x_{k+1} - x_k\| ^2 \le f(x_k)\) for all \(k \in \mathbb {N}\);

  2. there exists \(\omega _{k+1} \in \partial f(x_{k+1})\) with \(\| \omega _{k+1}\| \le b \| x_{k+1} - x_k\| \) for all \(k \in \mathbb {N}\);

  3. whenever \(x_{\psi (j)} \to \bar{x}\), we have \(f(x_{\psi (j)}) \to f(\bar{x})\).

Then \(\sum _{k=0}^\infty \| x_{k+1} - x_k\| {\lt} +\infty \), and \((x_k)\) converges to a critical point \(x_\infty \in \mathrm{crit}(f)\).

Proof ▶

By (H1) and lower boundedness, \(f(x_k) \downarrow f_\star \) and \(\| x_{k+1} - x_k\| \to 0\). Using (H2), (H3), and Lemma 3, every \(\bar{x} \in \omega (x^0)\) satisfies \(\bar{x} \in \mathrm{crit}(f)\) and \(f(\bar{x}) = f_\star \). If \(f(x_{k_0}) = f_\star \) at some step, monotonicity forces \(x_k = x_{k_0}\) for all \(k \ge k_0\). Otherwise, applying Theorem 10 on \(\Omega = \omega (x^0)\) and concavity of \(\varphi \) yields, for \(k \ge K\),

\[ 2 \| x_{k+1} - x_k\| \le \| x_k - x_{k-1}\| + \frac{b}{c_1} \bigl(\varphi (f(x_k) - f_\star ) - \varphi (f(x_{k+1}) - f_\star )\bigr). \]

Summing gives \(\sum \| x_{k+1} - x_k\| {\lt} +\infty \), hence Cauchyness and convergence of \((x_k)\) to a limit \(x_\infty \in \omega (x^0) \subseteq \mathrm{crit}(f)\).