Download:
Abstract:

We revisit the signal denoising problem through the lens of optimal transport: the goal is to recover an unknown scalar signal distribution $X \sim P$ from noisy observations $Y = X + \sigma Z$, with $Z$ being standard Gaussian independent of $X$ and $\sigma>0$ a known noise level. Let $Q$ denote the distribution of $Y$. We introduce a hierarchy of denoisers $T_0, T_1, \ldots, T_\infty : \mathbb{R} \to \mathbb{R}$ that are agnostic to the signal distribution $P$, depending only on higher-order score functions of $Q$. Each denoiser $T_K$ is progressively refined using the $(2K-1)$-th order score function of $Q$ at noise resolution $\sigma^{2K}$, achieving better denoising quality measured by the Wasserstein metric $W(T_K \sharp Q, P)$. The limiting denoiser $T_\infty$ identifies the optimal transport map with $T_\infty \sharp Q = P$.

We provide a complete characterization of the combinatorial structure underlying this hierarchy through Bell polynomial recursions, revealing how higher-order score functions encode the optimal transport map for signal denoising. We study two estimation strategies with convergence rates for higher-order scores from i.i.d. samples drawn from $Q$: (i) plug-in estimation via Gaussian kernel smoothing, and (ii) direct estimation via higher-order score matching. This hierarchy of agnostic denoisers opens new perspectives in signal denoising and empirical Bayes.

Citation

Tengyuan Liang. 2025. “Distributional Shrinkage II: Higher-Order Scores Encode Brenier Map.” arXiv:2512.09295.

@misc{Liang2025DS2,
  title = {Distributional Shrinkage {II}: Higher-Order Scores Encode Brenier Map},
  author = {Liang, Tengyuan},
  year = {2025},
  eprint = {2512.09295},
  archivePrefix = {arXiv},
  primaryClass = {math.ST},
  url = {https://arxiv.org/abs/2512.09295},
}

This work is part II of a two-part series on distributional shrinkage; part I can be found here .

Previously circulated as “Distributional Shrinkage II: Optimal Transport Denoisers with Higher-Order Scores” (arXiv:2512.09295v1 ).