Creating and sharing knowledge for telecommunications

External Patch-Based Image Restoration Using Importance Sampling

Niknejad, M. ; Bioucas-Dias, J. ; Figueiredo, M. A. T.

IEEE Transactions on Image Processing Vol. 28, Nº 9, pp. 4460 - 4470, September, 2019.

ISSN (print): 1057-7149
ISSN (online): 1941-0042

Scimago Journal Ranking: 2,89 (in 2019)

Digital Object Identifier: 10.1109/TIP.2019.2912122

Abstract
This paper introduces a new approach to patch-based image restoration based on external datasets and importance sampling. The minimum mean squared error (MMSE) estimate of the image patches, the computation of which requires solving a multidimensional (typically intractable) integral, is approximated using samples from an external dataset. The new method, which can be interpreted as a generalization of the external non-local means, uses self-normalized importance sampling to efficiently approximate the MMSE estimates. The use of self-normalized importance sampling endows the proposed method with great flexibility, namely regarding the statistical properties of the measurement noise. The effectiveness of the proposed method is shown in a series of experiments using both generic large-scale and class-specific external datasets.