Model Meets Deep Learning in Image Inverse Problems

Model Meets Deep Learning in Image Inverse Problems

Year:    2020

Author:    Na Wang, Jian Sun

CSIAM Transactions on Applied Mathematics, Vol. 1 (2020), Iss. 3 : pp. 365–386

Abstract

Image inverse problem aims to reconstruct or restore high-quality images from observed samples or degraded images, with wide applications in imaging sciences. The traditional methods rely on mathematical models to invert the process of image sensing or degradation. But these methods require good design of image prior or regularizer that is hard to be hand-crafted. In recent years, deep learning has been introduced to image inverse problems by learning to invert image sensing or degradation process. In this paper, we will review a new trend of methods for image inverse problem that combines the imaging/degradation model with deep learning approach. These methods are typically designed by unrolling some optimization algorithms or statistical inference algorithms into deep neural networks. The ideas combining deep learning and models are also emerging in other fields such as PDE, control, etc. We will also summarize and present perspectives along this research direction.

You do not have full access to this article.

Already a Subscriber? Sign in as an individual or via your institution

Journal Article Details

Publisher Name:    Global Science Press

Language:    English

DOI:    https://doi.org/10.4208/csiam-am.2020-0016

CSIAM Transactions on Applied Mathematics, Vol. 1 (2020), Iss. 3 : pp. 365–386

Published online:    2020-01

AMS Subject Headings:    Global Science Press

Copyright:    COPYRIGHT: © Global Science Press

Pages:    22

Keywords:    Image inverse problem model-driven deep learning statistical model optimization model.

Author Details

Na Wang

Jian Sun

  1. Deep Gradient Projection Networks for Pan-sharpening

    Xu, Shuang | Zhang, Jiangshe | Zhao, Zixiang | Sun, Kai | Liu, Junmin | Zhang, Chunxia

    2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2021), P.1366

    https://doi.org/10.1109/CVPR46437.2021.00142 [Citations: 126]
  2. Advances in Information Communication Technology and Computing

    HySeg-Net: A Robust Interactive Hybrid Technique for Image Segmentation and Classification in Hand Gesture Recognition

    Narayan, Satya | Gajrani, Jyoti | Jain, Vinesh Kumar | Jat, Dharm Singh

    2025

    https://doi.org/10.1007/978-981-97-6106-7_9 [Citations: 0]
  3. Seismic Acoustic Impedance Inversion via Optimization-Inspired Semisupervised Deep Learning

    Chen, Hongling | Gao, Jinghuai | Zhang, Wei | Yang, Ping

    IEEE Transactions on Geoscience and Remote Sensing, Vol. 60 (2022), Iss. P.1

    https://doi.org/10.1109/TGRS.2021.3107257 [Citations: 21]