Self-Supervised Linear Motion Deblurring
Artikel i vetenskaplig tidskrift, 2020

Motion blurry images challenge many computer vision algorithms, e.g., feature detection, motion estimation, or object recognition. Deep convolutional neural networks are stateof-the-art for image deblurring. However, obtaining training data with corresponding sharp and blurry image pairs can be difficult. In this letter, we present a differentiable reblur model for selfsupervised motion deblurring, which enables the network to learn from real-world blurry image sequences without relying on sharp images for supervision. Our key insight is that motion cues obtained from consecutive images yield sufficient information to inform the deblurring task. We therefore formulate deblurring as an inverse rendering problem, taking into account the physical image formation process: we first predict two deblurred images from which we estimate the corresponding optical flow. Using these predictions, we re-render the blurred images and minimize the difference with respect to the original blurry inputs. We use both synthetic and real dataset for experimental evaluations. Our experiments demonstrate that self-supervised single image deblurring is really feasible and leads to visually compelling results. Both the code and datasets are available at https://github.com/ethliup/SelfDeblur https://github.com/ethliup/SelfDeblur.

Författare

Peidong Liu

Eidgenössische Technische Hochschule Zürich (ETH)

Joel Janai

Universität Tübingen

Marc Pollefeys

Eidgenössische Technische Hochschule Zürich (ETH)

Torsten Sattler

Chalmers, Elektroteknik, Signalbehandling och medicinsk teknik

Andreas Geiger

Universität Tübingen

IEEE Robotics and Automation Letters

23773766 (eISSN)

Vol. 5 2 2475-2482

Ämneskategorier

Robotteknik och automation

DOI

10.1109/LRA.2020.2972873

Mer information

Senast uppdaterat

2021-05-04