D2-Net: A Trainable CNN for Joint Description and Detection of Local Features
Paper i proceeding, 2019
In this work we address the problem of finding reliable pixel-level correspondences under difficult imaging conditions. We propose an approach where a single convolutional neural network plays a dual role: It is simultaneously a dense feature descriptor and a feature detector. By postponing the detection to a later stage, the obtained keypoints are more stable than their traditional counterparts based on early detection of low-level structures. We show that this model can be trained using pixel correspondences extracted from readily available large-scale SfM reconstructions, without any further annotations. The proposed method obtains state-of-the-art performance on both the difficult Aachen Day-Night localization dataset and the InLoc indoor localization benchmark, as well as competitive performance on other benchmarks for image matching and 3D reconstruction.
visual localization
3D reconstruction
machine learning
deep learning
local features
Författare
Mihai Dusmanu
Ecole Normale Superieure (ENS)
Eidgenössische Technische Hochschule Zürich (ETH)
Institut National de Recherche en Informatique et en Automatique (INRIA)
Ignacio Rocco
Ecole Normale Superieure (ENS)
Institut National de Recherche en Informatique et en Automatique (INRIA)
Tomas Pajdla
Ceske Vysoke Uceni Technicke v Praze
Marc Pollefeys
Eidgenössische Technische Hochschule Zürich (ETH)
Microsoft Corporation
Josef Sivic
Institut National de Recherche en Informatique et en Automatique (INRIA)
Ceske Vysoke Uceni Technicke v Praze
Ecole Normale Superieure (ENS)
Akihiko Torii
Tokyo Institute of Technology
Torsten Sattler
Chalmers, Elektroteknik, Signalbehandling och medicinsk teknik
Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
10636919 (ISSN)
Vol. 2019-June 8084-8093978-1-7281-3293-8 (ISBN)
IEEE / CVF Conference on Computer Vision and Pattern Recognition
Long Beach, USA,
Long Beach, USA,
Ämneskategorier (SSIF 2011)
Robotteknik och automation
Datorseende och robotik (autonoma system)
DOI
10.1109/CVPR.2019.00828