D2-Net: A Trainable CNN for Joint Description and Detection of Local Features
Paper i proceeding, 2019

In this work we address the problem of finding reliable pixel-level correspondences under difficult imaging conditions. We propose an approach where a single convolutional neural network plays a dual role: It is simultaneously a dense feature descriptor and a feature detector. By postponing the detection to a later stage, the obtained keypoints are more stable than their traditional counterparts based on early detection of low-level structures. We show that this model can be trained using pixel correspondences extracted from readily available large-scale SfM reconstructions, without any further annotations. The proposed method obtains state-of-the-art performance on both the difficult Aachen Day-Night localization dataset and the InLoc indoor localization benchmark, as well as competitive performance on other benchmarks for image matching and 3D reconstruction.

visual localization

local features

3D reconstruction

deep learning

machine learning

Författare

Mihai Dusmanu

Eidgenössische Technische Hochschule Zürich (ETH)

Ecole Normale Superieure (ENS)

Institut National de Recherche en Informatique et en Automatique (INRIA)

Ignacio Rocco

Institut National de Recherche en Informatique et en Automatique (INRIA)

Ecole Normale Superieure (ENS)

Tomas Pajdla

Ceske Vysoke Uceni Technicke v Praze

Marc Pollefeys

Microsoft Mixed Reality & AI Lab - Zürich

Eidgenössische Technische Hochschule Zürich (ETH)

Josef Sivic

Institut National de Recherche en Informatique et en Automatique (INRIA)

Ceske Vysoke Uceni Technicke v Praze

Ecole Normale Superieure (ENS)

Akihiko Torii

Tokyo Institute of Technology

Torsten Sattler

Chalmers, Elektroteknik, Signalbehandling och medicinsk teknik

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

10636919 (ISSN)

8084-8093
978-1-7281-3293-8 (ISBN)

IEEE / CVF Conference on Computer Vision and Pattern Recognition
Long Beach, USA,

Ämneskategorier

Robotteknik och automation

Datorseende och robotik (autonoma system)

DOI

10.1109/CVPR.2019.00828

Mer information

Senast uppdaterat

2023-03-21