Differentiable Fixed-Rank Regularisation using Bilinear Parameterization
Paper i proceeding, 2020

Low rank structures are present in many applications of computer vision and machine learning. A popular approach consists of explicitly parameterising the set or matrices with sought rank, leading to a bilinear factorisation, reducing the problem to find the bilinear factors. While such an approach can be efficiently implemented using secondorder methods, such as Levenberg–Marquardt (LM) or Variable Projection (VarPro), it suffers from the presence of local minima, which makes theoretical optimality guarantees hard to derive. Another approach is to penalise non-zero singular values to enforce a low-rank structure. In certain cases, global optimality guarantees are known; however, such methods often lead to non-differentiable (and even discontinuous) objectives, for which it is necessary to use subgradient methods and splitting schemes. If the objective is complex, such as in structure from motion, the convergence rates for such methods can be very slow. In this paper we show how optimality guarantees can be lifted to methods that employ bilinear parameterisation when the sought rank is known. Using this approach the best of two worlds are combined: optimality guarantees and superior convergence speeds. We compare the proposed method to state-of-the-art solvers for prior-free non-rigid structure from motion.

Tensor rank

Matrix Completion

Nonconvex

Författare

Marcus Valtonen Örnhag

Lunds universitet

Carl Olsson

Chalmers, Elektroteknik, Signalbehandling och medicinsk teknik, Digitala bildsystem och bildanalys

Lunds universitet

Anders Heyden

Lunds universitet

30th British Machine Vision Conference 2019, BMVC 2019

British Machine Vision Conference
Cardiff, Wales, United Kingdom,

Optimeringsmetoder med prestandagarantier för maskininlärningsmetoder

Vetenskapsrådet (VR), 2019-01-01 -- 2022-12-31.

Ämneskategorier

Algebra och logik

Beräkningsmatematik

Datorseende och robotik (autonoma system)

Mer information

Senast uppdaterat

2020-11-02