Multi-View ML Object Tracking with Online Learning on Riemannian Manifolds by Combining Geometric Constraints
Journal article, 2013

This paper addresses issues in object tracking with occlusion scenarios, where multiple uncalibrated cameras with overlapping fields of view are exploited. We propose a novel method where tracking is first done independently in each individual view and then tracking results are mapped from different views to improve the tracking jointly. The proposed tracker uses the assumptions that objects are visible in at least one view and move uprightly on a common planar ground that may induce a homography relation between views. A method for online learning of object appearances on Riemannian manifolds is also introduced. The main novelties of the paper include: (a) define a similarity measure, based on geodesics between a candidate object and a set of mapped references from multiple views on a Riemannian manifold; (b) propose multiview maximum likelihood (ML) estimation of object bounding box parameters, based on Gaussian-distributed geodesics on the manifold; (c) introduce online learning of object appearances on the manifold, taking into account of possible occlusions; (d) utilize projective transformations for objects between views, where parameters are estimated from warped vertical axis by combining planar homography, epipolar geometry and vertical vanishing point; (e) embed single-view trackers in a three-layer multi-view tracking scheme. Experiments have been conducted on videos from multiple uncalibrated cameras, where objects contain long-term partial/full occlusions, or frequent intersections. Comparisons have been made with three existing methods, where the performance is evaluated both qualitatively and quantitatively. Results have shown the effectiveness of the proposed method in terms of robustness against tracking drift caused by occlusions.

covariance tracking

maximum likelihood

multiple cameras

multiple view geometry

planar homography

particle filters

online learning

epipolar geometry

Riemannian manifold

Visual object tracking

Author

Yixiao Yun

Chalmers, Signals and Systems, Signal Processing and Biomedical Engineering

Irene Yu-Hua Gu

Chalmers, Signals and Systems, Signal Processing and Biomedical Engineering

Hamid Aghajan

IEEE Journal on Emerging and Selected Topics in Circuits and Systems

2156-3357 (ISSN) 21563365 (eISSN)

Vol. 3 2 12 -197 6516988

Areas of Advance

Information and Communication Technology

Transport

Subject Categories

Geometry

Information Science

Signal Processing

Computer Science

Computer Vision and Robotics (Autonomous Systems)

DOI

10.1109/JETCAS.2013.2256814

More information

Latest update

4/6/2022 5