Next Generation Multitarget Trackers: Random Finite Set Methods vs Transformer-based Deep Learning
Paper i proceeding, 2021

Multitarget Tracking (MTT) is the problem of tracking the states of an unknown number of objects using noisy measurements, with important applications to autonomous driving, surveillance, robotics, and others. In the model-based Bayesian setting, there are conjugate priors that enable us to express the multi-object posterior in closed form, which could theoretically provide Bayes-optimal estimates. However, the posterior involves a super-exponential growth of the number of hypotheses over time, forcing state-of-the-art methods to resort to approximations for remaining tractable, which can impact their performance in complex scenarios. Model-free methods based on deep-learning provide an attractive alternative, as they can, in principle, learn the optimal filter from data, but to the best of our knowledge were never compared to current state-of-the-art Bayesian filters, specially not in contexts where accurate models are available. In this paper, we propose a high-performing deeplearning method for MTT based on the Transformer architecture and compare it to two state-of-the-art Bayesian filters, in a setting where we assume the correct model is provided. Although this gives an edge to the model-based filters, it also allows us to generate unlimited training data. We show that the proposed model outperforms state-of-the-art Bayesian filters in complex scenarios, while matching their performance in simpler cases, which validates the applicability of deep-learning also in the model-based regime. The code for all our implementations is made available at https://github.com/JulianoLagana/MT3.

Multitarget tracking

Multi-object tracking

Multi-object conjugate prior

Deep learning

Transformers

Författare

Juliano Pinto

Chalmers, Elektroteknik, Signalbehandling och medicinsk teknik

Georg Hess

Chalmers, Elektroteknik, Signalbehandling och medicinsk teknik

William Ljungbergh

Student vid Chalmers

Yuxuan Xia

Chalmers, Elektroteknik, Signalbehandling och medicinsk teknik

Lennart Svensson

Chalmers, Elektroteknik, Signalbehandling och medicinsk teknik

Henk Wymeersch

Chalmers, Elektroteknik, Kommunikation, Antenner och Optiska Nätverk

Proceedings of 2021 IEEE 24th International Conference on Information Fusion, FUSION 2021

1059-1066
9781737749714 (ISBN)

IEEE Fusion 2021
Sun City, South Africa,

Ämneskategorier

Annan data- och informationsvetenskap

Kommunikationssystem

Signalbehandling

Datavetenskap (datalogi)

Mer information

Senast uppdaterat

2023-04-21