Max-margin learning of deep structured models for semantic segmentation
Paper in proceeding, 2017

During the last few years most work done on the task of image segmentation has been focused on deep learning and Convolutional Neural Networks (CNNs) in particular. CNNs are powerful for modeling complex connections between input and output data but lack the ability to directly model dependent output structures, for instance, enforcing properties such as smoothness and coherence. This drawback motivates the use of Conditional Random Fields (CRFs), widely applied as a post-processing step in semantic segmentation. In this paper, we propose a learning framework that jointly trains the parameters of a CNN paired with a CRF. For this, we develop theoretical tools making it possible to optimize a max-margin objective with back-propagation. The max-margin loss function gives the model good generalization capabilities. Thus, the method is especially suitable for applications where labelled data is limited, for example, medical applications. This generalization capability is reflected in our results where we are able to show good performance on two relatively small medical datasets. The method is also evaluated on a public benchmark (frequently used for semantic segmentation) yielding results competitive to state-of-the-art. Overall, we demonstrate that end-to-end max-margin training is preferred over piecewise training when combining a CNN with a CRF.

Convolutional Neural Networks

Markov random fields

Segmentation

Author

Måns Larsson

Chalmers, Signals and Systems, Signal Processing and Biomedical Engineering

Jennifer Alvén

Chalmers, Signals and Systems, Signal Processing and Biomedical Engineering

Fredrik Kahl

Lund University

Chalmers, Signals and Systems, Signal Processing and Biomedical Engineering

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

03029743 (ISSN) 16113349 (eISSN)

Vol. 10270 LNCS 28-40
9783319591285 (ISBN)

Subject Categories

Energy Systems

DOI

10.1007/978-3-319-59129-2_3

ISBN

9783319591285

More information

Latest update

4/5/2022 6