Reliable and Dynamic Appearance Modeling and Label Consistency Enforcing for Fast and Coherent Video Object Segmentation With the Bilateral Grid
| Autor: | Ying Tian, Yan Gui, Daojian Zeng, Yi-Yu Cai, Zhifeng Xie |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
Markov random field
Computer science business.industry Pattern recognition 02 engineering and technology Grid Cut 0202 electrical engineering electronic engineering information engineering Media Technology Graph (abstract data type) 020201 artificial intelligence & image processing Segmentation Artificial intelligence Electrical and Electronic Engineering Appearance modeling business |
| Zdroj: | IEEE Transactions on Circuits and Systems for Video Technology. 30:4781-4795 |
| ISSN: | 1558-2205 1051-8215 |
| DOI: | 10.1109/tcsvt.2019.2961267 |
| Popis: | We propose a novel optimization framework for video object segmentation, given the initial annotations of objects in the keyframes of an input video sequence. In this work, video data is represented by a Markov Random Field model, and segmentation is achieved by finding the minimum graph cut label assignment. More specifically, we first create a bilateral representation of the input video sequence which reduces the size of the graph that the min-cut must operate on. We then introduce dynamic appearance models to learn the segmentation likelihoods, and the reliability of likelihoods is measured to identify false likelihoods that may cause segmentation errors. Thus, the model accurately describes changes in the object’s appearance that have evolved over time. Furthermore, we augment spatial and temporal connections using a soft higher-order potential, ensuring long-range label consistency in the segmentation. We provide extensive analysis and evaluation with respect to the influence of each component of the framework through the ablation study. Experiments on three benchmark datasets (DAVIS 2016, YouTube-Objects and SegTrack v2) show that our method achieves competitive performance compared to state-of-the-art while having the order of magnitude faster runtime. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|