Depth-Aided Tracking Multiple Objects under Occlusion

Abstract

In this paper, we have presented a novel tracking method aiming at detecting objects and maintaining their la-bel/identification over the time. The key factors of this method are to use depth information and different strategies to track objects under various occlusion scenarios. The foreground objects are detected and refined by background subtraction and shadow cancellation. The occlusion detection is based on information of foreground blobs in successive frames. The occlusion regions are projected to the projection plane XZ to analysis occlusion situation. According to the occlusion analysis results, different objects corresponding strategies are introduced to track objects under various occlusion scenarios including tracking occluded objects in similar depth layer and in different depth layers. The experimental results show that our proposed method can track the moving objects under the most typical and challenging occlusion scenarios.

Share and Cite:

A. Tran and K. Harada, "Depth-Aided Tracking Multiple Objects under Occlusion," Journal of Signal and Information Processing, Vol. 4 No. 3, 2013, pp. 299-307. doi: 10.4236/jsip.2013.43038.

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1] D. Koller, K. Danilidis and H.-H. Nagel, “Model-Based Object Tracking in Monocular Image Sequences of Road Traffic Scenes,” International Journal of Computer Vision, Vol. 10, No. 3, 1993, pp. 257-281. doi:10.1007/BF01539538
[2] T. Hai, H. S. Sawhney and R. Kumar, “Object Tracking with Bayesian Estimation of Dynamic Layer Representations,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 24, No. 1, 2002, pp. 75-89. doi:10.1109/34.982885
[3] A. D. Jepson, D. J. Fleet and T. F. El-Maraghi, “Robust Online Appearance Models for Visual Tracking,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 25, No. 10, 2003, pp. 1296-1311. doi:10.1109/TPAMI.2003.1233903
[4] D. Comaniciu, V. Ramesh and P. Meer, “Kernel-Based Object Tracking,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 25, No. 5, 2003, pp. 564-577. doi:10.1109/TPAMI.2003.1195991
[5] J. Shi and C. Tomasi, “Good Features to Track,” Proceedings IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, 21-23 June 1994, pp. 593-600.
[6] Y. Rui and Y. Chen, “Better Proposal Distributions: Object Tracking Using Unscented Particle Filter,” Proceedings of the Computer Vision and Pattern Recognition, Vol. 2, 2001, pp. 786-793.
[7] M. Isard and A. Blake, “CONDENSATION—Conditional Density Propagation for Visual Tracking,” International Journal of Computer Vision, Vol. 29, No. 1, 1998, pp. 5-28. doi:10.1023/A:1008078328650
[8] D. Beymer, P. McLauchlan, B. Coifman and J. Malik, “A Real-Time Computer Vision System for Measuring Traffic Parameters,” IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, 17-19 June 1997, pp. 495-501.
[9] N. K. Paragios and R. Deriche, “A PDE-Based Level-Set Approach for Detection and Tracking of Moving Objects,” The Sixth International Conference on Computer Vision, Bombay, 4-7 January 1998, pp. 1139-1145.
[10] Z. Tao, R. Nevatia and W. Bo, “Segmentation and Tracking of Multiple Humans in Crowded Environments,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 30No. 7, , 2008, pp. 1198-1211. doi:10.1109/TPAMI.2007.70770
[11] X. Zhou, Y. F. Li and B. He, “Game-Theoretical Occlusion Handling for Multi-Target Visual Tracking,” Pattern Recognition, Vol. 46, No. 10, 2013, pp. 2670-2684. doi:10.1016/j.patcog.2013.02.013
[12] V. Papadourakis and A. Argyros, “Multiple Objects Tracking in the Presence of Long-Term Occlusions,” Computer Vision and Image Understanding, Vol. 114, No. 7, 2010, pp. 835-846. doi:10.1016/j.cviu.2010.02.003
[13] M. Wu, X. Peng, Q. Zhang and R. Zhao, “Segmenting and Tracking Multiple Objects under Occlusion Using Multi-Label Graph Cut,” Computers & Electrical Engineering, Vol. 36, No. 5, 2010, pp. 927-934. doi:10.1016/j.compeleceng.2009.12.013
[14] E. Parvizi and Q. M. J. Wu, “Multiple Object Tracking Based on Adaptive Depth Segmentation,” Canadian Conference on Computer and Robot Vision, Windsor, 28-30 May 2008, pp. 273-277.
[15] S. J. Krotosky and M. M. Trivedi, “On Color-, Infrared-, and Multimodal-Stereo Approaches to Pedestrian Detection,” IEEE Transactions on Intelligent Transportation Systems, Vol. 8, No. 4, 2007, pp. 619-629. doi:10.1109/TITS.2007.908722
[16] R. Okada, Y. Shirai and J. Miura, “Object Tracking Based on Optical Flow and Depth,” International Conference on Multisensor Fusion and Integration for Intelligent Systems (IEEE/SICE/RSJ), Washington DC, 8-11 December 1996, pp. 565-571.
[17] D. Scharstein and R. Szeliski, “A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms,” International Journal of Computer Vision, Vol. 47, No. 1-3, 2002, pp. 7-42. doi:10.1023/A:1014573219977
[18] K. Konolige, “Small Vision Systems: Hardware and Implementation,” In: Y. Shirai and S. Hirose, Eds., Robotics Research, Springer, London, 1998, pp. 203-212.
[19] Z. Zivkovic, “Improved Adaptive Gaussian Mixture Model for Background Subtraction,” Proceedings of the 17th International Conference on Pattern Recognition, Vol. 2, 2004, pp. 28-31.
[20] P. KaewTraKulPong and R. Bowden, “An Improved Adaptive Background Mixture Model for Real-Time Tracking with Shadow Detection,” In: P. Remagnino, G. Jones, N. Paragios and C. Regazzoni, Eds., Video-Based Surveillance Systems, Springer, Berlin, 2002, pp. 135-144.
[21] A. Prati, I. Mikic, M. M. Trivedi and R. Cucchiara, “Detecting Moving Shadows: Algorithms and Evaluation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 25, No. 7, 2003, pp. 918-923. doi:10.1109/TPAMI.2003.1206520
[22] “OpenCV Wiki, cvBlobLib,” 2011. http://opencv.willowgarage.com/wiki/cvBlobsLib
[23] F. Chang, C.-J. Chen and C.-J. Lu, “A Linear-Time Component-Labeling Algorithm Using Contour Tracing Technique,” Computer Vision and Image Understanding, Vol. 93, No. 2, 2004, pp. 206-220. doi:10.1016/j.cviu.2003.09.002
[24] A. Bhattacharyya, “On a Measure of Divergence between Two Statistical Populations Defined by Their Probability Distributions,” Bulletin of the Calcutta Mathematical Society, Vol. 35, 1943, pp. 99-109.
[25] G. R. Bradski, “Real Time Face and Object Tracking as a Component of a Perceptual User Interface,” The Fourth IEEE Workshop on Applications of Computer Vision, Princeton, 19-21 October 1998, pp. 214-219.

Copyright © 2024 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.