Robust Visual Tracking Based on Convolutional Features with Illumination and Occlusion Handing

Robust Visual Tracking Based on Convolutional Features with Illumination and Occlusion Handing

Year:    2010

Journal of Computer Science & Technology, Vol. 25 (2010), Iss. 2 : pp. 223–236

Abstract

Visual tracking is an important area in computer vision. How to deal with illumination and occlusion problems is a challenging issue. This paper presents a novel and efficient tracking algorithm to handle such problems. On one hand, a target's initial appearance always has clear contour, which is light-invariant and robust to illumination change. On the other hand, features play an important role in tracking, among which convolutional features have shown favorable performance. Therefore, we adopt convolved contour features to represent the target appearance. Generally speaking, first-order derivative edge gradient operators are efficient in detecting contours by convolving them with images. Especially, the Prewitt operator is more sensitive to horizontal and vertical edges, while the Sobel operator is more sensitive to diagonal edges. Inherently, Prewitt and Sobel are complementary with each other. Technically speaking, this paper designs two groups of Prewitt and Sobel edge detectors to extract a set of complete convolutional features, which include horizontal, vertical and diagonal edges features. In the first frame, contour features are extracted from the target to construct the initial appearance model. After the analysis of experimental image with these contour features, it can be found that the bright parts often provide more useful information to describe target characteristics. Therefore, we propose a method to compare the similarity between candidate sample and our trained model only using bright pixels, which makes our tracker able to deal with partial occlusion problem. After getting the new target, in order to adapt appearance change, we propose a corresponding online strategy to incrementally update our model. Experiments show that convolutional features extracted by well-integrated Prewitt and Sobel edge detectors can be efficient enough to learn robust appearance model. Numerous experimental results on nine challenging sequences show that our proposed approach is very effective and robust in comparison with the state-of-the-art trackers.

You do not have full access to this article.

Already a Subscriber? Sign in as an individual or via your institution

Journal Article Details

Publisher Name:    Global Science Press

Language:    English

DOI:    https://doi.org/10.1007/s11390-017-1764-5

Journal of Computer Science & Technology, Vol. 25 (2010), Iss. 2 : pp. 223–236

Published online:    2010-01

AMS Subject Headings:   

Copyright:    COPYRIGHT: © Global Science Press

Pages:    14

Keywords:   

  1. To Identify Tree Species With Highly Similar Leaves Based on a Novel Attention Mechanism for CNN

    Song, Yupeng | He, Fazhi | Zhang, Xiying

    IEEE Access, Vol. 7 (2019), Iss. P.163277

    https://doi.org/10.1109/ACCESS.2019.2951607 [Citations: 14]
  2. A cloud-terminal-based cyber-physical system architecture for energy efficient machining process optimization

    Li, X. X. | He, F. Z. | Li, W. D.

    Journal of Ambient Intelligence and Humanized Computing, Vol. 10 (2019), Iss. 3 P.1049

    https://doi.org/10.1007/s12652-018-0832-1 [Citations: 20]
  3. Spatiotemporal key region transformer for visual tracking

    Wu, Ruixu | Wen, Xianbin | Yuan, Liming | Xu, Haixia

    Complex & Intelligent Systems, Vol. 9 (2023), Iss. 5 P.5865

    https://doi.org/10.1007/s40747-023-01040-4 [Citations: 1]
  4. HKSiamFC: Visual-Tracking Framework Using Prior Information Provided by Staple and Kalman Filter

    Li, Chenpu | Xing, Qianjian | Ma, Zhenguo

    Sensors, Vol. 20 (2020), Iss. 7 P.2137

    https://doi.org/10.3390/s20072137 [Citations: 7]
  5. On the role of generating textual description for design intent communication in feature-based 3D collaborative design

    Cheng, Yuan | He, Fazhi | Lv, Xiao | Cai, Weiwei

    Advanced Engineering Informatics, Vol. 39 (2019), Iss. P.331

    https://doi.org/10.1016/j.aei.2019.02.003 [Citations: 13]
  6. A Novel Bat Algorithm based on Collaborative and Dynamic Learning of Opposite Population

    Yong, Jiashi | He, Fazhi | Li, Haoran | Zhou, Weiqing

    2018 IEEE 22nd International Conference on Computer Supported Cooperative Work in Design ((CSCWD)), (2018), P.541

    https://doi.org/10.1109/CSCWD.2018.8464759 [Citations: 23]
  7. Shot boundary detection based on orthogonal polynomial

    Abdulhussain, Sadiq H. | Ramli, Abd Rahman | Mahmmod, Basheera M. | Saripan, M. Iqbal | Al-Haddad, S. A. R. | Jassim, Wissam A.

    Multimedia Tools and Applications, Vol. 78 (2019), Iss. 14 P.20361

    https://doi.org/10.1007/s11042-019-7364-3 [Citations: 34]
  8. Autofocus of imaging ellipsometry

    Guo, Haiyan | Ibrahim Khaleel, Mai | Chang, Yia-Chung

    Applied Optics, Vol. 61 (2022), Iss. 8 P.2045

    https://doi.org/10.1364/AO.449171 [Citations: 1]
  9. An optimized RGA supporting selective undo for collaborative text editing systems

    Lv, Xiao | He, Fazhi | Cai, Weiwei | Cheng, Yuan

    Journal of Parallel and Distributed Computing, Vol. 132 (2019), Iss. P.310

    https://doi.org/10.1016/j.jpdc.2019.05.005 [Citations: 11]
  10. DRCDN: learning deep residual convolutional dehazing networks

    Zhang, Shengdong | He, Fazhi

    The Visual Computer, Vol. 36 (2020), Iss. 9 P.1797

    https://doi.org/10.1007/s00371-019-01774-8 [Citations: 134]
  11. Advances in Multimedia Information Processing – PCM 2017

    Single Image Dehazing Using Deep Convolution Neural Networks

    Zhang, Shengdong | He, Fazhi | Yao, Jian

    2018

    https://doi.org/10.1007/978-3-319-77380-3_13 [Citations: 2]
  12. Channel Positive and Negative Feedback Network for Target Tracking

    Chen, Yue | He, Xiaowei | Zheng, Zhonglong | Bian, Pengcheng | Li, Yi

    IEEE Access, Vol. 9 (2021), Iss. P.15004

    https://doi.org/10.1109/ACCESS.2021.3052511 [Citations: 3]
  13. Joint learning of image detail and transmission map for single image dehazing

    Zhang, Shengdong | He, Fazhi | Ren, Wenqi | Yao, Jian

    The Visual Computer, Vol. 36 (2020), Iss. 2 P.305

    https://doi.org/10.1007/s00371-018-1612-9 [Citations: 70]
  14. Efficient fuzzy feature matching and optimal feature points for multiple objects tracking in fixed and active camera models

    Mathivanan, Anbuselvi | Palaniswamy, Saravanan

    Multimedia Tools and Applications, Vol. 78 (2019), Iss. 19 P.27245

    https://doi.org/10.1007/s11042-019-07825-5 [Citations: 1]
  15. STASiamRPN: visual tracking based on spatiotemporal and attention

    Wu, Ruixu | Wen, Xianbin | Liu, Zhanlu | Yuan, Liming | Xu, Haixia

    Multimedia Systems, Vol. 28 (2022), Iss. 5 P.1543

    https://doi.org/10.1007/s00530-021-00845-y [Citations: 3]
  16. A multi-phase blending method with incremental intensity for training detection networks

    Quan, Quan | He, Fazhi | Li, Haoran

    The Visual Computer, Vol. 37 (2021), Iss. 2 P.245

    https://doi.org/10.1007/s00371-020-01796-7 [Citations: 54]
  17. Learning adaptive trust strength with user roles of truster and trustee for trust-aware recommender systems

    Pan, Yiteng | He, Fazhi | Yu, Haiping | Li, Haoran

    Applied Intelligence, Vol. 50 (2020), Iss. 2 P.314

    https://doi.org/10.1007/s10489-019-01542-0 [Citations: 25]
  18. Word searching in scene image and video frame in multi-script scenario using dynamic shape coding

    Roy, Partha Pratim | Bhunia, Ayan Kumar | Bhattacharyya, Avirup | Pal, Umapada

    Multimedia Tools and Applications, Vol. 78 (2019), Iss. 6 P.7767

    https://doi.org/10.1007/s11042-018-6484-5 [Citations: 11]
  19. Robust visual tracking based on spatial context pyramid

    Tang, Fuhui | Zhang, Xiaoyu | Lu, Xiankai | Hu, Shiqiang | Zhang, Huanlong

    Multimedia Tools and Applications, Vol. 78 (2019), Iss. 15 P.21065

    https://doi.org/10.1007/s11042-019-7416-8 [Citations: 1]
  20. An efficient GPU-based parallel tabu search algorithm for hardware/software co-design

    Hou, Neng | He, Fazhi | Zhou, Yi | Chen, Yilin

    Frontiers of Computer Science, Vol. 14 (2020), Iss. 5

    https://doi.org/10.1007/s11704-019-8184-3 [Citations: 55]
  21. Collaborative CAD Synchronization Based on a Symmetric and Consistent Modeling Procedure

    Wu, Yiqi | He, Fazhi | Han, Soonhung

    Symmetry, Vol. 9 (2017), Iss. 4 P.59

    https://doi.org/10.3390/sym9040059 [Citations: 13]
  22. An asymmetric and optimized encryption method to protect the confidentiality of 3D mesh model

    Liang, Yaqian | He, Fazhi | Li, Haoran

    Advanced Engineering Informatics, Vol. 42 (2019), Iss. P.100963

    https://doi.org/10.1016/j.aei.2019.100963 [Citations: 24]
  23. A matting method based on full feature coverage

    Chen, Xiao | He, Fazhi | Yu, Haiping

    Multimedia Tools and Applications, Vol. 78 (2019), Iss. 9 P.11173

    https://doi.org/10.1007/s11042-018-6690-1 [Citations: 48]
  24. A parallel and robust object tracking approach synthesizing adaptive Bayesian learning and improved incremental subspace learning

    Li, Kang | He, Fazhi | Yu, Haiping | Chen, Xiao

    Frontiers of Computer Science, Vol. 13 (2019), Iss. 5 P.1116

    https://doi.org/10.1007/s11704-018-6442-4 [Citations: 46]
  25. Edge detection using multi-directional anisotropic Gaussian directional derivative

    An, Ying | Jing, Junfeng | Zhang, Weichuan

    Signal, Image and Video Processing, Vol. 17 (2023), Iss. 7 P.3767

    https://doi.org/10.1007/s11760-023-02604-0 [Citations: 0]
  26. A Novel Bat Algorithm based on Cross Boundary Learning and Uniform Explosion Strategy

    Yong, Jia-shi | He, Fa-zhi | Li, Hao-ran | Zhou, Wei-qing

    Applied Mathematics-A Journal of Chinese Universities, Vol. 34 (2019), Iss. 4 P.480

    https://doi.org/10.1007/s11766-019-3714-1 [Citations: 27]
  27. Digital image splicing detection based on Markov features in block DWT domain

    Zhang, Qingbo | Lu, Wei | Wang, Ruxin | Li, Guoqiang

    Multimedia Tools and Applications, Vol. 77 (2018), Iss. 23 P.31239

    https://doi.org/10.1007/s11042-018-6230-z [Citations: 25]
  28. A dividing-based many-objective evolutionary algorithm for large-scale feature selection

    Li, Haoran | He, Fazhi | Liang, Yaqian | Quan, Quan

    Soft Computing, Vol. 24 (2020), Iss. 9 P.6851

    https://doi.org/10.1007/s00500-019-04324-5 [Citations: 59]
  29. Multi-tracker fusion via adaptive outlier detection

    Xie, Chao | Wang, Ning | Zhou, Wengang | Li, Weiping | Li, Houqiang

    Multimedia Tools and Applications, Vol. 78 (2019), Iss. 2 P.2227

    https://doi.org/10.1007/s11042-018-6278-9 [Citations: 3]
  30. A Multi-Information Fusion Correlation Filters Tracker

    Wang, Junnan | Jia, Zhenhong | Lai, Huicheng | Yang, Jie | Kasabov, Nikola K.

    IEEE Access, Vol. 8 (2020), Iss. P.162022

    https://doi.org/10.1109/ACCESS.2020.3021235 [Citations: 3]
  31. DASFTOT: Dual attention spatiotemporal fused transformer for object tracking

    Wu, Ruixu | Wen, Xianbin | Yuan, Liming | Xu, Haixia

    Knowledge-Based Systems, Vol. 256 (2022), Iss. P.109897

    https://doi.org/10.1016/j.knosys.2022.109897 [Citations: 10]
  32. Recent trends in multicue based visual tracking: A review

    Kumar, Ashish | Walia, Gurjit Singh | Sharma, Kapil

    Expert Systems with Applications, Vol. 162 (2020), Iss. P.113711

    https://doi.org/10.1016/j.eswa.2020.113711 [Citations: 43]
  33. LSTM-based real-time action detection and prediction in human motion streams

    Carrara, Fabio | Elias, Petr | Sedmidubsky, Jan | Zezula, Pavel

    Multimedia Tools and Applications, Vol. 78 (2019), Iss. 19 P.27309

    https://doi.org/10.1007/s11042-019-07827-3 [Citations: 48]
  34. Visual object tracking using similarity transformation and adaptive optical flow

    Abbasi, Soolmaz | Rezaeian, Mehdi

    Multimedia Tools and Applications, Vol. 80 (2021), Iss. 24 P.33455

    https://doi.org/10.1007/s11042-021-11344-7 [Citations: 10]
  35. IBEA-SVM: An Indicator-based Evolutionary Algorithm Based on Pre-selection with Classification Guided by SVM

    Li, Hao-ran | He, Fa-zhi | Yan, Xiao-hu

    Applied Mathematics-A Journal of Chinese Universities, Vol. 34 (2019), Iss. 1 P.1

    https://doi.org/10.1007/s11766-019-3706-1 [Citations: 36]
  36. Suspicious activity recognition for monitoring cheating in exams

    Genemo, Musa Dima

    Proceedings of the Indian National Science Academy, Vol. 88 (2022), Iss. 1 P.1

    https://doi.org/10.1007/s43538-022-00069-2 [Citations: 15]
  37. An exclusive U-net for fine and crisp edge detection

    An, Ying | Jing, Junfeng | Li, Xuewei | Zhang, Jiaqi | Bao, Junmin

    Multimedia Tools and Applications, Vol. 83 (2023), Iss. 18 P.54657

    https://doi.org/10.1007/s11042-023-17706-7 [Citations: 2]
  38. MFCFSiam: A Correlation-Filter-Guided Siamese Network with Multifeature for Visual Tracking

    Li, Chenpu | Xing, Qianjian | Ma, Zhenguo | Zang, Ke | Tolba, Amr

    Wireless Communications and Mobile Computing, Vol. 2020 (2020), Iss. P.1

    https://doi.org/10.1155/2020/6681391 [Citations: 2]
  39. Localization-Aware Meta Tracker Guided With Adversarial Features

    Lin, Yiting | Zhong, Bineng | Li, Guorong | Zhao, Sicheng | Chen, Ziyi | Fan, Wentao

    IEEE Access, Vol. 7 (2019), Iss. P.99441

    https://doi.org/10.1109/ACCESS.2019.2930550 [Citations: 10]
  40. Learning social representations with deep autoencoder for recommender system

    Pan, Yiteng | He, Fazhi | Yu, Haiping

    World Wide Web, Vol. 23 (2020), Iss. 4 P.2259

    https://doi.org/10.1007/s11280-020-00793-z [Citations: 119]
  41. A correlative denoising autoencoder to model social influence for top-N recommender system

    Pan, Yiteng | He, Fazhi | Yu, Haiping

    Frontiers of Computer Science, Vol. 14 (2020), Iss. 3

    https://doi.org/10.1007/s11704-019-8123-3 [Citations: 64]
  42. Visual Tracking based on deformable Transformer and spatiotemporal information

    Wu, Ruixu | Wen, Xianbin | Yuan, Liming | Xu, Haixia | Liu, Yanli

    Engineering Applications of Artificial Intelligence, Vol. 127 (2024), Iss. P.107269

    https://doi.org/10.1016/j.engappai.2023.107269 [Citations: 1]
  43. A novel Enhanced Collaborative Autoencoder with knowledge distillation for top-N recommender systems

    Pan, Yiteng | He, Fazhi | Yu, Haiping

    Neurocomputing, Vol. 332 (2019), Iss. P.137

    https://doi.org/10.1016/j.neucom.2018.12.025 [Citations: 83]
  44. A novel region-based active contour model via local patch similarity measure for image segmentation

    Yu, Haiping | He, Fazhi | Pan, Yiteng

    Multimedia Tools and Applications, Vol. 77 (2018), Iss. 18 P.24097

    https://doi.org/10.1007/s11042-018-5697-y [Citations: 91]
  45. A novel CRDT-based synchronization method for real-time collaborative CAD systems

    Lv, Xiao | He, Fazhi | Cheng, Yuan | Wu, Yiqi

    Advanced Engineering Informatics, Vol. 38 (2018), Iss. P.381

    https://doi.org/10.1016/j.aei.2018.08.008 [Citations: 19]
  46. Local Homography Estimation on User-Specified Textureless Regions

    Chen, Zheng | Fang, Xiao-Nan | Zhang, Song-Hai

    Journal of Computer Science and Technology, Vol. 37 (2022), Iss. 3 P.615

    https://doi.org/10.1007/s11390-022-2185-7 [Citations: 2]
  47. A novel segmentation model for medical images with intensity inhomogeneity based on adaptive perturbation

    Yu, Haiping | He, Fazhi | Pan, Yiteng

    Multimedia Tools and Applications, Vol. 78 (2019), Iss. 9 P.11779

    https://doi.org/10.1007/s11042-018-6735-5 [Citations: 90]
  48. Personalized channel recommendation on live streaming platforms

    Lin, Chen-Yi | Chen, Han-Shen

    Multimedia Tools and Applications, Vol. 78 (2019), Iss. 2 P.1999

    https://doi.org/10.1007/s11042-018-6323-8 [Citations: 18]
  49. Human consistency evaluation of static video summaries

    Kannappan, Sivapriyaa | Liu, Yonghuai | Tiddeman, Bernie

    Multimedia Tools and Applications, Vol. 78 (2019), Iss. 9 P.12281

    https://doi.org/10.1007/s11042-018-6772-0 [Citations: 2]
  50. An efficient and robust bat algorithm with fusion of opposition-based learning and whale optimization algorithm

    Luo, Jinkun | He, Fazhi | Yong, Jiashi

    Intelligent Data Analysis, Vol. 24 (2020), Iss. 3 P.581

    https://doi.org/10.3233/IDA-194641 [Citations: 48]
  51. Dual feature selection and rebalancing strategy using metaheuristic optimization algorithms in X-ray image datasets

    Li, Jinyan | Fong, Simon | Liu, Lian-sheng | Dey, Nilanjan | Ashour, Amira S. | Moraru, Luminița

    Multimedia Tools and Applications, Vol. 78 (2019), Iss. 15 P.20913

    https://doi.org/10.1007/s11042-019-7354-5 [Citations: 18]