Versatile Defacement Detection by Monitoring Video Sequences Using Deep Learning


  •   Newlin Shebiah R

  •   Arivazhagan S


The main objective of this paper is to detect vandal and vandalism by monitoring recorded video sequences. Vandalism is one of the most commonly occurring crimes in the society that indirectly affects the economy of the country. The proposed algorithm takes in the input from the video extracted from surveillance camera which prevails in public places. Further, it is converted into frames and subtracted with the background to detect the foreground object. The background subtracted image contains both human and non-human moving objects. In order to differentiate human pixels and other moving objects in the video sequence, discriminative features are extracted using deep architecture and classified using SVM classifier. Deep features proved to be highly discriminative when compared with the handcrafted Histogram of Oriented Gradients features. By analyzing the dwell time of the person in the restricted scene and his motion pattern with time and significant change in background vandalism act is declared and the person is considered as vandal. The proposed method was evaluated on the videos collected from You Tube with the contents taken during night time, multiple vandals, car vandals etc.

Keywords: Vandalism, Background Subtraction, Feature Extraction, SVM Classifier, Alexnet


M. Ghazal, C. Vazquez, and A. Amer, “Real-time automatic detection of vandalism behavior in video sequences,” IEEE International Conference on Systems, Man and Cybernetics, Montreal, Que., Canada, 2007.

M. Ghazal, C. Vázquez, and A. Amer, “Real-time vandalism detection by monitoring object activities,” Multimedia Tools and Applications, vol. 58, no. 3, pp. 585-611, 2011.

D. Angiati, G. Gera, S. Piva, and C. Regazzoni, “A novel method for graffiti detection using change detection algorithm” Proceedings” IEEE Conference on Advanced Video and Signal Based Surveillance, Como, Italy, vol. 46, pp. 242-246, 2005.

Jing Wang, Zhijie Xu and Michael O'Grady, “Head Curve Matching and Graffiti Detection,” Int. Journal of Computer Vision, vol. 14, pp. 9-14, 2010.

Prakhar Nahar, Kang-hua Wu, Sitao Mei, Hadiyah Ghoghari, Preethi Srinivasan, Yueh-lin Lee, Jerry Gao, Xuan Guan, “Autonomous UAV Forced Grafitti Detection and Removal System Based on Machine Learning,” Int. Conf. on Unnamed Aircraft Systems, Vol.16, pages 672-679,2017.

M. Abdulraheem Fadhel, O. Al-Shamaa, and B. Husain Taher, “Real-Time detection and tracking moving vehicles for video surveillance systems using FPGA,” International Journal of Engineering & Technology, vol. 7, no. 2.31, pp. 117-121, 2018.

A. H. Al-Fatlawi, S. H. Ling, H. K. Lam, “A Comparison of Neural Classifiers for Graffiti Recognition” Journal of Intelligent Learning Systems and Applications, vol. 6, pp. 94-112, 2014.

A. Krizhevsky , I. Sutskever and G. E. Hinton, “ImageNet Classification with Deep Convolutional Neural Networks,” NIPS'12 Proceedings of the 25th International Conference on Neural Information Processing Systems - Volume 1, Lake Tahoe, Nevada, pp. 1097-1105, December 2012.

C. Stauffer and W.E.L. Grimson, “Adaptive background mixture models for real-time tracking,” IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Fort Collins, CO, USA, June 1999.

A. Elgammal, D. Harwood and L. Davis, “Non parametric model for background subtraction,” European Conference on Computer Vision, pp. 751-767, 2000.

M. Seki, T. Wada, H. Fujiwara, and K. Sumi,” Background subtraction based on cooccurrence of image variations,” IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, WI, USA, June 2003.

S. Kumar, and J. S. Yadav, “Video object extraction and its tracking using background subtraction in complex environments,” Perspectives in Science, vol. 8, pp. 317-322, 2016.

A. A. Ramirez, and M. Chouikha, “A New Algorithm for Tracking Objects in Videos of Cluttered Scenes,” International Journal of Information Technology, Modeling and Computing, vol. 1, no. 2, pp. 71-83, May 2013.

H. Zhou, W. Pan, and X. Shen, “Penalized model-based clustering with unconstrained covariance matrices,” Electronic Journal of Statistics, vol. 3, pp. 1473-1496, 2009.

I. Cohen, and G. Medioni, “Detecting and tracking moving objects for video surveillance,” IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Fort Collins, CO, USA, June 1999.

S. Minu, and A. Shetty, “A Comparative Study of Image Change Detection Algorithms in MATLAB,” Aquatic Procedia, vol. 4, pp. 1366-1373, 2015.

R. Radke, S. Andra, O. Al-Kofahi, and B. Roysam, “Image change detection algorithms: a systematic survey,” IEEE Transactions on Image Processing, vol. 14, no. 3, pp. 294-307, 2005.


Download data is not yet available.


How to Cite
R, N.S. and S, A. 2019. Versatile Defacement Detection by Monitoring Video Sequences Using Deep Learning. European Journal of Engineering and Technology Research. 4, 7 (Jul. 2019), 37-41. DOI: