License Plate Detection using Cascaded Classifier with Two-Phase Training and Testing

Mahdi Yazdian-Dehkordi, Fahimeh Ramazankhani

Abstract


License plate recognition (LPR) is a core infrastructure of most intelligent transport systems (ITS). Plate detection is the first and the most important step for license plate recognition. In this paper, several schemes are proposed based on cascade classifier to detect multi-plates in an image. Here, a two-phase testing approach is suggested to improve the efficiency of the system in tackling false alarm and improving the detection precision. Besides, a two-phase training with feedback is proposed by collecting negative data feedback to improve the training of the cascade classifier. Finally, a combined approach is also proposed by merging the two-phase testing and the two-phase training with feedback schemes. To analyze the efficiency of the proposed approaches, the experiments are conducted on the real-world images with the plates in different environments as well as the plates in two different languages with various size, complexity, illumination, multiple plates at front/rear of cars. The results show that the proposed schemes can improve the performance of the plate detection system.

Keywords


Cascade Classifier; Classification; License Plate Recognition; Plate Detection; Two-Phase Train/Test;

Full Text:

PDF

References


C. N. Anagnostopoulos, I. Anagnostopoulos, V. Loumos and E. Kayafas, "A License Plate-Recognition Algorithm for Intelligent Transportation System Applications," IEEE Transactions on Intelligent Transportation Systems, vol. 7, no. 3, pp. 377 - 392, September 2006.

M. K. Sarker, S. Yoon and D. S. Park, "A Fast and Robust License Plate Detection Algorithm Based on Two-stage Cascade AdaBoost," KSII Transactions on Internet and Information Systems, vol. 8, no. 10, pp. 3490-3507, 31 October 2014.

M. Rokonuzzaman, M. A. Al Amin, M. H. K. M. U. Ahmed and M. T. Rahman, "Automatic vehicle identification system using machine learning and robot operating system (ROS)," in 4th International Conference on Advances in Electrical Engineering (ICAEE), Dhaka, 2017.

A. . S. Joshi and D. A. Kulkarni, "Automatic Number Plate Recognition and IoT Based Vehicle Tracking," International Research Journal of Engineering and Technology (IRJET), vol. 4, no. 7, pp. 1503-1507, July 2017.

D. C. Luvizon, B. T. Nassu and R. Minetto, "A Video-Based System for Vehicle Speed Measurement in Urban Roadways," IEEE Transactions on Intelligent Transportation Systems, vol. 18, no. 6, pp. 1393 - 1404, June 2017.

M. Garg and S. Goel, "Real-Time License Plate Recognition and Speed Estimation from Video Sequences," ITSI Transactions on Electrical and Electronics Engineering (ITSI-TEEE), vol. 1, no. 5, pp. 1-4, 2013.

M. A. Massoud, M. Sabee, M. Gergais and R. Bakhit, "Automated new license plate recognition in Egypt," Alexandria Engineering Journal, vol. 52, no. 3, pp. 319-326, September 2013.

A. A. E. Senoussi Abdella, "Libyan Licenses Plate Recognition Using Template Matching Method," Journal of Computer and Communications, vol. 4, no. 7, pp. 62-71, May 2016.

S. S. Tabrizi and N. Cavus, "A Hybrid KNN-SVM Model for Iranian License Plate Recognition," Procedia Computer Science, vol. 102, pp. 588-594, 2016.

W. S. Chowdhury, A. R. Khan and J. Uddin, "Vehicle License Plate Detection Using Image Segmentation and Morphological Image Processing," in Advances in Signal Processing and Intelligent Recognition Systems. SIRS 2017, 2018.

Y.-Q. Yang, J. Bai, R.-L. Tian and N. Liu, "A vehicle license plate recognition system based on fixed color collocation," in 2005 International Conference on Machine Learning and Cybernetics, Guangzhou, 2005.

A. H. Ashtari , M. J. Nordin and M. Fathy, "An Iranian License Plate Recognition System Based on Color Features," IEEE Transactions on Intelligent Transportation Systems, vol. 15, no. 4, pp. 1690-1705, August 2014.

M. R. Asif, Q. Chun, S. Hussain, M. S. Fareed and S. Khan, "Multinational vehicle license plate detection in complex backgrounds," Journal of Visual Communication and Image Representation, vol. 46, pp. 176-186, 2017.

J. Matas and K. Zimmermann, "Unconstrained licence plate and text localization and recognition," in 2005 IEEE Intelligent Transportation Systems, Vienna, 2005.

N. More and B. Tidke, "License Plate Identification Using Artificial Neural Network and Wavelet Transformed Feature Selection," in 2015International Conference on Pervasive Computing (ICPC), Pune, 2015.

J. Sharma, A. Mishra, K. Saxena and S. Kumar, "A hybrid technique for License Plate Recognition based on feature selection of wavelet transform and artificial neural network," in 2014 International Conference on Reliability Optimization and Information Technology (ICROIT), Faridabad, 2014.

S. Roy and S. Rahman, "Emergency Vehicle Detection on Heavy Traffic Road from CCTV Footage Using Deep Convolutional Neural Network," in 2019 International Conference on Electrical, Computer and Communication Engineering (ECCE), Cox'sBazar, Bangladesh, 2019.

Y. Saadna and A. Behloul, "An overview of traffic sign detection and classification methods," International Journal of Multimedia Information Retrieval, vol. 6, no. 3, p. 193–210, September 2017. [19] H. Li , P. Wang and C. Shen , "Toward End-to-End Car License Plate Detection and Recognition With Deep Neural Networks," IEEE Transactions on Intelligent Transportation Systems, vol. 20, no. 3, pp. 1126-1136, March 2019.

J. Redmon, S. Divvala, R. Girshick and A. Farhadi, "You Only Look Once: Unified, Real-Time Object Detection," in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, 2016.

J. Redmon and A. Farhadi, "YOLO9000: Better, Faster, Stronger," in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, 2017.

R. Laroca, E. Severo, L. A. Zanlorensi, L. S. Oliveira, G. R. Gonçalves, W. R. Schwartz and D. Menotti, "A Robust Real-Time Automatic License Plate Recognition Based on the YOLO Detector," in 2018 International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, 2018.

S. M. Silva and C. R. Jung, "Real-Time Brazilian License Plate Detection and Recognition Using Deep Convolutional Neural Networks," in 2017 30th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Niteroi, 2017.

H. Li and C. Shen, "Reading Car License Plates Using Deep Convolutional Neural Networks and LSTMs," CoRR, vol. abs/1601.05610, 2016.

P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, Kauai, 2001.

W. G. Aguilar, M. A. Luna, J. F. Moya, V. Abad, H. Ruiz, H. Parra and W. Lopez, "Cascade Classifiers and Saliency Maps Based People Detection," in International Conference on Augmented Reality, Virtual Reality and Computer Graphics, 2017.

M. A. Chhajro, K. Kumar, A. Ahmed, M. Malook's, R. Hussain and H. N. Lashari, "Pedestrian Detection Approach for Driver Assisted System using Haar based Cascade Classifiers," International Journal of Advanced Computer Science and Applications, vol. 9, no. 6, pp. 111- 114, 2018 .

A. AbdelRaouf, C. A. Higgins, T. Pridmore and M. I. Khalil, "Arabic character recognition using a Haar cascade classifier approach (HCC)," Pattern Analysis and Applications, vol. 19, no. 2, p. 411–426, May 2016.

L. Barba-Guamán, P. A. Quezada-Sarmiento, C. Calderon-Cordova and J. P. Ordoñez López, "Detection of the characters from the license plates by cascade classifiers method," in 016 Future Technologies Conference (FTC), San Francisco, 2016.

E. Başer and Y. Altun, "Detection and classification of vehicles in traffic by using haar cascade classifier," in Proceedings of 58th ISERD International Conference, 2016 .

D.-Y. Huang, C.-H. Chen, T.-Y. Chen, W.-C. Hu and K.-W. Feng, "Vehicle detection and inter-vehicle distance estimation using singlelens video camera on urban/suburb roads," Journal of Visual Communication and Image Representation, vol. 46, pp. 250-259, 2017.

X. Chen, L. Liu, Y. Deng and X. Kong, "Vehicle detection based on visual attention mechanism and adaboost cascade classifier in intelligent transportation systems," Optical and Quantum Electronics, vol. 51, no. 8, August 2019.

A. Elbamby, E. E. Hemayed, D. Helal and M. Rehan, "Real-time automatic multi-style license plate detection in videos," in 2016 12th International Computer Engineering Conference (ICENCO), Cairo, 2016.

Y. Yuan, W. Zou, Y. Zhao , X. Wang, X. Hu and N. Komodakis, "A Robust and Efficient Approach to License Plate Detection," IEEE Transactions on Image Processing, vol. 26, no. 3, pp. 1102-1114, March 2017.

F. Ramazankhani and M. D. Yazdian, "Iranian License Plate Detection using Cascade Classifier," in 27th Iranian Conference on Electrical Engineering, Yazd, May 2019.

Y. Freund and R. E. Schapire, "A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting," Journal of Computer and System Sciences, vol. 55, no. 1, pp. 119-139, August 1997.

I. Gangopadhyay, A. Chatterjee and I. Das, "Face Detection and Expression Recognition Using Haar Cascade Classifier and Fisherface Algorithm," in Recent Trends in Signal and Image Processing. Advances in Intelligent Systems and Computing, Singapore, 2019.

N. Alsaeedi and D. Wloka, "Real-Time Eyeblink Detector and Eye State Classifier," sensors, vol. 19, no. 5, p. 1121, 2019.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.

ISSN: 2180-1843

eISSN: 2289-8131