Fused Faster RCNNs for Efficient Detection of the License Plates

Diyar Qader Sallem


Automatic License Plate Detection and Recognition (ALPD-R) is an important application for traffic surveillance, traffic safety, security, services purposes and parking management. Generally, traditional image processing routines have been used in ALPD-R. In this paper, the Deep Learning (DL) is used to detect license plates in given images. More specifically, the Faster Regions with Convolutional Neutral Network (Faster- RCNN) architecture is used due to its various advantages. The proposed license plate detection method uses three Faster- RCNN modules where each faster RCNN module uses a pre-trained CNN models namely AlexNet, VGG16 and VGG19. Each Faster-RCNN module is trained independently and their results are fused in fusing layer. Fusing layer use average operator on the X and Y coordinates of the outputs of the Faster-RCNN modules and maximum operator is employed on the width and height outputs of the Faster-RCNN modules. A publicly available dataset is used in experiments. The accuracy is used as a performance indicator of the proposed method. For 100 testing images, the proposed method detects the exact location of license plates for 97 images. The accuracy of the proposed method is 97%.


License plate detection Deep learning Faster- RCNN Vehicle images


Zeebaree, D. Q., Haron, H., and Abdulazeez, A. M., “Gene Selection and Classification of Microarray Data Using Convolutional Neural Network,” presented at the International Conference on Advanced Science and Engineering (ICOASE) (pp. 145-150). IEEE., 2018.

M. S. Al-Shemarry, Y. Li, and S. Abdulla, “An efficient texture descriptor for the detection of license plates from vehicle images in difficult conditions,” IEEE Trans. Intell. Transp. Syst., 2019.

Y. Yuan, W. Zou, Y. Zhao, X. Wang, X. Hu, and N. Komodakis, “A robust and efficient approach to license plate detection,” IEEE Trans. Image Process., vol. 26, no. 3, pp. 1102–1114, 2016.

B. V. Kakani, D. Gandhi, and S. Jani, “Improved OCR based automatic vehicle number plate recognition using features trained neural network,” presented at the 2017 8th International Conference on Computing, Communication and Networking Technologies (ICCCNT), 2017, pp. 1–6.

B. Singh, M. Kaur, D. Singh, and G. Singh, “Automatic number plate recognition system by character position method,” Int J Comput Vis. Robot, vol. 6, no. 1/2, pp. 94–112, 2016.

H. Li and C. Shen, “Reading car license plates using deep convolutional neural networks and lstms,” ArXiv Prepr. ArXiv160105610, 2016.

N. Sulaiman, S. N. H. M. Jalani, M. Mustafa, and K. Hawari, “Development of automatic vehicle plate detection system,” presented at the 2013 IEEE 3rd International Conference on System Engineering and Technology, 2013, pp. 130–135.

M. A. Lalimi, S. Ghofrani, and D. McLernon, “A vehicle license plate detection method using region and edge based methods,” Comput. Electr. Eng., vol. 39, no. 3, pp. 834–845, 2013.

P. Afeefa and P. P. Thulasidharan, “Automatic License Plate Recognition (ALPR) using HTM cortical learning algorithm,” presented at the 2017 International Conference on Intelligent Computing and Control (I2C2), 2017, pp. 1–4.

L. Jin, H. Xian, J. Bie, Y. Sun, H. Hou, and Q. Niu, “License plate recognition algorithm for passenger cars in Chinese residential areas,” Sensors, vol. 12, no. 6, pp. 8355–8370, 2012.

T. Ajanthan, P. Kamalaruban, and R. Rodrigo, “Automatic number plate recognition in low quality videos,” presented at the 2013 IEEE 8th International Conference on Industrial and Information Systems, 2013, pp. 566–571.

Y. Zhao, J. Gu, C. Liu, S. Han, Y. Gao, and Q. Hu, “License plate location based on haar-like cascade classifiers and edges,” presented at the 2010 Second WRI Global Congress on Intelligent Systems, 2010, vol. 3, pp. 102–105.

D. Zang, Z. Chai, J. Zhang, D. Zhang, and J. Cheng, “Vehicle license plate recognition using visual attention model and deep learning,” J. Electron. Imaging, vol. 24, no. 3, p. 033001, 2015.

P. Prabhakar, P. Anupama, and S. Resmi, “Automatic vehicle number plate detection and recognition,” presented at the 2014 International Conference on Control, Instrumentation, Communication and Computational Technologies (ICCICCT), 2014, pp. 185–190.

P. Patil, C. Kanagasabapathi, and S. S. Yellampalli, “Automatic number plate recognition system for vehicle identification,” presented at the 2017 International Conference on Electrical, Electronics, Communication, Computer, and Optimization Techniques (ICEECCOT), 2017, pp. 431–434.

W. T. Ho, H. W. Lim, and Y. H. Tay, “Two-stage license plate detection using gentle Adaboost and SIFT-SVM,” presented at the 2009 First Asian Conference on Intelligent Information and Database Systems, 2009, pp. 109–114.

S. Ktata, F. Benzarti, and H. Amiri, “License plate localization using Gabor filters and neural networks,” J. Comput. Sci., vol. 9, no. 10, p. 1341, 2013.

S. Kim, H. Jeon, and H. Koo, “Deep-learning-based license plate detection method using vehicle region extraction,” Electron. Lett., vol. 53, no. 15, pp. 1034–1036, 2017.

S. Z. Masood, G. Shu, A. Dehghan, and E. G. Ortiz, “License plate detection and recognition using deeply learned convolutional neural networks,” ArXiv Prepr. ArXiv170307330, 2017.

S. Azam and M. M. Islam, “Automatic license plate detection in hazardous condition,” J. Vis. Commun. Image Represent., vol. 36, pp. 172–186, 2016.

A. Naimi, Y. Kessentini, and M. Hammami, “Multi-nation and multi-norm license plates detection in real traffic surveillance environment using deep learning,” presented at the International Conference on Neural Information Processing, 2016, pp. 462–469.

S. Ren, K. He, R. Girshick, and J. Sun, “Faster r-cnn: Towards real-time object detection with region proposal networks,” presented at the Advances in neural information processing systems, 2015, pp. 91–99.

J. E. Espinosa, S. A. Velastin, and J. W. Branch, “Vehicle detection using alex net and faster R-CNN deep learning models: a comparative study,” presented at the International Visual Informatics Conference, 2017, pp. 3–15.

R. Girshick, “Fast r-cnn,” presented at the Proceedings of the IEEE international conference on computer vision, 2015, pp. 1440–1448.

H. Qassim, A. Verma, and D. Feinzimer, “Compressed residual-VGG16 CNN model for big data places image recognition,” presented at the 2018 IEEE 8th Annual Computing and Communication Workshop and Conference (CCWC), 2018, pp. 169–175.

LPDatabase. Accessed: Jul. 2016. [Online]. Available: http://www.zemris.fer.hr/projects/LicensePlates/english/


DOI: http://doi.org/10.11591/ijeecs.v19.i2.pp%25p
Total views : 16 times


  • There are currently no refbacks.

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

shopify stats IJEECS visitor statistics