ThreatNet: advanced threat detection, region-based convolutional neural network framework

Abstract

It is critical for many countries to ensure public safety in detecting and identifying threats in a night, commercial places, border areas and public places. Majority of past research in this area has focused on the use of image-level categorization and object-level detection techniques. As an X-ray and thermal security image analysis strategy, object separation can considerably improve automatic threat detection when used in conjunction with other techniques. In order to detect possible threats, the effects of introducing segmentation deep learning models into the threat detection pipeline of a large imbalanced X-ray and thermal dataset were investigated. With the purpose of boosting the number of true positives discovered, a faster regional convolutional neural network (R-CNN) model was trained on a balanced dataset to identify probable hazard zones in X-ray and thermal security pictures. In order to get the final results, we combined the two models i.e faster R-CNN with Mask RCNN into a single detection pipeline using the transfer learning technique, which outperforms baseline and end-to-end instance segmentation methods using less number of the practical dataset, with mAPs ranging from 94.88 percent to 91.40 percent helps in detecting the person with guns, knives, pliers to avoid cross border threats.