An integrated multi-level feature fusion framework for crowd behaviour prediction and analysis

Abstract

The uncontrolled outburst in population has led to crowd gatherings in various public places causing panic and disaster in certain unpleasant and extreme conditions. A study on the analysis of crowd accumulation has been carried out for various reasons that include management of crowd, design of a well-planned public space, the possibility for surveillance at every area and transportation systems. A lot of disasters also occurs due to uncontrollable crowd behaviour and poor crowd management. It could result in loss of property, fatalities or casualties. To avoid this, the conduct of a crowd of people has been studied and analyzed to control their movement and traffic. Hence, in this research work, integrated multi-level feature fusion (IMFF) framework is designed to predict the behaviour; further classification based on the local region is carried out to enhance the prediction. In the case of multi-level feature fusion; first level feature fusion utilizes the motion and appearance; second-level feature fusion utilizes the spatial connection and third-level utilizes the temporal connections. Further, the classification approach is integrated based on the local region is used to enhance the crowd behaviour prediction in terms of accuracy and faster. Moreover, performance evaluation is carried out considering the two distinctive datasets.