Bee-inspired knowledge transfer: synthesizing data for enhanced deep learning explainability

Abstract

This paper presents the generation method for an explainable model based on the given information of a black box model using a concept of knowledge transfer to synthesize a dataset. The proposed method applies with GAN and Bee algorithm (BA) for data synthesis technique to synthesize a dataset by considering loss value in a knowledge transferring process to inherit the significance of features. The synthesized dataset is used to train for a proxy model as an explainable model. The result of the experiment indicates that knowledge transfer from Bee algo better than generative adversarial network (GAN) in terms of the coefficient of determination R2. In addition, explainable models from the synthesized data of the Bee-based method obtains F1 score superior to those from the GAN-based method in all datasets and settings. The dataset synthesized from the Bee-based method produces the explainable prediction model that has similar top-10 features according to similarity score of 0.6718 using shapley additive explanations (SHAP) feature importance which is higher than those from GAN-based method for 0.4218 in average. Additionally, experimental result to evaluate accuracy shows that F1 score from explainable models from the Bee-based method are closed to F1 score from a model generated from the original dataset.