Sign language detection using convolutional neural network for teaching and learning application

Wan Mohd Yaakob Wan Bejuri, Nur’Ain Najiha Zakaria, Mohd Murtadha Mohamad, Warusia Mohamed Yassin, Sharifah Sakinah Syed Ahmad, Ngo Hea Choon

Abstract


Teaching lower school mathematic could be easy for everyone. For teaching in the situation that cannot speak, using sign language is the answer especially someone that have infected with vocal cord infection or critical spasmodic dysphonia or maybe disable people. However, the situation could be difficult, when the sign language is not understandable by the audience. Thus, the purpose of this research is to design a sign language detection scheme for teaching and learning activity. In this research, the image of hand gestures from teacher or presenter will be taken by using a web camera for the system to anticipate and display the image's name. This proposed scheme will detects hand movements and convert it be meaningful information. As a result, it show the model can be the most consistent in term of accuracy and loss compared to others method. Furthermore, the proposed algorithm is expected to contribute the body of knowledge and the society.

Keywords


Convolution neural network; Hand gestures; Image processing; ROI; Sign language detection

Full Text:

PDF


DOI: http://doi.org/10.11591/ijeecs.v28.i1.pp358-364

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Indonesian Journal of Electrical Engineering and Computer Science (IJEECS)
p-ISSN: 2502-4752, e-ISSN: 2502-4760
This journal is published by the Institute of Advanced Engineering and Science (IAES) in collaboration with Intelektual Pustaka Media Utama (IPMU).

shopify stats IJEECS visitor statistics