Interpreter Glove With Gesture Recognition Ability For Dumb And Deaf Ones

  • Suryabhan Shaw
  • Archana Kumari
  • Samir Basak

Abstract

With the advent of wearable technology, it is now
possible to implement numerous and extremely creative ideas
to serve humanity in unprecedented ways. Thus inspired, we
have developed a smart system which would be more beneficial
for deaf and dumb ones. The primary goal of this paper is to
design and implement a low cost wired interactive glove,
interfaced with Arduino UNO, with a high degree of accuracy
for gesture recognition. The glove maps the orientation of
fingers with the help of flex sensors. The data is then
transmitted to the smartphone with the help of Bluetooth
module connected with arduino UNO. As, they have the ability
to see they do read and write. The system is modeled for the
differently abled section of the society to help convert sign
language to more human understandable and efficient form
such as interpretation or understandable voice/speech. As
nowadays, smartphones are playing a vital role in our lifestyle.
Thus inspired, we had developed an app which will interpret
on behalf of hearing and speech impaired ones. It will vocalize
the statement they write and do converts speech to text which
they can read. If they fall in some trouble, they can crave for
help just by making fist or using a hotkey integrated in the app
which will make sound of siren. If in some bad day they have
an accident, the smartphone finds an accidental shake and the
helping message with the location will be sent to registered
mobile number and the same message will be sent to
ambulance and an automatic call will go for emergency and
proper confirmation. This device will bridge the gap in
communication and helps them to grow their career.

Keywords: Gesture recognition, data glove, data extraction method, voice interpretation, Save Our Souls (SOS), speech to text, text to speech

References

[1] P.Garg, N. Aggarwal and S. Sofat, “Vision based hand gesture
recognition,” World Academy of Science,Engineering and
Technology, vol. 3, 2009.
[2] V. Pavlovic, R. Sharma and T. S. Huang, “Visual interpretation of
hand gestures for human-computer interaction: a review,” IEEE
Transactions on Pattern Analysis and Machine Intelligence, vol. 19,
no. 7, pp.677692, July 1997.
[3] P. Halarankar, S. Shah, H. Shah, H. Shah and J. Shah “Gesture
recognition technology: a review,” International Journal of
Engineering Science and Technology (IJEST), vol. 4, no 11, 2012.
[4] C. S. Fahn and H Sun, “Development of a sensory data glove using
neural-network-based calibration, ”Corrections of IC-AT 2000
Proceeding, pp 239 – 245, 2000.
[5] C. S. Ingulkar and A. N. Gaikwad, “Hand data glove: a wearable real
time device for human computer interaction,” International Journal
of Science and Engineering, vol. 1, pp-99-104, 2013.
[6] Abhishek Soni, Abhishek Kardak, Gokul K, “Missing sense a smart
glove for sign to speech/text conversion,” International Journal of
Multidisciplinary Research and Development, vol. 3, pp-327-329,
2016.
[7] https://learn.sparkfun.com/tutorials/flex-sensor-hookup-guide/all
Statistics
0 Views | 0 Downloads
How to Cite
Shaw, S., Kumari, A., & Basak, S. (2019). Interpreter Glove With Gesture Recognition Ability For Dumb And Deaf Ones. Asian Journal For Convergence In Technology (AJCT). Retrieved from http://asianssr.org/index.php/ajct/article/view/724
Section
Article

Most read articles by the same author(s)