Manuscript Number : SHISRRJ20313

Speech Generation Using Kinect Devices Using NLP

Authors(1) :-D. Suganthi

Various new technologies and aiding instruments are always being introduced for the betterment of the challenged. This project focuses on aiding the mute in expressing their views and ideas in a much efficient and effective manner thereby creating their own place in this world. The proposed system focuses on using various gestures traced into texts which could in turn be transformed into speech. The gesture identification and mapping is performed by the Kinect device, which is found to cost effective and reliable. A suitable text to speech convertor is used to translate the texts generated from Kinect into a speech. The proposed system though cannot be applied to man-to-man conversation owing to the hardware complexities, but could find itself very much of use under addressing environments such as auditoriums, classrooms.

Authors and Affiliations

D. Suganthi
M. Tech Scholar, College of Engineering, Anna University, Guindy Campus, Chennai, Tamilnadu, India

Kinect, Gestures, Speech Synthesizers, Text to Speech Converter.

  1. Mauro dos Santos Anjo, Ednaldo Brigante Pizzolato, Sebastian Feuerstack "A Real-Time System to Recognize Static Gestures of Brazilian Sign Language (Libras) alphabet using Kinect", IHC 2012 proceedings.
  2. K. K. Biswas and Saurav Kumar Basu "Gesture Recognition using Microsoft Kinect", 2012, unpublished.
  3. Yi Li "Hand Recognition using Kinect", 2012, unpublished.
  4. Belinda Lange, Skip Rizzo, Chien Yen Chang, Evan A. Suma, Mark "Markerless Full Body Tracking: Depth- Sensing Technology within Virtual Environments", Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), 2011.
  5. Mohamed Alsheakhali, Ahmed Skaik, Mohammed Aldahdouh and Mahmoud Alhelou "Hand Gesture Recognition System", 2011, Intelligent Approaches to interact with Machines proceedings.
  6. Ankit Chaudhary, J. L. Raheja, Karen Das, Sonia Raheja, "Using Hand Gesture Recognition in Natural way: A Survey", International Journal of Computer Science & Engineering Survey (IJCSES) Vol.2, No.1, Feb 2011.
  7. Archana S. Ghotkar and Gajanan K. Kharate, "Hand Segmentation Techniques to Hand Gesture Recognition for Natural Human Computer Interaction", International Journal of Human Computer Interaction (IJHCI), Volume (3): Issue (1), 2012.
  8. Xi Chen and Markus Koskela, "Skeleton-Based Action Recognition with Extreme Learning Machines", ELM2013 23 October 2013.
  9. Chanjira Sinthanayothin, Nonlapas Wongwaen and Wisarut Bholsithi, "Skeleton Tracking using Kinect Sensor & Displaying in 3D Virtual Scene", International Journal of Advancements in Computing Technology(IJACT), Volume4, Number11, June 2012.
  10. Georgios Th. Papadopoulos, Apostolos Axenopoulos and Petros Daras, "Real-time Skeleton-tracking-based Human, Action Recognition Using Kinect Data", 2013.
  11. Abhishek Kar, "Skeletal Tracking using Microsoft Kinect", 2013, unpublished.
  12. Najeefa Nikhat Choudhury and Golam Kayas,"Automatic Recognition of Bangla Sign Language",2012, unpublished.
  13. G Tao, PS Archambault and MF Levin, "Evaluation of Kinect skeletal tracking in a virtual reality rehabilitation system for upper limb hemiparesis", Virtual Rehabilitation (ICVR), 2013.
  14. Alessandro De Mauro, "Virtual Reality Based Rehabilitation and Game Technology", EICS4Med, 2011.
  15. Jiann-Der Lee, Chung-Hung Hsieh and Ting-Yang Lin, "A Kinect-based Tai Chi exercises evaluation system for physical rehabilitation", Consumer Electronics (ICCE), 2014.
  16. Bengalur, "Human activity recognition using body pose features and support vector machine", Advances in Computing, Communications and Informatics (ICACCI), 2013.
  17. Helten T. Muller M. Seidel H. P. and Theobalt, C., "Real-Time Body Tracking with One Depth Camera and Inertial Sensors", Computer Vision (ICCV), 2013.

Publication Details

Published in : Volume 3 | Issue 1 | January-February 2020
Date of Publication : 2020-01-30
License:  This work is licensed under a Creative Commons Attribution 4.0 International License.
Page(s) : 23-29
Manuscript Number : SHISRRJ20313
Publisher : Shauryam Research Institute

ISSN : 2581-6306

Cite This Article :

D. Suganthi, "Speech Generation Using Kinect Devices Using NLP", Shodhshauryam, International Scientific Refereed Research Journal (SHISRRJ), ISSN : 2581-6306, Volume 3, Issue 1, pp.23-29, January-February.2020
URL : https://shisrrj.com/SHISRRJ20313

Article Preview