13 Abstract

SIGN TO SPEECH CONVERTE GLOVES FOR DEAF AND DUMB PEOPLE ABSTRACT Speech and gestures are expressions, which are mostly used in communication between human beings getting the data is the first step. The second step is that recognizing the sign or gesture once it has been captured is much more challenging, especially in a continuous stream. In fact currently, this is the focus of the research. The objective of this project is to design a simple embedded system based communicating device for deaf and dumb people. In our day to day life most of the task we carryout involves speaking and hearing. The deaf and dumb or paralyzed people have difficulty in communicating with others who cannot understand sign language and miss-interpreters. In this project, we designed a simple embedded system based device for solving this problem.

Existing Method: 

A sign language is a language, which uses hand gestures, and body movement to convey meaning,as opposed to accoustically conveyed sound patterns.



Research in the sign language system has two well known approaches are image processing technique and a data glove.



The image processing technique uses the camera to capture the image or video, andanother approach is sign language recognition system using a data glove.

Drawbacks of Existing Method: 

The main drawback of vision based sign language recognition system image acquisition process has many environmental apprehensions such as the place of the camera, background condition,and lightning sensitivity.The user always needs camera forever and cannot implement it in public place.



By using data glove approach, detection of hand is eliminated by the sensor glove consists of a flex sensor an accelerometer.

Proposed Method: In this, we have suggested a wearable glove for people who face difficulty in communicating verbally due to various different reasons (be it deaf or dumb), so that with the possession of this device, they can exhibit their basic requirements via their gestures and those gestures will be converted to speech for the hearer to understand what is he or she trying to say. In this system, MEMS (Micro Electro Mechanical systems) will be connected to the dumb person’s hand. The moment person gives the signs, MEMS sensor X, Y & Z values vary for each and every sign. Based on those signs controller reads the data of X, Y & Z and as per software program it commands Voice module pins. APR9600 is the voice module which can be able to store and play back upto 8 different voices. LCD can be used to display the functionality of the whole system. Arduino UNO is the microcontroller which plays main role of the system.

BLOCK DIAGRAM:

HARDWARE REQUIREMENTS: 1. ARDUNIO UNO CONTROLLER - 1 2. POWER SUPPLY - 1 3. LCD - 1 4. MEMS (Micro Electro Mechanical systems) – 1 5. VOICE PLAY BACK MODULE(APR9600) – 1 6. SPEAKER - 1

SOFTWAREREQUIREMENTS: 1. ARDUINO-C LANGUAGE 2. ARDUINO – IDE

Advantages:



The text and voice output being in English. So, this device provides efficient way of communication for both deaf-dumb and normal people.



Requires fewer components so its cost is low.



It is economical.



It is small in size; due to the small size we can place its hardware on our hand easily.



The whole apparatus carries less weight. Hence they are portable and flexible to users.



The use of this glove eliminates the necessity to learn sign language forcommunication with speech and hearing impaired.

Disadvantages: 

Requires well structured hardware



Requires reliable sensors to work accurately for long time.

Applications: 

A Smart Glove Controller is designed which senses hand movement, andprograms it to recognize a set of predefined gestures, for use in sign language to speech translation applications.



For disabled people.

Under the guidance of: Ravindra Reddy sir.

By: D. Haritha, R. Moshini, M. Joy Pradeepa, S. Jaya Surya.