SlideShare a Scribd company logo
1 of 27
Download to read offline
Silent Sound
Technology (SST)
OVERVIEW
Introduction
Methods
Applications
Conclusion
Silent Sound………?
“talking without talking”
What is SST?
It is a technology that helps to transmit information
without using our vocal cords.
Aims to observe our silent speech and transform it into
text/audio output.
The software can be installed in wrist tag/ display,
mobile or PC.
“What happens if we don’t communicate? Suddenly we
lose our voice during an accident……”
 Helps those who had lost their voice but wish to speak.
 Output can be routed to communication networks.
 People can speak over phone without disturbing others.
 Also can speak in noisy environment.
Why Needed........?
 Idea was popularized in the 1968 Stanley Kubrick’s science
fiction film ‘‘2001 – A Space Odyssey ” (Using Electronic signals)
 US space agency Nasa has investigated the technique for
communicating in noisy environments such as the Space Station.
 SST was demonstrated in the year 2010 at CeBIT’s “future
park”, one of the largest trade fair.
 This technology is being developed at Karlsruhe Institute of
Technology ( KIT ), Germany.
 Wand and Tanja Shultz
Origin
METHODS
ELECTROMYOGRAPHY
IMAGE PROCESSING
ELECTROMYOGRAPHY(EMG)
A technique for evaluating and recording the electrical
activity produced by skeletal muscles.
It detects the electrical potential generated by muscle
cells, when these cells are electrically or neurologically
activated.
Performed using instrument called an electromyograph,
to produce a record called an electromyogram.
signals can be analyzed to detect medical abnormalities.
How can We Speak….?
When we generally speak aloud, air passes through
larynx or vocal cord & the tongue.
 Words are produced using articulator muscle in the
mouth & jaw region.
EMG in SST
Process….
monitor tiny muscular movements that occur when we speak.
Monitored signals are converted into electrical pulses that can
then be turned into speech, without a sound uttered.
Fig: Electromyography activity
DRAWBACKS
Device presently needs nine leads to be attached to our
face which is quite impractical to make it usable.
It’s little painful.
Translation to Chinese language is a bit difficult.
Not portable
Image processing In SST
A device oriented package to design and implement for the
purpose of lip reading.
It works based on our silent speech.
It can recognize words, single sentence or even continuous
sentences of people of different region.
Device consider our non-speech accent and pronunciation
by observing every movement of our lip and facial Expression
Terms………
Region of Interest(ROI)
Skin segmentation
Face detection
Lip detection
Lip contour
Key points
Facial features
Lip tracking
Fig1:Key points
Fig2:Lip contour
with key points
Silent sound technology
Face Detection
Perform Lighting Compensation on image.
Extract skin region and remove all the noisy data.
Check for face criterions.
Skin colour blocks are identified.
Height and width ratio (1.5 and 0.8) computed and
Minimal face dimension constrained is implemented.
Crop the current region.
Skin Segmentation
One of the important steps in face feature extraction.
Colour segmentation of human face depends on the
colour space that is selected.
Skin colours of different people are closely grouped in
normalized RG colour plane ( by Yang and Waibel).
Search for the pixels which are close enough to this
spread .
Normalized RG colour plane
Active Shape Models
a)Original image
d)Active shape of face
Used to detect face in the captured video.
Shape model is formed from a set of
manually annotated shape of faces:
•Align all shapes of the learning data to an
arbitrary reference by geometric
transformation.
•Calculate average shape .
Model positioned on the face.
Iteratively deformed until it sticks to the
face in respective bounding boxes
Mouth region Localization.
Face Detection
VideoFileReader('path')
Reads video frame by frame
CascadeObjectDetector('FrontalFaceLBP')
Creates a detector for face
activecontour(A,mask,method)
Detect active contour inside face region .Here active contour is lip (i.e..
major difference region).
centroidColumn(X), centroidRow(Y) – centroid point
Middlerow,middlecolumn– minor and major axis lines of lip contour
Contour fitting point location
Key points
topRowY = find(middleColumn, 1, 'first');
centroidColumn, topRowY -this gives top
bottomRowY = find(middleColumn, 1, 'last');
centroidColumn, bottomRowY -this gives bottom
leftColumnX = find(middleRow, 1, 'first');
leftColumnX, centroidRow -this gives left
rightColumnX= find(middleRow, 1, 'last');
rightColumnX, centroidRow -this gives right
1.Live video 2.ROI video
3.Facial features
detected live video
4.Lip during motion with perimeter
contour and key points
5.Multi Image montage(28 frames)6.Threshold Analysis
Applications
People can communicate in different languages by translating
the output of SST.
 Helps to Analyse and understand the people who have lost voice
to speak or stuttering problem.
Silent Sound Techniques is applied in Military for communicating
secret/confidential matters to others.
Helps people to make silent calls during meetings/ in mass
crowded places.
User can tell PIN no., credit card no., password and other
personals without bothering some eavesdroppers.
Software can be installed in wrist watch, wrist tag or
display/Mobile/Pc and etc.
Conclusion
The software is being trained based on the lip structure, complexion
and features of the lip area.
Provide easier mode of communication for people with speech
disabilities by converting the identified lip movements directly to
speech.
Software can be integrated onto mobile oriented or hand-held
devices.
Lip read for Chinese language Mandarin is highly personalized.
Systems are still preliminary need improvement.
REFERERENCES
Pradeep B.S. And Zhang Jingang , “Silent Sound Technology for
Mandarin”.
Sasikumar Gurumurthy and B.K.Tripathy , “Design and
Implementation of Face Recognition System in Matlab Using the
Features of Lips”.
Evangelos Skodras and Nikolaos Fakotakis , “An Unconstrained
Method for Lip Detection in Color Images”.
Priya Jethani and Bharat Choudhari , “Silent Sound Technology: A
Solution to Noisy Communication”.
Queries
?

More Related Content

What's hot

Abstract Silent Sound Technology
Abstract   Silent Sound TechnologyAbstract   Silent Sound Technology
Abstract Silent Sound Technologyvishnu murthy
 
Silentsound documentation
Silentsound documentationSilentsound documentation
Silentsound documentationRaj Niranjan
 
Silent Sound Technology
Silent Sound TechnologySilent Sound Technology
Silent Sound TechnologyMoumita132
 
Silent sound technology
Silent sound technologySilent sound technology
Silent sound technologypriya_trehan
 
Silent sound technology_powerpoint
Silent sound technology_powerpointSilent sound technology_powerpoint
Silent sound technology_powerpointAmitt Arrsh
 
Silent sound-technology ppt final
Silent sound-technology ppt finalSilent sound-technology ppt final
Silent sound-technology ppt finalLohit Dalal
 
silent sound new by RAJ NIRANJAN
silent sound new by RAJ NIRANJANsilent sound new by RAJ NIRANJAN
silent sound new by RAJ NIRANJANRaj Niranjan
 
Silent sound technology- Technology towards change.
Silent sound technology- Technology towards change.Silent sound technology- Technology towards change.
Silent sound technology- Technology towards change.Suman Savanur
 
silent sound technology
silent sound technologysilent sound technology
silent sound technologykamesh0007
 
silent sound technology final report(17321A0432) (1).pdf
silent sound technology final report(17321A0432) (1).pdfsilent sound technology final report(17321A0432) (1).pdf
silent sound technology final report(17321A0432) (1).pdfssuser476810
 
silent sound technology
silent sound technologysilent sound technology
silent sound technologyNajeeb p
 
Silent sound technology
Silent sound technologySilent sound technology
Silent sound technologyJeet Das
 
Silent Sound Technology
Silent Sound TechnologySilent Sound Technology
Silent Sound TechnologyHafiz Sanni
 
SILENT SOUND TECHNOLOGY
SILENT SOUND TECHNOLOGYSILENT SOUND TECHNOLOGY
SILENT SOUND TECHNOLOGYNagma Parween
 
Silent sound interface
Silent sound interfaceSilent sound interface
Silent sound interfaceJeevitha Reddy
 
Silent sound technology
Silent sound technologySilent sound technology
Silent sound technologyjayanthch
 

What's hot (20)

Abstract Silent Sound Technology
Abstract   Silent Sound TechnologyAbstract   Silent Sound Technology
Abstract Silent Sound Technology
 
Silentsound documentation
Silentsound documentationSilentsound documentation
Silentsound documentation
 
Silent Sound Technology
Silent Sound TechnologySilent Sound Technology
Silent Sound Technology
 
Silent sound technology
Silent sound technologySilent sound technology
Silent sound technology
 
Silent sound technology
Silent sound technologySilent sound technology
Silent sound technology
 
Silent sound technology_powerpoint
Silent sound technology_powerpointSilent sound technology_powerpoint
Silent sound technology_powerpoint
 
Silent sound-technology ppt final
Silent sound-technology ppt finalSilent sound-technology ppt final
Silent sound-technology ppt final
 
Silent Sound Technology
Silent Sound TechnologySilent Sound Technology
Silent Sound Technology
 
silent sound new by RAJ NIRANJAN
silent sound new by RAJ NIRANJANsilent sound new by RAJ NIRANJAN
silent sound new by RAJ NIRANJAN
 
Silent sound technology- Technology towards change.
Silent sound technology- Technology towards change.Silent sound technology- Technology towards change.
Silent sound technology- Technology towards change.
 
silent sound technology
silent sound technologysilent sound technology
silent sound technology
 
silent sound technology final report(17321A0432) (1).pdf
silent sound technology final report(17321A0432) (1).pdfsilent sound technology final report(17321A0432) (1).pdf
silent sound technology final report(17321A0432) (1).pdf
 
Silent Sound
Silent SoundSilent Sound
Silent Sound
 
silent sound technology
silent sound technologysilent sound technology
silent sound technology
 
Silent sound technology
Silent sound technologySilent sound technology
Silent sound technology
 
Silent Sound Technology
Silent Sound TechnologySilent Sound Technology
Silent Sound Technology
 
SILENT SOUND TECHNOLOGY
SILENT SOUND TECHNOLOGYSILENT SOUND TECHNOLOGY
SILENT SOUND TECHNOLOGY
 
Silent sound interface
Silent sound interfaceSilent sound interface
Silent sound interface
 
Voice morphing-
Voice morphing-Voice morphing-
Voice morphing-
 
Silent sound technology
Silent sound technologySilent sound technology
Silent sound technology
 

Similar to Silent sound technology

Seminar PPT - Shreya Suroliya.pptx
Seminar PPT - Shreya Suroliya.pptxSeminar PPT - Shreya Suroliya.pptx
Seminar PPT - Shreya Suroliya.pptxchiragsharmaa36
 
Silent-Sound-Technology-PPT.pptx
Silent-Sound-Technology-PPT.pptxSilent-Sound-Technology-PPT.pptx
Silent-Sound-Technology-PPT.pptxomkarrekulwar
 
A survey on Enhancements in Speech Recognition
A survey on Enhancements in Speech RecognitionA survey on Enhancements in Speech Recognition
A survey on Enhancements in Speech RecognitionIRJET Journal
 
IRJET - Sign Language Text to Speech Converter using Image Processing and...
IRJET -  	  Sign Language Text to Speech Converter using Image Processing and...IRJET -  	  Sign Language Text to Speech Converter using Image Processing and...
IRJET - Sign Language Text to Speech Converter using Image Processing and...IRJET Journal
 
Paper id 23201490
Paper id 23201490Paper id 23201490
Paper id 23201490IJRAT
 
PERFORMANCE EVALUATION AND IMPLEMENTATION OF FACIAL EXPRESSION AND EMOTION R...
PERFORMANCE EVALUATION AND IMPLEMENTATION  OF FACIAL EXPRESSION AND EMOTION R...PERFORMANCE EVALUATION AND IMPLEMENTATION  OF FACIAL EXPRESSION AND EMOTION R...
PERFORMANCE EVALUATION AND IMPLEMENTATION OF FACIAL EXPRESSION AND EMOTION R...Akhil Upadhyay
 
Sign language converter
Sign language converterSign language converter
Sign language converterIJCSES Journal
 
207952_VIJAY_MCA.ppt
207952_VIJAY_MCA.ppt207952_VIJAY_MCA.ppt
207952_VIJAY_MCA.pptvijay518229
 
finger gesture (1).docx
finger gesture (1).docxfinger gesture (1).docx
finger gesture (1).docxKavitaMishra49
 
Robot social design -Facial expressions
Robot social design -Facial expressionsRobot social design -Facial expressions
Robot social design -Facial expressionsinventy
 
FACE DETECTION AND FEATURE EXTRACTION FOR FACIAL EMOTION DETECTION
FACE DETECTION AND FEATURE EXTRACTION FOR FACIAL EMOTION DETECTIONFACE DETECTION AND FEATURE EXTRACTION FOR FACIAL EMOTION DETECTION
FACE DETECTION AND FEATURE EXTRACTION FOR FACIAL EMOTION DETECTIONvivatechijri
 
Incremental Difference as Feature for Lipreading
Incremental Difference as Feature for LipreadingIncremental Difference as Feature for Lipreading
Incremental Difference as Feature for LipreadingIDES Editor
 
Feature Extraction of Gesture Recognition Based on Image Analysis for Differe...
Feature Extraction of Gesture Recognition Based on Image Analysis for Differe...Feature Extraction of Gesture Recognition Based on Image Analysis for Differe...
Feature Extraction of Gesture Recognition Based on Image Analysis for Differe...IJERA Editor
 
Feature Extraction of Gesture Recognition Based on Image Analysis for Differe...
Feature Extraction of Gesture Recognition Based on Image Analysis for Differe...Feature Extraction of Gesture Recognition Based on Image Analysis for Differe...
Feature Extraction of Gesture Recognition Based on Image Analysis for Differe...IJERA Editor
 
Human Computer Interface Glove for Sign Language Translation
Human Computer Interface Glove for Sign Language TranslationHuman Computer Interface Glove for Sign Language Translation
Human Computer Interface Glove for Sign Language TranslationPARNIKA GUPTA
 
Paper id 24201453
Paper id 24201453Paper id 24201453
Paper id 24201453IJRAT
 

Similar to Silent sound technology (20)

Seminar PPT - Shreya Suroliya.pptx
Seminar PPT - Shreya Suroliya.pptxSeminar PPT - Shreya Suroliya.pptx
Seminar PPT - Shreya Suroliya.pptx
 
Silent-Sound-Technology-PPT.pptx
Silent-Sound-Technology-PPT.pptxSilent-Sound-Technology-PPT.pptx
Silent-Sound-Technology-PPT.pptx
 
A survey on Enhancements in Speech Recognition
A survey on Enhancements in Speech RecognitionA survey on Enhancements in Speech Recognition
A survey on Enhancements in Speech Recognition
 
IRJET - Sign Language Text to Speech Converter using Image Processing and...
IRJET -  	  Sign Language Text to Speech Converter using Image Processing and...IRJET -  	  Sign Language Text to Speech Converter using Image Processing and...
IRJET - Sign Language Text to Speech Converter using Image Processing and...
 
Paper id 23201490
Paper id 23201490Paper id 23201490
Paper id 23201490
 
PERFORMANCE EVALUATION AND IMPLEMENTATION OF FACIAL EXPRESSION AND EMOTION R...
PERFORMANCE EVALUATION AND IMPLEMENTATION  OF FACIAL EXPRESSION AND EMOTION R...PERFORMANCE EVALUATION AND IMPLEMENTATION  OF FACIAL EXPRESSION AND EMOTION R...
PERFORMANCE EVALUATION AND IMPLEMENTATION OF FACIAL EXPRESSION AND EMOTION R...
 
183
183183
183
 
Sign language converter
Sign language converterSign language converter
Sign language converter
 
207952_VIJAY_MCA.ppt
207952_VIJAY_MCA.ppt207952_VIJAY_MCA.ppt
207952_VIJAY_MCA.ppt
 
finger gesture (1).docx
finger gesture (1).docxfinger gesture (1).docx
finger gesture (1).docx
 
Robot social design -Facial expressions
Robot social design -Facial expressionsRobot social design -Facial expressions
Robot social design -Facial expressions
 
FACE DETECTION AND FEATURE EXTRACTION FOR FACIAL EMOTION DETECTION
FACE DETECTION AND FEATURE EXTRACTION FOR FACIAL EMOTION DETECTIONFACE DETECTION AND FEATURE EXTRACTION FOR FACIAL EMOTION DETECTION
FACE DETECTION AND FEATURE EXTRACTION FOR FACIAL EMOTION DETECTION
 
Poster02
Poster02Poster02
Poster02
 
Incremental Difference as Feature for Lipreading
Incremental Difference as Feature for LipreadingIncremental Difference as Feature for Lipreading
Incremental Difference as Feature for Lipreading
 
Feature Extraction of Gesture Recognition Based on Image Analysis for Differe...
Feature Extraction of Gesture Recognition Based on Image Analysis for Differe...Feature Extraction of Gesture Recognition Based on Image Analysis for Differe...
Feature Extraction of Gesture Recognition Based on Image Analysis for Differe...
 
Feature Extraction of Gesture Recognition Based on Image Analysis for Differe...
Feature Extraction of Gesture Recognition Based on Image Analysis for Differe...Feature Extraction of Gesture Recognition Based on Image Analysis for Differe...
Feature Extraction of Gesture Recognition Based on Image Analysis for Differe...
 
HandOVRS p-report
HandOVRS p-reportHandOVRS p-report
HandOVRS p-report
 
Human Computer Interface Glove for Sign Language Translation
Human Computer Interface Glove for Sign Language TranslationHuman Computer Interface Glove for Sign Language Translation
Human Computer Interface Glove for Sign Language Translation
 
2014etc016
2014etc0162014etc016
2014etc016
 
Paper id 24201453
Paper id 24201453Paper id 24201453
Paper id 24201453
 

Recently uploaded

Engineering Mechanics Chapter 5 Equilibrium of a Rigid Body
Engineering Mechanics  Chapter 5  Equilibrium of a Rigid BodyEngineering Mechanics  Chapter 5  Equilibrium of a Rigid Body
Engineering Mechanics Chapter 5 Equilibrium of a Rigid BodyAhmadHajasad2
 
Summer training report on BUILDING CONSTRUCTION for DIPLOMA Students.pdf
Summer training report on BUILDING CONSTRUCTION for DIPLOMA Students.pdfSummer training report on BUILDING CONSTRUCTION for DIPLOMA Students.pdf
Summer training report on BUILDING CONSTRUCTION for DIPLOMA Students.pdfNaveenVerma126
 
solar wireless electric vechicle charging system
solar wireless electric vechicle charging systemsolar wireless electric vechicle charging system
solar wireless electric vechicle charging systemgokuldongala
 
Transforming Process Safety Management: Challenges, Benefits, and Transition ...
Transforming Process Safety Management: Challenges, Benefits, and Transition ...Transforming Process Safety Management: Challenges, Benefits, and Transition ...
Transforming Process Safety Management: Challenges, Benefits, and Transition ...soginsider
 
me3493 manufacturing technology unit 1 Part A
me3493 manufacturing technology unit 1 Part Ame3493 manufacturing technology unit 1 Part A
me3493 manufacturing technology unit 1 Part Akarthi keyan
 
ASME BPVC 2023 Section I para leer y entender
ASME BPVC 2023 Section I para leer y entenderASME BPVC 2023 Section I para leer y entender
ASME BPVC 2023 Section I para leer y entenderjuancarlos286641
 
Nodal seismic construction requirements.pptx
Nodal seismic construction requirements.pptxNodal seismic construction requirements.pptx
Nodal seismic construction requirements.pptxwendy cai
 
Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...
Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...
Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...Sean Meyn
 
Mohs Scale of Hardness, Hardness Scale.pptx
Mohs Scale of Hardness, Hardness Scale.pptxMohs Scale of Hardness, Hardness Scale.pptx
Mohs Scale of Hardness, Hardness Scale.pptxKISHAN KUMAR
 
The relationship between iot and communication technology
The relationship between iot and communication technologyThe relationship between iot and communication technology
The relationship between iot and communication technologyabdulkadirmukarram03
 
Power System electrical and electronics .pptx
Power System electrical and electronics .pptxPower System electrical and electronics .pptx
Power System electrical and electronics .pptxMUKULKUMAR210
 
SATELITE COMMUNICATION UNIT 1 CEC352 REGULATION 2021 PPT BASICS OF SATELITE ....
SATELITE COMMUNICATION UNIT 1 CEC352 REGULATION 2021 PPT BASICS OF SATELITE ....SATELITE COMMUNICATION UNIT 1 CEC352 REGULATION 2021 PPT BASICS OF SATELITE ....
SATELITE COMMUNICATION UNIT 1 CEC352 REGULATION 2021 PPT BASICS OF SATELITE ....santhyamuthu1
 
Renewable Energy & Entrepreneurship Workshop_21Feb2024.pdf
Renewable Energy & Entrepreneurship Workshop_21Feb2024.pdfRenewable Energy & Entrepreneurship Workshop_21Feb2024.pdf
Renewable Energy & Entrepreneurship Workshop_21Feb2024.pdfodunowoeminence2019
 
UNIT4_ESD_wfffffggggggggggggith_ARM.pptx
UNIT4_ESD_wfffffggggggggggggith_ARM.pptxUNIT4_ESD_wfffffggggggggggggith_ARM.pptx
UNIT4_ESD_wfffffggggggggggggith_ARM.pptxrealme6igamerr
 
Clutches and brkesSelect any 3 position random motion out of real world and d...
Clutches and brkesSelect any 3 position random motion out of real world and d...Clutches and brkesSelect any 3 position random motion out of real world and d...
Clutches and brkesSelect any 3 position random motion out of real world and d...sahb78428
 
Lecture 1: Basics of trigonometry (surveying)
Lecture 1: Basics of trigonometry (surveying)Lecture 1: Basics of trigonometry (surveying)
Lecture 1: Basics of trigonometry (surveying)Bahzad5
 
ChatGPT-and-Generative-AI-Landscape Working of generative ai search
ChatGPT-and-Generative-AI-Landscape Working of generative ai searchChatGPT-and-Generative-AI-Landscape Working of generative ai search
ChatGPT-and-Generative-AI-Landscape Working of generative ai searchrohitcse52
 

Recently uploaded (20)

Engineering Mechanics Chapter 5 Equilibrium of a Rigid Body
Engineering Mechanics  Chapter 5  Equilibrium of a Rigid BodyEngineering Mechanics  Chapter 5  Equilibrium of a Rigid Body
Engineering Mechanics Chapter 5 Equilibrium of a Rigid Body
 
Litature Review: Research Paper work for Engineering
Litature Review: Research Paper work for EngineeringLitature Review: Research Paper work for Engineering
Litature Review: Research Paper work for Engineering
 
Summer training report on BUILDING CONSTRUCTION for DIPLOMA Students.pdf
Summer training report on BUILDING CONSTRUCTION for DIPLOMA Students.pdfSummer training report on BUILDING CONSTRUCTION for DIPLOMA Students.pdf
Summer training report on BUILDING CONSTRUCTION for DIPLOMA Students.pdf
 
solar wireless electric vechicle charging system
solar wireless electric vechicle charging systemsolar wireless electric vechicle charging system
solar wireless electric vechicle charging system
 
Transforming Process Safety Management: Challenges, Benefits, and Transition ...
Transforming Process Safety Management: Challenges, Benefits, and Transition ...Transforming Process Safety Management: Challenges, Benefits, and Transition ...
Transforming Process Safety Management: Challenges, Benefits, and Transition ...
 
計劃趕得上變化
計劃趕得上變化計劃趕得上變化
計劃趕得上變化
 
me3493 manufacturing technology unit 1 Part A
me3493 manufacturing technology unit 1 Part Ame3493 manufacturing technology unit 1 Part A
me3493 manufacturing technology unit 1 Part A
 
ASME BPVC 2023 Section I para leer y entender
ASME BPVC 2023 Section I para leer y entenderASME BPVC 2023 Section I para leer y entender
ASME BPVC 2023 Section I para leer y entender
 
Nodal seismic construction requirements.pptx
Nodal seismic construction requirements.pptxNodal seismic construction requirements.pptx
Nodal seismic construction requirements.pptx
 
Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...
Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...
Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...
 
Mohs Scale of Hardness, Hardness Scale.pptx
Mohs Scale of Hardness, Hardness Scale.pptxMohs Scale of Hardness, Hardness Scale.pptx
Mohs Scale of Hardness, Hardness Scale.pptx
 
The relationship between iot and communication technology
The relationship between iot and communication technologyThe relationship between iot and communication technology
The relationship between iot and communication technology
 
Power System electrical and electronics .pptx
Power System electrical and electronics .pptxPower System electrical and electronics .pptx
Power System electrical and electronics .pptx
 
Présentation IIRB 2024 Marine Cordonnier.pdf
Présentation IIRB 2024 Marine Cordonnier.pdfPrésentation IIRB 2024 Marine Cordonnier.pdf
Présentation IIRB 2024 Marine Cordonnier.pdf
 
SATELITE COMMUNICATION UNIT 1 CEC352 REGULATION 2021 PPT BASICS OF SATELITE ....
SATELITE COMMUNICATION UNIT 1 CEC352 REGULATION 2021 PPT BASICS OF SATELITE ....SATELITE COMMUNICATION UNIT 1 CEC352 REGULATION 2021 PPT BASICS OF SATELITE ....
SATELITE COMMUNICATION UNIT 1 CEC352 REGULATION 2021 PPT BASICS OF SATELITE ....
 
Renewable Energy & Entrepreneurship Workshop_21Feb2024.pdf
Renewable Energy & Entrepreneurship Workshop_21Feb2024.pdfRenewable Energy & Entrepreneurship Workshop_21Feb2024.pdf
Renewable Energy & Entrepreneurship Workshop_21Feb2024.pdf
 
UNIT4_ESD_wfffffggggggggggggith_ARM.pptx
UNIT4_ESD_wfffffggggggggggggith_ARM.pptxUNIT4_ESD_wfffffggggggggggggith_ARM.pptx
UNIT4_ESD_wfffffggggggggggggith_ARM.pptx
 
Clutches and brkesSelect any 3 position random motion out of real world and d...
Clutches and brkesSelect any 3 position random motion out of real world and d...Clutches and brkesSelect any 3 position random motion out of real world and d...
Clutches and brkesSelect any 3 position random motion out of real world and d...
 
Lecture 1: Basics of trigonometry (surveying)
Lecture 1: Basics of trigonometry (surveying)Lecture 1: Basics of trigonometry (surveying)
Lecture 1: Basics of trigonometry (surveying)
 
ChatGPT-and-Generative-AI-Landscape Working of generative ai search
ChatGPT-and-Generative-AI-Landscape Working of generative ai searchChatGPT-and-Generative-AI-Landscape Working of generative ai search
ChatGPT-and-Generative-AI-Landscape Working of generative ai search
 

Silent sound technology

  • 4. What is SST? It is a technology that helps to transmit information without using our vocal cords. Aims to observe our silent speech and transform it into text/audio output. The software can be installed in wrist tag/ display, mobile or PC.
  • 5. “What happens if we don’t communicate? Suddenly we lose our voice during an accident……”  Helps those who had lost their voice but wish to speak.  Output can be routed to communication networks.  People can speak over phone without disturbing others.  Also can speak in noisy environment. Why Needed........?
  • 6.  Idea was popularized in the 1968 Stanley Kubrick’s science fiction film ‘‘2001 – A Space Odyssey ” (Using Electronic signals)  US space agency Nasa has investigated the technique for communicating in noisy environments such as the Space Station.  SST was demonstrated in the year 2010 at CeBIT’s “future park”, one of the largest trade fair.  This technology is being developed at Karlsruhe Institute of Technology ( KIT ), Germany.  Wand and Tanja Shultz Origin
  • 8. ELECTROMYOGRAPHY(EMG) A technique for evaluating and recording the electrical activity produced by skeletal muscles. It detects the electrical potential generated by muscle cells, when these cells are electrically or neurologically activated. Performed using instrument called an electromyograph, to produce a record called an electromyogram. signals can be analyzed to detect medical abnormalities.
  • 9. How can We Speak….? When we generally speak aloud, air passes through larynx or vocal cord & the tongue.  Words are produced using articulator muscle in the mouth & jaw region.
  • 11. Process…. monitor tiny muscular movements that occur when we speak. Monitored signals are converted into electrical pulses that can then be turned into speech, without a sound uttered. Fig: Electromyography activity
  • 12. DRAWBACKS Device presently needs nine leads to be attached to our face which is quite impractical to make it usable. It’s little painful. Translation to Chinese language is a bit difficult. Not portable
  • 13. Image processing In SST A device oriented package to design and implement for the purpose of lip reading. It works based on our silent speech. It can recognize words, single sentence or even continuous sentences of people of different region. Device consider our non-speech accent and pronunciation by observing every movement of our lip and facial Expression
  • 14. Terms……… Region of Interest(ROI) Skin segmentation Face detection Lip detection Lip contour Key points Facial features Lip tracking
  • 17. Face Detection Perform Lighting Compensation on image. Extract skin region and remove all the noisy data. Check for face criterions. Skin colour blocks are identified. Height and width ratio (1.5 and 0.8) computed and Minimal face dimension constrained is implemented. Crop the current region.
  • 18. Skin Segmentation One of the important steps in face feature extraction. Colour segmentation of human face depends on the colour space that is selected. Skin colours of different people are closely grouped in normalized RG colour plane ( by Yang and Waibel). Search for the pixels which are close enough to this spread .
  • 20. Active Shape Models a)Original image d)Active shape of face Used to detect face in the captured video. Shape model is formed from a set of manually annotated shape of faces: •Align all shapes of the learning data to an arbitrary reference by geometric transformation. •Calculate average shape . Model positioned on the face. Iteratively deformed until it sticks to the face in respective bounding boxes Mouth region Localization.
  • 21. Face Detection VideoFileReader('path') Reads video frame by frame CascadeObjectDetector('FrontalFaceLBP') Creates a detector for face activecontour(A,mask,method) Detect active contour inside face region .Here active contour is lip (i.e.. major difference region). centroidColumn(X), centroidRow(Y) – centroid point Middlerow,middlecolumn– minor and major axis lines of lip contour Contour fitting point location
  • 22. Key points topRowY = find(middleColumn, 1, 'first'); centroidColumn, topRowY -this gives top bottomRowY = find(middleColumn, 1, 'last'); centroidColumn, bottomRowY -this gives bottom leftColumnX = find(middleRow, 1, 'first'); leftColumnX, centroidRow -this gives left rightColumnX= find(middleRow, 1, 'last'); rightColumnX, centroidRow -this gives right
  • 23. 1.Live video 2.ROI video 3.Facial features detected live video 4.Lip during motion with perimeter contour and key points 5.Multi Image montage(28 frames)6.Threshold Analysis
  • 24. Applications People can communicate in different languages by translating the output of SST.  Helps to Analyse and understand the people who have lost voice to speak or stuttering problem. Silent Sound Techniques is applied in Military for communicating secret/confidential matters to others. Helps people to make silent calls during meetings/ in mass crowded places. User can tell PIN no., credit card no., password and other personals without bothering some eavesdroppers. Software can be installed in wrist watch, wrist tag or display/Mobile/Pc and etc.
  • 25. Conclusion The software is being trained based on the lip structure, complexion and features of the lip area. Provide easier mode of communication for people with speech disabilities by converting the identified lip movements directly to speech. Software can be integrated onto mobile oriented or hand-held devices. Lip read for Chinese language Mandarin is highly personalized. Systems are still preliminary need improvement.
  • 26. REFERERENCES Pradeep B.S. And Zhang Jingang , “Silent Sound Technology for Mandarin”. Sasikumar Gurumurthy and B.K.Tripathy , “Design and Implementation of Face Recognition System in Matlab Using the Features of Lips”. Evangelos Skodras and Nikolaos Fakotakis , “An Unconstrained Method for Lip Detection in Color Images”. Priya Jethani and Bharat Choudhari , “Silent Sound Technology: A Solution to Noisy Communication”.