Skip Navigation Links

Project Information

US EGYPT COOPERATIVE RESEARCH: COMPUTER AIDED PRONUNCIATION LEARNING APPLICATION

Agency:
NSF

National Science Foundation

Project Number:
0923658
Contact PI / Project Leader:
ELGAMMAL, AHMED M
Awardee Organization:
RUTGERS THE ST UNIV OF NJ NEW BRUNSWICK

Description

Abstract Text:
This collaborative research project is being undertaken by Dr. Ahmed Elgammal, Rutgers University, and Dr. Sherif Abdou, Cairo University in Egypt, in order to create an automated system that will input pronunciations from language learners along with dynamic images of their faces as they speak. Using this information, the proposed system will assess whether the user has produced an accurate pronunciation of a particular word or phrase in the target language. The system will then offer specific feedback to the user regarding the quality of their pronunciation, with suggestions for improvement. Specifically, the research will entail analyzing pronunciation errors that occur for non-native speakers of English and Arabic.

The researchers anticipate that this speech recognition system will be robust enough to withstand large mispronunciations that may occur when the user has a non-native tongue. Additionally, the system will be designed to assign a pass or fail score to the user?s utterance, detect where the error occurred, and classify the error in order to give adequate feedback on how the pronunciation should be altered. In order to create such a system, novel algorithms will be developed for combining visual cues with audio cues for the task of mispronunciation detection. This will be achieved by deploying lip tracking algorithms and studying the correlation between lip movement and speech through style-dependent models of individual users. The research plan will also result in collection of a large audio-visual database of the phonemes by native and non-native Arabic and English speakers. The significance of initially developing the mispronunciation detection for English and Arabic is that these two languages are both phonetically rich and different from one another, leading to an assumption that the mispronunciation detection has a wide working spectrum.

The societal benefits of efficient speech training systems are significant. In addition to numerous benefits for language learning, the expected outcome of this collaborative research is a tool that would be one of the core components for any Computer Aided Language Learning (CALL) system. Such an outcome could provide a cost effective and personalized tool for hearing-impaired speakers where the acquisition of an acceptable pronunciation can be challenging.
Project Terms:
Algorithms; Collection; Computer Assisted; Correlation Studies; cost effective; Cues; Databases; design; Detection; Egypt; Face; Feedback; Hearing; Image; Individual; Language; Language Development; Learning; Lip structure; Modeling; Movement; novel; Outcome; phrases; Research; Research Personnel; Research Project Grants; Speech; speech recognition; Suggestion; System; Tongue; tool; Training; Universities; Visual; Work

Details

Contact PI / Project Leader Information:
Name:  ELGAMMAL, AHMED M
Other PI Information:
Not Applicable
Awardee Organization:
Name:  RUTGERS THE ST UNIV OF NJ NEW BRUNSWICK
City:  NEW BRUNSWICK    
Country:  UNITED STATES
Congressional District:
State Code:  NJ
District:  06
Other Information:
Fiscal Year: 2009
Award Notice Date: 24-Sep-2009
DUNS Number: 001912864
Project Start Date: 01-Oct-2009
Budget Start Date:
CFDA Code: 47.079
Project End Date: 30-Sep-2012
Budget End Date:
Agency: ?

Agency: The entity responsible for the administering of a research grant, project, or contract. This may represent a federal department, agency, or sub-agency (institute or center). Details on agencies in Federal RePORTER can be found in the FAQ page.

National Science Foundation
Project Funding Information for 2009:
Year Agency

Agency: The entity responsible for the administering of a research grant, project, or contract. This may represent a federal department, agency, or sub-agency (institute or center). Details on agencies in Federal RePORTER can be found in the FAQ page.

FY Total Cost
2009 NSF

National Science Foundation

$75,051

Results

i

It is important to recognize, and consider in any interpretation of Federal RePORTER data, that the publication and patent information cannot be associated with any particular year of a research project. The lag between research being conducted and the availability of its results in a publication or patent award varies substantially. For that reason, it's difficult, if not impossible, to associate a publication or patent with any specific year of the project. Likewise, it is not possible to associate a publication or patent with any particular supplement to a research project or a particular subproject of a multi-project grant.

ABOUT FEDERAL REPORTER RESULTS

Publications: i

Click on the column header to sort the results

PubMed = PubMed PubMed Central = PubMed Central Google Scholar = Google Scholar

Patents: i

Click on the column header to sort the results

Similar Projects

Download Adobe Acrobat Reader:Adobe Acrobat VERSION: 3.41.0 Release Notes
Back to Top