一种应用虚拟发音头像的普通话聋儿言语康复系统
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

国家自然科学基金重点项目(61135003);国家自然科学基金(90920002);广东省创新型研究团队(201001D0104648280)


An Interactive Speech Training System with Virtual Reality Articulation for Hearing Impaired Mandarin-speaking Children
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    本文介绍了一种新型的包含虚拟发音人头像的语言训练系统并对该系统在听障儿童语言康复训练中的实用性进 行了研究。该系统以虚拟三维发音人头像的形式再现了汉语中常见的 20 个单音节字的发音动作,并将之用于语言康复 训练。系统运用 EMA(三维电磁发音仪)设备采集内部及外部发音器官运动轨迹作为驱动数据,有效模拟了汉语发音。此 外,系统还包括一个听力训练模块和一个朗读训练模块,用于辅助聋儿的发音康复训练。文章对系统发音模拟功能的准 确性进行了人工评估,并应用系统对两名 4 至 5 岁之间的聋儿进行了初步的康复训练。初步评估及训练的结果表明:系 统的发音模拟功能可有效模拟发音器官的动作,有助于提高听障儿童的语言能力;同时,系统的设计风格较易获得幼儿 认同。研究证明,本系统在听障儿童发音训练方面是有效的,具有较高的应用价值。

    Abstract:

    In this study, a novel interactive speech training system based on virtual reality articulation was introduced and its efficiency in the rehabilitation of hearing impaired (HI) children was investigated as well. 20 meaningful words in Mandarin were presented by using a 3D talking head in this system for articulatory training. The Electro-Magnetic Articulography (EMA) and graphic transform technology were used to develop the reality inner articulatory movements of 3D talking head. Furthermore, relevant corpus was organized in a listening module and a speaking module of the system to help to recover the HI children’s language skills. Then, the accuracy of virtual reality (VR) articulatory movement model was evaluated through a series of experiments. Finally, a pilot test was performed on the training of two HI children with the system. The preliminary results show that there is an improvement in the speaking abilities of the tested HI children. Meanwhile, the system was recognized as acceptable and interesting for younger children. The study indicates that the presented training system is effective to articulation training for the HI children.

    参考文献
    相似文献
    引证文献
引用本文

引文格式
刘晓千,燕 楠,王 岚.一种应用虚拟发音头像的普通话聋儿言语康复系统 [J].集成技术,2013,2(4):68-73

Citing format
LIU Xiao-qian, YAN Nan, WANG Lan. An Interactive Speech Training System with Virtual Reality Articulation for Hearing Impaired Mandarin-speaking Children[J]. Journal of Integration Technology,2013,2(4):68-73

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2013-09-25
  • 出版日期:
文章二维码