论文标题
设计，播放和使用基于视觉的口腔接口进行表演
Designing, Playing, and Performing with a Vision-based Mouth Interface
论文作者
论文摘要
面部和口腔在言语制作中的作用以及语言交流表明，使用面部动作对照音乐声音。在这里，我们记录了有关TheSouthesizer的工作，该系统使用了毛毛的微型摄取和计算机视觉算法来从口腔张开中提取板甲板，并随着中部控制的变化而输出这些。我们报告了我们在各种媒体到达的映射和音乐应用方面的经验，并描述了使用inusesizerface的现场表演。
The role of the face and mouth in speech production as well asnon-verbal communication suggests the use of facial action tocontrol musical sound. Here we document work on theMouthesizer, a system which uses a headworn miniaturecamera and computer vision algorithm to extract shapeparameters from the mouth opening and output these as MIDIcontrol changes. We report our experience with variousgesture-to-sound mappings and musical applications, anddescribe a live performance which used the Mouthesizerinterface.
