视觉口型图像呈现对正常听力受试者和人工耳蜗使用者噪声下言语感知的影响

文献信息

中文摘要

本研究探讨了视觉言语线索对人工耳蜗（CI）使用者噪声下言语感知和主观聆听努力的影响，并与正常听力（NH）个体进行比较。此外，研究还比较了通过计算机生成虚拟形象或真实说话者视频录像呈现的视觉信息。13名NH参与者和12名双侧CI使用者完成了奥尔登堡句子测试（OLSA）的六种条件：仅听觉、仅视觉，以及使用视频录像（女性说话者）或计算机动画虚拟形象（男性说话者）的视听呈现。测量了噪声下的言语接受阈（SRT）和主观聆听努力（LE）。还记录了仅视觉条件下的唇读表现和自我评估的唇读技能。基于视频的视听呈现较仅听觉呈现显著改善了言语感知（NH：1.6 dB；CI：3.5 dB）。CI使用者的唇读得分显著高于NH参与者（51% vs. 28%），且唇读表现与自我报告能力强烈相关。尽管SRT有所改善，视听呈现仅对CI使用者的聆听努力产生边际性降低，对NH参与者则无降低。相比之下，计算机动画虚拟形象在两组中均未对言语感知或聆听努力提供可测量的视听获益。真实说话者视频录像显著增强了NH个体和CI使用者的视听言语感知，尤其使CI听者获益。然而，聆听努力的降低很小，凸显了言语感知与感知聆听努力之间的分离。纳入视听测量可能提高CI结局临床评估的生态效度。

英文摘要

This study investigated the impact of visual speech cues on speech perception in noise and subjective listening effort in cochlear implant (CI) users compared with normal-hearing (NH) individuals. Furthermore, the study compared visual information presented either by a computer-generated avatar or by video recordings of a real speaker. Thirteen NH participants and twelve bilateral CI users completed the Oldenburg Sentence Test (OLSA) in six conditions: auditory‑only, visual‑only, and audiovisual presentations using either video recordings (female speaker) or a computer‑animated avatar (male speaker). Speech reception thresholds (SRTs) in noise and subjective listening effort (LE) were measured. Visual‑only lipreading performance and self‑assessed lipreading skills were also recorded. Video‑based audiovisual presentation significantly improved speech perception compared with audio‑only presentation (NH: 1.6 dB; CI: 3.5 dB). CI users demonstrated substantially higher lipreading scores than NH participants (51% vs. 28%), and lipreading performance strongly correlated with self‑reported ability. Despite SRT improvements, audiovisual presentation yielded only marginal reductions in listening effort for CI users and none for NH participants. In contrast, the computer‑animated avatar provided no measurable audiovisual benefit for speech perception or listening effort in either group. Real‑speaker video recordings considerably enhance audiovisual speech perception in both NH individuals and CI users, particularly benefiting CI listeners. However, reductions in listening effort were minimal, underscoring the dissociation between speech perception and perceived listening effort. Incorporating audiovisual measures may improve ecological validity in clinical assessment of CI outcomes.