论文标题
思考言语来识别用户经验问题:与中文非母语说话者的语言水平的影响
Think-Aloud Verbalizations for Identifying User Experience Problems: Effects of Language Proficiency with Chinese Non-Native English Speakers
论文作者
论文摘要
用户的思维(TA)语言(即话语)中的微妙模式被证明是用户体验(UX)问题的明显迹象,并用于构建人工智能(AI)模型或AI-Assiss cassiss的工具,以帮助UX评估者自动识别UX问题。尽管有这种语言模式的潜力,但他们还是被英语英语的人发现。由于大多数说英语的人都是非母语的人,因此重要的是要研究非母语说话者的语言中是否存在类似的模式。作为回答这个问题的第一步,我们使用三种常见的TA协议对中国非母语说话者和英语英语的人进行了思考可用性测试。我们比较了他们遇到的语言和UX问题,以了解语言和TA协议的影响。我们的发现表明,两个语言组的言语类别的数量和比例相似,遇到了类似的问题,并且具有类似的语言模式,表明了UX问题。此外,TA方案并未显着影响语言和问题之间的相关性。根据发现,我们对UX从业人员和AI辅助分析工具的设计提出了三个设计含义。
Subtle patterns in users' think-aloud (TA) verbalizations (i.e., utterances) are shown to be telltale signs of user experience (UX) problems and used to build artificial intelligence (AI) models or AI-assisted tools to help UX evaluators identify UX problems automatically or semi-automatically. Despite the potential of such verbalization patterns, they were uncovered with native English speakers. As most people who speak English are non-native speakers, it is important to investigate whether similar patterns exist in non-native English speakers' TA verbalizations. As a first step to answer this question, we conducted think-aloud usability testing with Chinese non-native English speakers and native English speakers using three common TA protocols. We compared their verbalizations and UX problems that they encountered to understand the effects of language and TA protocols. Our findings show that both language groups had similar amounts and proportions of verbalization categories, encountered similar problems, and had similar verbalization patterns that indicate UX problems. Furthermore, TA protocols did not significantly affect the correlations between verbalizations and problems. Based on the findings, we present three design implications for UX practitioners and the design of AI-assisted analysis tools.