论文标题
利用基于变压器的模型用于Lismore院长书籍的单词级音译
Use of Transformer-Based Models for Word-Level Transliteration of the Book of the Dean of Lismore
论文作者
论文摘要
利斯莫尔院长（BDL）的书是用非标准拼字法编写的16世纪苏格兰盖尔语手稿。在这项工作中，我们概述了将BDL的文本译成标准化拼字法的问题，并使用基于变压器的模型执行此任务的探索性实验。特别是，我们专注于单词级音译的任务，并以最佳模型获得了54.15的角色级别的BLEU得分，这是对苏格兰盖尔维克·维基百科（Scottish Gaelic Wikipedia）文本进行培训的BART架构，然后对大约2,000个单词级并行示例进行了微调。我们的最初实验给出了令人鼓舞的结果，但我们重点介绍了模型的缺点，并讨论了未来工作的方向。
The Book of the Dean of Lismore (BDL) is a 16th-century Scottish Gaelic manuscript written in a non-standard orthography. In this work, we outline the problem of transliterating the text of the BDL into a standardised orthography, and perform exploratory experiments using Transformer-based models for this task. In particular, we focus on the task of word-level transliteration, and achieve a character-level BLEU score of 54.15 with our best model, a BART architecture pre-trained on the text of Scottish Gaelic Wikipedia and then fine-tuned on around 2,000 word-level parallel examples. Our initial experiments give promising results, but we highlight the shortcomings of our model, and discuss directions for future work.
