Multi-Hierarchy Metamorphic Testing for Hyphenated Words in Machine Translation
With the advancement of deep neural networks, machine translation has seen rapid progress in recent years. Individuals often rely on machine translation software to facilitate various tasks. However, the intricacies of neural networks can lead to translation errors, resulting in misunderstandings or conflicts. The most common method for testing machine translation is metamorphic testing. However, metamorphic testing at the phrase or sentence hierarchy may result in some test cases being incorrectly identified as failures. To mitigate this issue, we added the word hierarchy. We proposed a multi-hierarchy metamorphic testing method, MHT, to test machine translation. Hyphenated words as a specific format prone to translation errors, which are chosen as our research object. Based on the common notion that translations of words within the same sentence should be similar, we extract contents from different hierarchies within sentences containing hyphenated words and compare the similarity of their corresponding translations for these specific words. We conducted the experiments on 881 sentences leveraging Google Translate, Microsoft Bing Translator, and Baidu Translate, which detected 111, 91, and 111 suspicious errors with high precision (78.4%, 82.4%, and 81.1%). Translation errors mainly include mis-translation, under-translation, over-translation, and non-translation.
Thu 5 DecDisplayed time zone: Beijing, Chongqing, Hong Kong, Urumqi change
14:00 - 15:30 | Session (9)Technical Track / ERA - Early Research Achievements at Room 2 (Xiangshan Ballroom) Chair(s): Zhiqiang Li | ||
14:00 30mTalk | Multi-Hierarchy Metamorphic Testing for Hyphenated Words in Machine Translation Technical Track Rui Zhu Nanjing University of Aeronautics and Astronautics, Chuanqi Tao Nanjing University of Aeronautics and Astronautics, Jerry Gao San Jose State University | ||
14:30 30mTalk | Exploring the Depths of WebAudio: Advancing Greybox Fuzzing for Enhanced Vulnerability Detection in Safari Technical Track Jiashui Wang Zhejiang University, Jiahui Wang Zhejiang University, Jundong Xie Ant Group, Zhenyuan Li Zhejiang University, Yan Chen Northwestern University, Peng Qian Zhejiang University | ||
15:00 20mTalk | A Study On C Code Defect Detection With Fine-tuned Large Language Models ERA - Early Research Achievements Yue Wang Beihang University, Xu Wang Beihang University, Hongwei Yu Beihang University, Fei Gao Beijing Aerospace Automatic Control Institute, Xueshi Liu Beijing Aerospace Automatic Control Institute, Xiaoling Wang |