ChatGPT as a Translation Engine: A Case Study on Japanese-English
By: Vincent Michael Sutanto , Giovanni Gatti De Giacomo , Toshiaki Nakazawa and more
Potential Business Impact:
Makes computers translate Japanese to English better.
This study investigates ChatGPT for Japanese-English translation, exploring simple and enhanced prompts and comparing against commercially available translation engines. Performing both automatic and MQM-based human evaluations, we found that document-level translation outperforms sentence-level translation for ChatGPT. On the other hand, we were not able to determine if enhanced prompts performed better than simple prompts in our experiments. We also discovered that ChatGPT-3.5 was preferred by automatic evaluation, but a tradeoff exists between accuracy (ChatGPT-3.5) and fluency (ChatGPT-4). Lastly, ChatGPT yields competitive results against two widely-known translation systems.
Similar Papers
Optimising ChatGPT for creativity in literary translation: A case study from English into Dutch, Chinese, Catalan and Spanish
Computation and Language
Makes computer translations more creative and interesting.
A Comparison of Human and ChatGPT Classification Performance on Complex Social Media Data
Computation and Language
AI struggles to understand tricky words.
Evaluation of GPT-based large language generative AI models as study aids for the national licensure examination for registered dietitians in Japan
Computation and Language
AI helps nutrition students study for tests.