Iterative data augmentation for neural machine translation: a low resource case study for English-Telugu

• Autores: Sandipan Dandapat, Christian Federmann
• Localización: Proceedings of the 21st Annual Conference of the European Association for Machine Translation: 28-30 May 2018, Universitat d'Alacant, Alacant, Spain / coord. por Juan Antonio Pérez Ortiz, Felipe Sánchez Martínez, Miquel Esplà Gomis, Maja Popovic, Celia Rico Pérez, André Martins, Joachim Van den Bogaert, Mikel L. Forcada Zubizarreta, 2018, ISBN 978-84-09-01901-4, págs. 287-292
• Idioma: inglés
• Enlaces
  • Texto completo
• Resumen

  • Telugu is the fifteenth most commonly spoken language in the world with an estimated reach of 75 million people in the Indian subcontinent. At the same time, it is a severely low resourced language. In this paper, we present work on English–Telugu general domain machine translation (MT) systems using small amounts of parallel data. The baseline statistical (SMT) and neural MT (NMT) systems do not yield acceptable translation quality, mostly due to limited resources. However, the use of synthetic parallel data (generated using back translation, based on an NMT engine) significantly improves translation quality and allows NMT to outperform SMT. We extend back translation and propose a new, iterative data augmentation (IDA) method. Filtering of synthetic data and IDA both further boost translation quality of our final NMT systems, as measured by BLEU scores on all test sets and based on state-of-the-art human evaluation.