Logo ÚFAL Logo MFF

The Prague Bulletin of Mathematical Linguistics


ÚFAL
PBML

Improving Fuzzy Match Augmented Neural Machine Translation in Specialised Domains through Synthetic Data

Arda Tezcan, Alina Skidanova, Thomas Moerman

References:

  1. Duarte Alves, Nuno Guerreiro, João Alves, José Pombal, Ricardo Rei, José de Souza, Pierre Colombo, and Andre Martins. Steering Large Language Models for Machine Translation with Finetuning and In-Context Learning In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 11127–11148, Association for Computational Linguistics, Singapore, 2023. (http://doi.org/10.18653/v1/2023.findings-emnlp.744)
  2. Duarte M. Alves, José P. Pombal, Nuno M. Guerreiro, Pedro Henrique Martins, Joao Alves, Amin Farajian, Ben Peters, Ricardo Rei, Patrick Fernandes, Sweta Agrawal, Pierre Colombo, Jos'e G. C. de Souza, and André Martins. Tower: An Open Multilingual Large Language Model for Translation-Related Tasks ArXiv abs/2402.17733, 2024.
  3. Maxime Bouthors, Josep Crego, and François Yvon. Towards Example-Based NMT with Multi-Levenshtein Transformers In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 1830–1846, Association for Computational Linguistics, Singapore, 2023. (http://doi.org/10.18653/v1/2023.emnlp-main.113)
  4. Bram Bulté and Arda Tezcan. Neural Fuzzy Repair: Integrating Fuzzy Matches into Neural Machine Translation In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 1800–1809, Association for Computational Linguistics, Florence, Italy, 2019. (http://doi.org/10.18653/v1/P19-1175)
  5. Deng Cai, Yan Wang, Huayang Li, Wai Lam, and Lemao Liu. Neural Machine Translation with Monolingual Translation Memory In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 7307–7318, Association for Computational Linguistics, Online, 2021. (http://doi.org/10.18653/v1/2021.acl-long.567)
  6. Qian Cao and Deyi Xiong. Encoding gated translation memory into neural machine translation In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 3042–3047, 2018. (http://doi.org/10.18653/v1/D18-1340)
  7. Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Amy Yang, Angela Fan, Anirudh Goyal, Anthony Hartshorn, Aobo Yang, Archi Mitra, Archie Sravankumar, Artem Korenev, Arthur Hinsvark, Arun Rao, Aston Zhang, Aurelien Rodriguez, Austen Gregerson, Ava Spataru, Baptiste Roziere, Bethany Biron, Binh Tang, Bobbie Chern, Charlotte Caucheteux, Chaya Nayak, Chloe Bi, Chris Marra, Chris McConnell, Christian Keller, Christophe Touret, Chunyang Wu, Corinne Wong, Cristian Canton Ferrer, Cyrus Nikolaidis, Damien Allonsius, Daniel Song, Danielle Pintz, Danny Livshits, David Esiobu, Dhruv Choudhary, Dhruv Mahajan, Diego Garcia-Olano, Diego Perino, Dieuwke Hupkes, Egor Lakomkin, Ehab AlBadawy, Elina Lobanova, Emily Dinan, Eric Michael Smith, Filip Radenovic, Frank Zhang, Gabriel Synnaeve, Gabrielle Lee, Georgia Lewis Anderson, Graeme Nail, Gregoire Mialon, Guan Pang, Guillem Cucurell, Hailey Nguyen, Hannah Korevaar, Hu Xu, Hugo Touvron, Iliyan Zarov, Imanol Arrieta Ibarra, Isabel Kloumann, Ishan Misra, Ivan Evtimov, Jade Copet, Jaewon Lee, Jan Geffert, Jana Vranes, Jason Park, Jay Mahadeokar, Jeet Shah, Jelmer van der Linde, Jennifer Billock, Jenny Hong, Jenya Lee, Jeremy Fu, Jianfeng Chi, Jianyu Huang, Jiawen Liu, Jie Wang, Jiecao Yu, Joanna Bitton, Joe Spisak, Jongsoo Park, Joseph Rocca, Joshua Johnstun, Joshua Saxe, Junteng Jia, Kalyan Vasuden Alwala, Kartikeya Upasani, Kate Plawiak, Ke Li, Kenneth Heafield, Kevin Stone, Khalid El-Arini, Krithika Iyer, Kshitiz Malik, Kuenley Chiu, Kunal Bhalla, Lauren Rantala-Yeary, Laurens van der Maaten, Lawrence Chen, Liang Tan, Liz Jenkins, Louis Martin, Lovish Madaan, Lubo Malo, Lukas Blecher, Lukas Landzaat, Luke de Oliveira, Madeline Muzzi, Mahesh Pasupuleti, Mannat Singh, Manohar Paluri, Marcin Kardas, Mathew Oldham, Mathieu Rita, Maya Pavlova, Melanie Kambadur, Mike Lewis, Min Si, Mitesh Kumar Singh, Mona Hassan, Naman Goyal, Narjes Torabi, Nikolay Bashlykov, Nikolay Bogoychev, Niladri Chatterji, Olivier Duchenne, Onur Çelebi, Patrick Alrassy, Pengchuan Zhang, Pengwei Li, Petar Vasic, Peter Weng, Prajjwal Bhargava, Pratik Dubal, Praveen Krishnan, Punit Singh Koura, Puxin Xu, Qing He, Qingxiao Dong, Ragavan Srinivasan, Raj Ganapathy, Ramon Calderer, Ricardo Silveira Cabral, Robert Stojnic, Roberta Raileanu, Rohit Girdhar, Rohit Patel, Romain Sauvestre, Ronnie Polidoro, Roshan Sumbaly, Ross Taylor, Ruan Silva, Rui Hou, Rui Wang, Saghar Hosseini, Sahana Chennabasappa, Sanjay Singh, Sean Bell, Seohyun Sonia Kim, Sergey Edunov, Shaoliang Nie, Sharan Narang, Sharath Raparthy, Sheng Shen, Shengye Wan, Shruti Bhosale, Shun Zhang, Simon Vandenhende, Soumya Batra, Spencer Whitman, Sten Sootla, Stephane Collot, Suchin Gururangan, Sydney Borodinsky, Tamar Herman, Tara Fowler, Tarek Sheasha, Thomas Georgiou, Thomas Scialom, Tobias Speckbacher, Todor Mihaylov, Tong Xiao, Ujjwal Karn, Vedanuj Goswami, Vibhor Gupta, Vignesh Ramanathan, Viktor Kerkez, Vincent Gonguet, Virginie Do, Vish Vogeti, Vladan Petrovic, Weiwei Chu, Wenhan Xiong, Wenyin Fu, Whitney Meers, Xavier Martinet, Xiaodong Wang, Xiaoqing Ellen Tan, Xinfeng Xie, Xuchao Jia, Xuewei Wang, Yaelle Goldschlag, Yashesh Gaur, Yasmine Babaei, Yi Wen, Yiwen Song, Yuchen Zhang, Yue Li, Yuning Mao, Zacharie Delpierre Coudert, Zheng Yan, Zhengxing Chen, Zoe Papakipos, Aaditya Singh, Aaron Grattafiori, Abha Jain, Adam Kelsey, Adam Shajnfeld, Adithya Gangidi, Adolfo Victoria, Ahuva Goldstand, Ajay Menon, Ajay Sharma, Alex Boesenberg, Alex Vaughan, Alexei Baevski, Allie Feinstein, Amanda Kallet, Amit Sangani, Anam Yunus, Andrei Lupu, Andres Alvarado, Andrew Caples, Andrew Gu, Andrew Ho, Andrew Poulton, Andrew Ryan, Ankit Ramchandani, Annie Franco, Aparajita Saraf, Arkabandhu Chowdhury, Ashley Gabriel, Ashwin Bharambe, Assaf Eisenman, Azadeh Yazdan, Beau James, Ben Maurer, Benjamin Leonhardi, Bernie Huang, Beth Loyd, Beto De Paola, Bhargavi Paranjape, Bing Liu, Bo Wu, Boyu Ni, Braden Hancock, Bram Wasti, Brandon Spence, Brani Stojkovic, Brian Gamido, Britt Montalvo, Carl Parker, Carly Burton, Catalina Mejia, Changhan Wang, Changkyu Kim, Chao Zhou, Chester Hu, Ching-Hsiang Chu, Chris Cai, Chris Tindal, Christoph Feichtenhofer, Damon Civin, Dana Beaty, Daniel Kreymer, Daniel Li, Danny Wyatt, David Adkins, David Xu, Davide Testuggine, Delia David, Devi Parikh, Diana Liskovich, Didem Foss, Dingkang Wang, Duc Le, Dustin Holland, Edward Dowling, Eissa Jamil, Elaine Montgomery, Eleonora Presani, Emily Hahn, Emily Wood, Erik Brinkman, Esteban Arcaute, Evan Dunbar, Evan Smothers, Fei Sun, Felix Kreuk, Feng Tian, Firat Ozgenel, Francesco Caggioni, Francisco Guzmán, Frank Kanayet, Frank Seide, Gabriela Medina Florez, Gabriella Schwarz, Gada Badeer, Georgia Swee, Gil Halpern, Govind Thattai, Grant Herman, Grigory Sizov, Guangyi, Zhang, Guna Lakshminarayanan, Hamid Shojanazeri, Han Zou, Hannah Wang, Hanwen Zha, Haroun Habeeb, Harrison Rudolph, Helen Suk, Henry Aspegren, Hunter Goldman, Ibrahim Damlaj, Igor Molybog, Igor Tufanov, Irina-Elena Veliche, Itai Gat, Jake Weissman, James Geboski, James Kohli, Japhet Asher, Jean-Baptiste Gaya, Jeff Marcus, Jeff Tang, Jennifer Chan, Jenny Zhen, Jeremy Reizenstein, Jeremy Teboul, Jessica Zhong, Jian Jin, Jingyi Yang, Joe Cummings, Jon Carvill, Jon Shepard, Jonathan McPhie, Jonathan Torres, Josh Ginsburg, Junjie Wang, Kai Wu, Kam Hou U, Karan Saxena, Karthik Prasad, Kartikay Khandelwal, Katayoun Zand, Kathy Matosich, Kaushik Veeraraghavan, Kelly Michelena, Keqian Li, Kun Huang, Kunal Chawla, Kushal Lakhotia, Kyle Huang, Lailin Chen, Lakshya Garg, Lavender A, Leandro Silva, Lee Bell, Lei Zhang, Liangpeng Guo, Licheng Yu, Liron Moshkovich, Luca Wehrstedt, Madian Khabsa, Manav Avalani, Manish Bhatt, Maria Tsimpoukelli, Martynas Mankus, Matan Hasson, Matthew Lennie, Matthias Reso, Maxim Groshev, Maxim Naumov, Maya Lathi, Meghan Keneally, Michael L. Seltzer, Michal Valko, Michelle Restrepo, Mihir Patel, Mik Vyatskov, Mikayel Samvelyan, Mike Clark, Mike Macey, Mike Wang, Miquel Jubert Hermoso, Mo Metanat, Mohammad Rastegari, Munish Bansal, Nandhini Santhanam, Natascha Parks, Natasha White, Navyata Bawa, Nayan Singhal, Nick Egebo, Nicolas Usunier, Nikolay Pavlovich Laptev, Ning Dong, Ning Zhang, Norman Cheng, Oleg Chernoguz, Olivia Hart, Omkar Salpekar, Ozlem Kalinli, Parkin Kent, Parth Parekh, Paul Saab, Pavan Balaji, Pedro Rittner, Philip Bontrager, Pierre Roux, Piotr Dollar, Polina Zvyagina, Prashant Ratanchandani, Pritish Yuvraj, Qian Liang, Rachad Alao, Rachel Rodriguez, Rafi Ayub, Raghotham Murthy, Raghu Nayani, Rahul Mitra, Raymond Li, Rebekkah Hogan, Robin Battey, Rocky Wang, Rohan Maheswari, Russ Howes, Ruty Rinott, Sai Jayesh Bondu, Samyak Datta, Sara Chugh, Sara Hunt, Sargun Dhillon, Sasha Sidorov, Satadru Pan, Saurabh Verma, Seiji Yamamoto, Sharadh Ramaswamy, Shaun Lindsay, Shaun Lindsay, Sheng Feng, Shenghao Lin, Shengxin Cindy Zha, Shiva Shankar, Shuqiang Zhang, Shuqiang Zhang, Sinong Wang, Sneha Agarwal, Soji Sajuyigbe, Soumith Chintala, Stephanie Max, Stephen Chen, Steve Kehoe, Steve Satterfield, Sudarshan Govindaprasad, Sumit Gupta, Sungmin Cho, Sunny Virk, Suraj Subramanian, Sy Choudhury, Sydney Goldman, Tal Remez, Tamar Glaser, Tamara Best, Thilo Kohler, Thomas Robinson, Tianhe Li, Tianjun Zhang, Tim Matthews, Timothy Chou, Tzook Shaked, Varun Vontimitta, Victoria Ajayi, Victoria Montanez, Vijai Mohan, Vinay Satish Kumar, Vishal Mangla, Vítor Albiero, Vlad Ionescu, Vlad Poenaru, Vlad Tiberiu Mihailescu, Vladimir Ivanov, Wei Li, Wenchen Wang, Wenwen Jiang, Wes Bouaziz, Will Constable, Xiaocheng Tang, Xiaofang Wang, Xiaojian Wu, Xiaolan Wang, Xide Xia, Xilun Wu, Xinbo Gao, Yanjun Chen, Ye Hu, Ye Jia, Ye Qi, Yenda Li, Yilin Zhang, Ying Zhang, Yossi Adi, Youngjin Nam, Yu, Wang, Yuchen Hao, Yundi Qian, Yuzi He, Zach Rait, Zachary DeVito, Zef Rosnbrick, Zhaoduo Wen, Zhenyu Yang, and Zhiwei Zhao. The Llama 3 Herd of Models, 2024.
  8. Sergey Edunov, Myle Ott, Michael Auli, and David Grangier. Understanding Back-Translation at Scale In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 489–500, Association for Computational Linguistics, Brussels, Belgium, 2018. (http://doi.org/10.18653/v1/D18-1045)
  9. Miquel Esplà-Gomis, Víctor M. Sánchez-Cartagena, Juan Antonio Pérez-Ortiz, and Felipe Sánchez-Martínez. Cross-lingual neural fuzzy matching for exploiting target-language monolingual corpora in computer-aided translation In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 7532–7543, Association for Computational Linguistics, Abu Dhabi, United Arab Emirates, 2022. (http://doi.org/10.18653/v1/2022.emnlp-main.511)
  10. Marzieh Fadaee, Arianna Bisazza, and Christof Monz. Data Augmentation for Low-Resource Neural Machine Translation In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 567–573, Association for Computational Linguistics, Vancouver, Canada, 2017. (http://doi.org/10.18653/v1/P17-2090)
  11. Yang Feng, Shiyue Zhang, Andi Zhang, Dong Wang, and Andrew Abel. Memory-augmented Neural Machine Translation In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 1390–1399, Association for Computational Linguistics, Copenhagen, Denmark, 2017. (http://doi.org/10.18653/v1/D17-1146)
  12. Fangxiaoyu Feng, Yinfei Yang, Daniel Cer, Naveen Arivazhagan, and Wei Wang. Language-agnostic BERT Sentence Embedding In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 878–891, Association for Computational Linguistics, Dublin, Ireland, 2022. (http://doi.org/10.18653/v1/2022.acl-long.62)
  13. Jiatao Gu, Yong Wang, Kyunghyun Cho, and Victor O. K. Li. Search engine guided neural machine translation In Proceedings of the 32nd AAAI Conference on Artificial Intelligence, pages 5133-5140, Association for the Advancement of Artificial Intelligence, New Orleans, Louisiana, USA, 2018. (http://doi.org/10.1609/aaai.v32i1.12013)
  14. Jiatao Gu, Changhan Wang, and Junbo Zhao. Levenshtein Transformer In Advances in Neural Information Processing Systems 32, pages , Curran Associates, Inc., 2019.
  15. Caglar Gulcehre, Orhan Firat, Kelvin Xu, Kyunghyun Cho, Loïc Barrault, Huei-Chi Lin, Fethi Bougares, Holger Schwenk, and Y. Bengio. On Using Monolingual Corpora in Neural Machine Translation, pages , 2015.
  16. Qiuxiang He, Guoping Huang, Qu Cui, Li Li, and Lemao Liu. Fast and Accurate Neural Machine Translation with Translation Memory In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 3170–3180, Association for Computational Linguistics, Online, 2021. (http://doi.org/10.18653/v1/2021.acl-long.246)
  17. Sébastien Jean, Orhan Firat, Kyunghyun Cho, Roland Memisevic, and Yoshua Bengio. Montreal Neural Machine Translation Systems for WMT'15 In Proceedings of the Tenth Workshop on Statistical Machine Translation, pages 134–140, Association for Computational Linguistics, Lisbon, Portugal, 2015. (http://doi.org/10.18653/v1/W15-3014)
  18. Albert Q. Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, Lélio Renard Lavaud, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix, and William El Sayed. Mistral 7B, 2023.
  19. Wenxiang Jiao, Wenxuan Wang, Jen-tse Huang, Xing Wang, Shuming Shi, and Zhaopeng Tu. Is ChatGPT A Good Translator? Yes With GPT-4 As The Engine, 2023.
  20. J. Johnson, M. Douze, and H. Jegou. Billion-Scale Similarity Search with GPUs IEEE Transactions on Big Data 7, pages 535-547, IEEE Computer Society, Los Alamitos, CA, USA, 2021. (http://doi.org/10.1109/TBDATA.2019.2921572)
  21. Urvashi Khandelwal, Angela Fan, Dan Jurafsky, Luke Zettlemoyer, and Mike Lewis. Nearest Neighbor Machine Translation, 2021.
  22. Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, and Alexander M Rush. OpenNMT: Open-source toolkit for neural machine translation Computing Research Repository arXiv:1701.02810, 2017. (http://doi.org/10.18653/v1/P17-4012)
  23. Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondřej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Philipp Koehn, Benjamin Marie, Christof Monz, Makoto Morishita, Kenton Murray, Makoto Nagata, Toshiaki Nakazawa, Martin Popel, Maja Popović, and Mariya Shmatova. Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet In Proceedings of the Eighth Conference on Machine Translation, pages 1–42, Association for Computational Linguistics, Singapore, 2023. (http://doi.org/10.18653/v1/2023.wmt-1.1)
  24. Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Marzena Karpinska, Philipp Koehn, Benjamin Marie, Kenton Murray, Masaaki Nagata, Martin Popel, Maja Popovic, Mariya Shmatova, Steinþór Steingrímsson, and Vilém Zouhar. Preliminary WMT24 Ranking of General MT Systems and LLMs, 2024.
  25. Philipp Koehn. Statistical Significance Tests for Machine Translation Evaluation In Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing, pages 388–395, Association for Computational Linguistics, Barcelona, Spain, 2004.
  26. Taku Kudo and John Richardson. SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 66–71, Association for Computational Linguistics, Brussels, Belgium, 2018. (http://doi.org/10.18653/v1/D18-2012)
  27. Yasmin Moslem, Rejwanul Haque, John D. Kelleher, and Andy Way. Adaptive Machine Translation with Large Language Models In Proceedings of the 24th Annual Conference of the European Association for Machine Translation, pages 227–237, European Association for Machine Translation, Tampere, Finland, 2023.
  28. Yasmin Moslem, Rejwanul Haque, and Andy Way. Fine-tuning Large Language Models for Adaptive Machine Translation, 2023.
  29. Yongyu Mu, Abudurexiti Reheman, Zhiquan Cao, Yuchun Fan, Bei Li, Yinqiao Li, Tong Xiao, Chunliang Zhang, and Jingbo Zhu. Augmenting Large Language Model Translators via Translation Memories In Findings of the Association for Computational Linguistics: ACL 2023, pages 10287–10299, Association for Computational Linguistics, Toronto, Canada, 2023. (http://doi.org/10.18653/v1/2023.findings-acl.653)
  30. Nathan Ng, Kyra Yee, Alexei Baevski, Myle Ott, Michael Auli, and Sergey Edunov. Facebook FAIR's WMT19 News Translation Task Submission In Proceedings of the Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1), pages 314–319, Association for Computational Linguistics, Florence, Italy, 2019. (http://doi.org/10.18653/v1/W19-5333)
  31. Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul F Christiano, Jan Leike, and Ryan Lowe. Training language models to follow instructions with human feedback In Advances in Neural Information Processing Systems 35, pages 27730–27744, Curran Associates, Inc., 2022.
  32. Matteo Pagliardini, Prakhar Gupta, and Martin Jaggi. Unsupervised Learning of Sentence Embeddings Using Compositional n-Gram Features In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pages 528–540, Association for Computational Linguistics, New Orleans, Louisiana, USA, 2018. (http://doi.org/10.18653/v1/N18-1049)
  33. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. BLEU: a method for automatic evaluation of machine translation In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, pages 311–318, Association for Computational Linguistics, USA, 2002. (http://doi.org/10.3115/1073083.1073135)
  34. Keqin Peng, Liang Ding, Qihuang Zhong, Li Shen, Xuebo Liu, Min Zhang, Yuanxin Ouyang, and Dacheng Tao. Towards Making the Most of ChatGPT for Machine Translation In The 2023 Conference on Empirical Methods in Natural Language Processing, 2023. (http://doi.org/10.18653/v1/2023.findings-emnlp.373)
  35. Minh Quang Pham, Jitao Xu, Josep Crego, François Yvon, and Jean Senellart. Priming Neural Machine Translation In Proceedings of the Fifth Conference on Machine Translation, pages 516–527, Association for Computational Linguistics, Online, 2020.
  36. Maja Popović. chrF: character n-gram F-score for automatic MT evaluation In Proceedings of the Tenth Workshop on Statistical Machine Translation, pages 392–395, Association for Computational Linguistics, Lisbon, Portugal, 2015. (http://doi.org/10.18653/v1/W15-3049)
  37. Matt Post. A Call for Clarity in Reporting BLEU Scores In Proceedings of the Third Conference on Machine Translation: Research Papers, pages 186–191, Association for Computational Linguistics, Belgium, Brussels, 2018. (http://doi.org/10.18653/v1/W18-6319)
  38. Abudurexiti Reheman, Tao Zhou, Yingfeng Luo, Di Yang, Tong Xiao, and Jingbo Zhu. Prompting neural machine translation with translation memories In Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence and Thirty-Fifth Conference on Innovative Applications of Artificial Intelligence and Thirteenth Symposium on Educational Advances in Artificial Intelligence, AAAI Press, 2023. (http://doi.org/10.1609/aaai.v37i11.26585)
  39. Ricardo Rei, Craig Stewart, Ana C Farinha, and Alon Lavie. COMET: A Neural Framework for MT Evaluation In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 2685–2702, Association for Computational Linguistics, Online, 2020. (http://doi.org/10.18653/v1/2020.emnlp-main.213)
  40. Rico Sennrich, Barry Haddow, and Alexandra Birch. Improving Neural Machine Translation Models with Monolingual Data In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 86–96, Association for Computational Linguistics, Berlin, Germany, 2016. (http://doi.org/10.18653/v1/P16-1009)
  41. Jungha Son and Boyoung Kim. Translation Performance from the User's Perspective of Large Language Models and Neural Machine Translation Systems Information 14, 2023. (http://doi.org/10.3390/info14100574)
  42. Ralf Steinberger, Andreas Eisele, Szymon Klocek, Spyridon Pilos, and Patrick Schlüter. DGT-TM: A freely available Translation Memory in 22 languages In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 454–459, European Language Resources Association (ELRA), Istanbul, Turkey, 2012.
  43. Takuya Tamura, Xiaotian Wang, Takehito Utsuro, and Masaaki Nagata. Target Language Monolingual Translation Memory based NMT by Cross-lingual Retrieval of Similar Translations and Reranking In Proceedings of Machine Translation Summit XIX, Vol. 1: Research Track, pages 313–323, 2023.
  44. Teven Le Scao, Angela Fan, Christopher Akiki, Ellie Pavlick, Suzana Ilic, Daniel Hesslow, Roman Castagné, Alexandra Sasha Luccioni, François Yvon, Matthias Gallé, Jonathan Tow, Alexander M. Rush, Stella Biderman, Albert Webson, Pawan Sasanka Ammanamanchi, Thomas Wang, Benoıt Sagot, Niklas Muennighoff, Albert Villanova del Moral, Olatunji Ruwase, Rachel Bawden, Stas Bekman, Angelina McMillan-Major, Iz Beltagy, Huu Nguyen, Lucile Saulnier, Samson Tan, Pedro Ortiz Suarez, Victor Sanh, Hugo Laurençon, Yacine Jernite, Julien Launay, Margaret Mitchell, Colin Raffel, Aaron Gokaslan, Adi Simhi, Aitor Soroa, Alham Fikri Aji, Amit Alfassy, Anna Rogers, Ariel Kreisberg Nitzav, Canwen Xu, Chenghao Mou, Chris Emezue, Christopher Klamm, Colin Leong, Daniel van Strien, David Ifeoluwa Adelani, and et al.. BLOOM: A 176B-Parameter Open-Access Multilingual Language Model CoRR abs/2211.05100, 2022. (http://doi.org/10.48550/ARXIV.2211.05100)
  45. Arda Tezcan, Bram Bulté, and Bram Vanroy. Towards a Better Integration of Fuzzy Matches in Neural Machine Translation through Data Augmentation Informatics 8, 2021. (http://doi.org/10.3390/informatics8010007)
  46. Arda Tezcan and Bram Bulté. Evaluating the impact of integrating similar translations into neural machine translation INFORMATION 13, pages 33, 2022. (http://doi.org/10.3390/info13010019)
  47. Bram Vanroy, Arda Tezcan, and Lieve Macken. MATEO: MAchine Translation Evaluation Online In Proceedings of the 24th Annual Conference of the European Association for Machine Translation, pages 499–500, European Association for Machine Translation (EAMT), 2023.
  48. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need In Advances in neural information processing systems, pages 5998–6008, 2017.
  49. Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, and William Fedus. Emergent Abilities of Large Language Models Transactions on Machine Learning Research, Survey Certification, 2022.
  50. Nuo Xu, Yinqiao Li, Chen Xu, Yanyang Li, Bei Li, Tong Xiao, and Jingbo Zhu. Analysis of Back-Translation Methods for Low-Resource Neural Machine Translation In Natural Language Processing and Chinese Computing: 8th CCF International Conference, NLPCC 2019, Dunhuang, China, October 9–14, 2019, Proceedings, Part II, pages 466–475, Springer-Verlag, Berlin, Heidelberg, 2019. (http://doi.org/10.1007/978-3-030-32236-6_42)
  51. Jitao Xu, Josep Crego, and Jean Senellart. Boosting Neural Machine Translation with Similar Translations In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 1580–1590, Association for Computational Linguistics, Online, 2020. (http://doi.org/10.18653/v1/2020.acl-main.144)
  52. Jitao Xu, Minh Quang Pham, Sadaf Abdul Rauf, and François Yvon. LISN @ WMT 2021 In Proceedings of the Sixth Conference on Machine Translation, pages 232–242, Association for Computational Linguistics, Online, 2021.
  53. Jitao Xu, Josep Crego, and François Yvon. Integrating Translation Memories into Non-Autoregressive Machine Translation In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pages 1326–1338, Association for Computational Linguistics, Dubrovnik, Croatia, 2023. (http://doi.org/10.18653/v1/2023.eacl-main.96)
  54. Jingyi Zhang, Masao Utiyama, Eiichro Sumita, Graham Neubig, and Satoshi Nakamura. Guiding Neural Machine Translation with Retrieved Translation Pieces In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pages 1325–1335, Association for Computational Linguistics, New Orleans, Louisiana, 2018. (http://doi.org/10.18653/v1/N18-1120)