Menu
Home
People
Places
Arts
History
Plants & Animals
Science
Life & Culture
Technology
Reference.org
Google Neural Machine Translation
open-in-new
<h2 id="history">History</h2> <p>The <a href="/facts/Google_Brain/yp0eeKSX">Google Brain</a> project was established in 2011 in the "secretive Google X research lab"<a class="footnote-ref" id="fnref:18" href="#fn:18"><sup>18</sup></a> by Google Fellow <a href="/facts/Jeff_Dean_(computer_scientist)/YIEWyTM4">Jeff Dean</a>, Google Researcher Greg Corrado, and <a href="/facts/Stanford_University/JEQeF9z2">Stanford University</a> Computer Science professor <a href="/facts/Andrew_Ng/q0WyebIh">Andrew Ng</a>.<a class="footnote-ref" id="fnref:19" href="#fn:19"><sup>19</sup></a><a class="footnote-ref" id="fnref:20" href="#fn:20"><sup>20</sup></a><a class="footnote-ref" id="fnref:21" href="#fn:21"><sup>21</sup></a> Ng's work has led to some of the biggest breakthroughs at Google and Stanford.<a class="footnote-ref" id="fnref:22" href="#fn:22"><sup>22</sup></a> </p><p>In November 2016, Google Neural Machine Translation system (GNMT) was introduced. Since then, Google Translate began using neural machine translation (NMT) in preference to its previous <a href="/facts/Statistical_machine_translation/rzJ8Gfyj">statistical methods</a> (SMT)<a class="footnote-ref" id="fnref:23" href="#fn:23"><sup>23</sup></a><a class="footnote-ref" id="fnref:24" href="#fn:24"><sup>24</sup></a><a class="footnote-ref" id="fnref:25" href="#fn:25"><sup>25</sup></a><a class="footnote-ref" id="fnref:26" href="#fn:26"><sup>26</sup></a> which had been used since October 2007, with its proprietary, in-house SMT technology.<a class="footnote-ref" id="fnref:27" href="#fn:27"><sup>27</sup></a><a class="footnote-ref" id="fnref:28" href="#fn:28"><sup>28</sup></a> </p><p>Training GNMT was a big effort at the time and took, by a 2021 OpenAI estimate, on the order of 100 PFLOP/s*day (up to 1022 FLOPs) of compute which was 1.5 orders of magnitude larger than <a href="/facts/Seq2seq/t0XBoV4t">Seq2seq</a> model of 2014<a class="footnote-ref" id="fnref:29" href="#fn:29"><sup>29</sup></a> (but about 2x smaller than <a href="/facts/GPT-J/scKaj0wn">GPT-J-6B</a> in 2021<a class="footnote-ref" id="fnref:30" href="#fn:30"><sup>30</sup></a>). </p><p>Google Translate's NMT system uses a large artificial neural network capable of <a href="/facts/Deep_learning/JLuwD3ea">deep learning</a>.<a class="footnote-ref" id="fnref:31" href="#fn:31"><sup>31</sup></a><a class="footnote-ref" id="fnref:32" href="#fn:32"><sup>32</sup></a><a class="footnote-ref" id="fnref:33" href="#fn:33"><sup>33</sup></a> By using millions of examples, GNMT improves the quality of translation,<a class="footnote-ref" id="fnref:34" href="#fn:34"><sup>34</sup></a> using broader context to deduce the most relevant translation. The result is then rearranged and adapted to approach grammatically based human language.<a class="footnote-ref" id="fnref:35" href="#fn:35"><sup>35</sup></a> GNMT's proposed architecture of system learning was first tested on over a hundred languages supported by Google Translate.<a class="footnote-ref" id="fnref:36" href="#fn:36"><sup>36</sup></a> GNMT did not create its own universal interlingua but rather aimed at finding the commonality between many languages using insights from psychology and linguistics.<a class="footnote-ref" id="fnref:37" href="#fn:37"><sup>37</sup></a> The new translation engine was first enabled for eight languages: to and from English and French, German, Spanish, Portuguese, Chinese, Japanese, Korean and Turkish in November 2016.<a class="footnote-ref" id="fnref:38" href="#fn:38"><sup>38</sup></a> In March 2017, three additional languages were enabled: Russian, Hindi and Vietnamese along with Thai for which support was added later.<a class="footnote-ref" id="fnref:39" href="#fn:39"><sup>39</sup></a><a class="footnote-ref" id="fnref:40" href="#fn:40"><sup>40</sup></a> Support for Hebrew and Arabic was also added with help from the Google Translate Community in the same month.<a class="footnote-ref" id="fnref:41" href="#fn:41"><sup>41</sup></a> In mid April 2017 Google Netherlands announced support for Dutch and other European languages related to English.<a class="footnote-ref" id="fnref:42" href="#fn:42"><sup>42</sup></a> Further support was added for nine Indian languages: Hindi, Bengali, Marathi, Gujarati, Punjabi, Tamil, Telugu, Malayalam and Kannada at the end of April 2017.<a class="footnote-ref" id="fnref:43" href="#fn:43"><sup>43</sup></a> </p><p>By 2020, Google had changed methodology to use a different neural network system based on <a href="/facts/Transformer_(deep_learning_architecture)/cDbjx6a8">transformers</a>, and had phased out NMT.<a class="footnote-ref" id="fnref:44" href="#fn:44"><sup>44</sup></a> </p> <h2 id="evaluation">Evaluation</h2> <p>The GNMT system was said to represent an improvement over the former Google Translate in that it will be able to handle "zero-shot translation", that is it directly translates one language into another. For example, it might be trained just for Japanese-English and Korean-English translation, but can perform Japanese-Korean translation. The system appears to have learned to produce a language-independent intermediate representation of language (an "<a href="/facts/Interlingual_machine_translation/NNCdra1F">interlingua</a>"), which allows it to perform zero-shot translation by converting from and to the interlingua.<a class="footnote-ref" id="fnref:45" href="#fn:45"><sup>45</sup></a> Google Translate previously first translated the <a href="/facts/Source_language_(translation)/2foI82so">source language</a> into English and then translated the English into the <a href="/facts/Target_language_(translation)/2foI82so">target language</a> rather than translating directly from one language to another.<a class="footnote-ref" id="fnref:46" href="#fn:46"><sup>46</sup></a> </p><p>A July 2019 study in <i><a href="/facts/Annals_of_Internal_Medicine/Shs6Flk8">Annals of Internal Medicine</a></i> found that "Google Translate is a viable, accurate tool for translating non–English-language trials". Only one disagreement between reviewers reading machine-translated trials was due to a translation error. Since many medical studies are excluded from systematic reviews because the reviewers do not understand the language, GNMT has the potential to reduce bias and improve accuracy in such reviews.<a class="footnote-ref" id="fnref:47" href="#fn:47"><sup>47</sup></a> </p> <h2 id="languages-supported-by-gnmt">Languages supported by GNMT</h2> <p>As of December 2021, all of the languages of <a href="/facts/Google_Translate/AR0cRb9n">Google Translate</a> support GNMT, with Latin being the most recent addition. </p> <ol><li><a href="/facts/Afrikaans/jYqEPHmA">Afrikaans</a></li> <li><a href="/facts/Albanian_language/6CyC8GPJ">Albanian</a></li> <li><a href="/facts/Amharic/zVHLsajh">Amharic</a></li> <li><a href="/facts/Arabic/A1e66hVV">Arabic</a></li> <li><a href="/facts/Armenian_language/tELuE2wG">Armenian</a></li> <li><a href="/facts/Azerbaijani_language/RBrpdUk2">Azerbaijani</a></li> <li><a href="/facts/Basque_language/rEMpH97p">Basque</a></li> <li><a href="/facts/Belarusian_language/yRuE1cfX">Belarusian</a></li> <li><a href="/facts/Bengali_language/twpKobqA">Bengali</a></li> <li><a href="/facts/Bosnian_language/T6magSgv">Bosnian</a></li> <li><a href="/facts/Bulgarian_language/susG15pr">Bulgarian</a></li> <li><a href="/facts/Burmese_language/1gpcvawX">Burmese</a></li> <li><a href="/facts/Catalan_language/W2uTbK8Q">Catalan</a></li> <li><a href="/facts/Cebuano_language/0vPDCHcX">Cebuano</a></li> <li><a href="/facts/Chewa_language/opzPQNQH">Chewa</a></li> <li><a href="/facts/Chinese_language/771ruUY1">Chinese</a> (<a href="/facts/Simplified_Chinese_characters/UcAD6xXs">Simplified</a>)</li> <li><a href="/facts/Chinese_language/771ruUY1">Chinese</a> (<a href="/facts/Traditional_Chinese_characters/bBFLkuz7">Traditional</a>)</li> <li><a href="/facts/Corsican_language/QjwJhhJt">Corsican</a></li> <li><a href="/facts/Croatian_language/o2Y8WHuy">Croatian</a></li> <li><a href="/facts/Czech_language/ySvEftdh">Czech</a></li> <li><a href="/facts/Danish_language/sTcGXTMJ">Danish</a></li> <li><a href="/facts/Dutch_language/yIB5lbsx">Dutch</a></li> <li><a href="/facts/English_language/tpkxGt7b">English</a></li> <li><a href="/facts/Esperanto/5cWPoLuM">Esperanto</a></li> <li><a href="/facts/Estonian_language/ywCJos4e">Estonian</a></li> <li><a href="/facts/Filipino_language/sFspmMjH">Filipino</a> (<a href="/facts/Tagalog_language/G8UARRIl">Tagalog</a>)</li> <li><a href="/facts/Finnish_language/lBuEIgs0">Finnish</a></li> <li><a href="/facts/French_language/qe1DnaQh">French</a></li> <li><a href="/facts/Galician_language/bGIhIvMX">Galician</a></li> <li><a href="/facts/Georgian_language/DoKtMLfq">Georgian</a></li> <li><a href="/facts/German_language/oWaQIDA8">German</a></li> <li><a href="/facts/Greek_language/pzDd6eIz">Greek</a></li> <li><a href="/facts/Gujarati_language/kGKRRbwe">Gujarati</a></li> <li><a href="/facts/Haitian_Creole/9serl3cP">Haitian Creole</a></li> <li><a href="/facts/Hausa_language/hQF3HW8r">Hausa</a></li> <li><a href="/facts/Hawaiian_language/SsQuMKm9">Hawaiian</a></li> <li><a href="/facts/Hebrew_language/hqKCSy9d">Hebrew</a></li> <li><a href="/facts/Hindi/n1QIEeCC">Hindi</a></li> <li><a href="/facts/Hmong_language/rAVAmkzy">Hmong</a></li> <li><a href="/facts/Hungarian_language/nt4g0ano">Hungarian</a></li> <li><a href="/facts/Icelandic_language/4GmzhaoT">Icelandic</a></li> <li><a href="/facts/Igbo_language/K08WN17k">Igbo</a></li> <li><a href="/facts/Indonesian_language/J8Q78Ywb">Indonesian</a></li> <li><a href="/facts/Irish_language/Kw97s2l4">Irish</a></li> <li><a href="/facts/Italian_language/YXsmvlQG">Italian</a></li> <li><a href="/facts/Japanese_language/EEv485a5">Japanese</a></li> <li><a href="/facts/Javanese_language/la4H713D">Javanese</a></li> <li><a href="/facts/Kannada/cooJ3trn">Kannada</a></li> <li><a href="/facts/Kazakh_language/rh22ccFt">Kazakh</a></li> <li><a href="/facts/Khmer_language/RVR7NyzQ">Khmer</a></li> <li><a href="/facts/Kinyarwanda/ugcnn7Fh">Kinyarwanda</a></li> <li><a href="/facts/Korean_language/dmNnRxAA">Korean</a></li> <li><a href="/facts/Kurdish_languages/6LSckYAz">Kurdish</a> (<a href="/facts/Kurmanji/4pp4wtq5">Kurmanji</a>)</li> <li><a href="/facts/Kyrgyz_language/jnuN76wT">Kyrgyz</a></li> <li><a href="/facts/Lao_language/Gfwndgl0">Lao</a></li> <li><a href="/facts/Latin/pM3Kge85">Latin</a></li> <li><a href="/facts/Latvian_language/1LRCJorI">Latvian</a></li> <li><a href="/facts/Lithuanian_language/p0bS9M0R">Lithuanian</a></li> <li><a href="/facts/Luxembourgish/HsVzn2YA">Luxembourgish</a></li> <li><a href="/facts/Macedonian_language/FdnWMYBR">Macedonian</a></li> <li><a href="/facts/Malagasy_language/KefIavD1">Malagasy</a></li> <li><a href="/facts/Malay_language/2T6pPtgv">Malay</a></li> <li><a href="/facts/Malayalam/YLuvDWd3">Malayalam</a></li> <li><a href="/facts/Maltese_language/Rgelh3pf">Maltese</a></li> <li><a href="/facts/M%C4%81ori_language/pVhKfILB">Maori</a></li> <li><a href="/facts/Marathi_language/uIJuwlFW">Marathi</a></li> <li><a href="/facts/Mongolian_language/0Lxog7Md">Mongolian</a></li> <li><a href="/facts/Nepali_language/TSC8VdAw">Nepali</a></li> <li><a href="/facts/Norwegian_language/TGEyeerM">Norwegian</a> (<a href="/facts/Bokm%C3%A5l/9HkIMEGV">Bokmål</a>)</li> <li><a href="/facts/Odia_language/RCSkWVSf">Odia</a></li> <li><a href="/facts/Pashto/hc2ndCqx">Pashto</a></li> <li><a href="/facts/Persian_language/jfUYbHbt">Persian</a></li> <li><a href="/facts/Polish_language/lzpvYDvV">Polish</a></li> <li><a href="/facts/Portuguese_language/vr3Fwzw3">Portuguese</a></li> <li><a href="/facts/Punjabi_language/Dps9vRRe">Punjabi</a> (<a href="/facts/Gurmukhi/u6Nt0z14">Gurmukhi</a>)</li> <li><a href="/facts/Romanian_language/zAY3GnkL">Romanian</a></li> <li><a href="/facts/Russian_language/ETXrTgHV">Russian</a></li> <li><a href="/facts/Samoan_language/mpCAULTg">Samoan</a></li> <li><a href="/facts/Scottish_Gaelic/KMI4MmzJ">Scottish Gaelic</a></li> <li><a href="/facts/Serbian_language/quNDpTCd">Serbian</a></li> <li><a href="/facts/Shona_language/HAzrhG6V">Shona</a></li> <li><a href="/facts/Sindhi_language/fQFk8mVz">Sindhi</a></li> <li><a href="/facts/Sinhala_language/qfPUFGYS">Sinhala</a></li> <li><a href="/facts/Slovak_language/HmmobnJ8">Slovak</a></li> <li><a href="/facts/Slovene_language/09YPyUQr">Slovenian</a></li> <li><a href="/facts/Somali_language/EqN6P5e0">Somali</a></li> <li><a href="/facts/Sotho_language/v4nqXojT">Sotho</a></li> <li><a href="/facts/Spanish_language/95BgYNfv">Spanish</a></li> <li><a href="/facts/Sundanese_language/tvI3v8gE">Sundanese</a></li> <li><a href="/facts/Swahili_language/sLzhutLC">Swahili</a></li> <li><a href="/facts/Swedish_language/1DkSIXkH">Swedish</a></li> <li><a href="/facts/Tajik_language/JsPpW9rI">Tajik</a></li> <li><a href="/facts/Tamil_language/7I0lHL0d">Tamil</a></li> <li><a href="/facts/Tatar_language/PfbDcPds">Tatar</a></li> <li><a href="/facts/Telugu_language/yV5dQWhw">Telugu</a></li> <li><a href="/facts/Thai_language/PnaLdG77">Thai</a></li> <li><a href="/facts/Turkish_language/C5X56Ijp">Turkish</a></li> <li><a href="/facts/Turkmen_language/83a4zv7w">Turkmen</a></li> <li><a href="/facts/Ukrainian_language/2zDw7rpD">Ukrainian</a></li> <li><a href="/facts/Urdu/oLrhuXc6">Urdu</a></li> <li><a href="/facts/Uyghur_language/RdlQY3hQ">Uyghur</a></li> <li><a href="/facts/Uzbek_language/ovLJMy4J">Uzbek</a></li> <li><a href="/facts/Vietnamese_language/J3Pbx58C">Vietnamese</a></li> <li><a href="/facts/Welsh_language/4Pz8r6yk">Welsh</a></li> <li><a href="/facts/West_Frisian_language/h7PVP7S6">West Frisian</a></li> <li><a href="/facts/Xhosa_language/5D8WmHT0">Xhosa</a></li> <li><a href="/facts/Yiddish/VfmsR6pW">Yiddish</a></li> <li><a href="/facts/Yoruba_language/q5osdFqR">Yoruba</a></li> <li><a href="/facts/Zulu_language/qzd3p6Yr">Zulu</a></li></ol> <h2 id="see-also">See also</h2> <ul><li><a href="/facts/Example-based_machine_translation/GhXgEDyU">Example-based machine translation</a></li> <li><a href="/facts/Rule-based_machine_translation/BwS2KWX3">Rule-based machine translation</a></li> <li><a href="/facts/Comparison_of_machine_translation_applications/TPk4Hov5">Comparison of machine translation applications</a></li> <li><a href="/facts/Statistical_machine_translation/rzJ8Gfyj">Statistical machine translation</a></li> <li><a href="/facts/Artificial_intelligence/lJGauQwX">Artificial intelligence</a></li> <li><a href="/facts/Cache_language_model/j3G58KP0">Cache language model</a></li> <li><a href="/facts/Computational_linguistics/XmegJ6LC">Computational linguistics</a></li> <li><a href="/facts/Computer-assisted_translation/JHebmnfD">Computer-assisted translation</a></li> <li><a href="/facts/History_of_machine_translation/uNeJC6H0">History of machine translation</a></li> <li><a href="/facts/List_of_emerging_technologies/00drktJ6">List of emerging technologies</a></li> <li><a href="/facts/List_of_research_laboratories_for_machine_translation/BRcsdfSV">List of research laboratories for machine translation</a></li> <li><a href="/facts/Neural_machine_translation/BsjdmTSt">Neural machine translation</a></li> <li><a href="/facts/Machine_translation/DGF3NwuI">Machine translation</a></li> <li><a href="/facts/Universal_translator/A6hvCYBV">Universal translator</a></li></ul> <h2 id="external-links">External links</h2> Wikiversity has learning resources about <i>Topic:Computational linguistics</i> <ul><li><a href="https://arxiv.org/abs/1609.08144">Google’s Neural Machine Translation System: Bridging the Gap between Human and Machine Translation</a></li> <li><a href="http://www.omniglot.com/language/articles/machinetranslation.htm">The Advantages and Disadvantages of Machine Translation</a></li> <li><a href="http://www.statmt.org/">Statistical Machine Translation</a></li> <li><a href="http://www.eamt.org/iamt.php">International Association for Machine Translation (IAMT)</a> <a href="https://web.archive.org/web/20100624162302/http://www.eamt.org/iamt.php">Archived</a> June 24, 2010, at the <a href="/facts/Wayback_Machine/nmQ3a6JC">Wayback Machine</a></li> <li><a href="http://www.mt-archive.info">Machine Translation Archive</a> <a href="https://web.archive.org/web/20190401232615/http://www.mt-archive.info/">Archived</a> April 1, 2019, at the <a href="/facts/Wayback_Machine/nmQ3a6JC">Wayback Machine</a> by <a href="/facts/W._John_Hutchins/hSnyXHIw">John Hutchins</a>. An electronic repository (and bibliography) of articles, books and papers in the field of machine translation and computer-based translation technology</li> <li><a href="http://www.hutchinsweb.me.uk/">Machine translation (computer-based translation)</a> – Publications by John Hutchins (includes <a href="/facts/PDF_format/C9Mn1vYL">PDFs</a> of several books on machine translation)</li></ul> <h2 id="references">References</h2> <ol> <li id="fn:1"><p>Barak Turovsky (November 15, 2016), "Found in translation: More accurate, fluent sentences in Google Translate", Google Blog, retrieved January 11, 2017 <a href="https://blog.google/products/translate/found-translation-more-accurate-fluent-sentences-google-translate/" target="_blank">https://blog.google/products/translate/found-translation-more-accurate-fluent-sentences-google-translate/</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></p></li> <li id="fn:2"><p>Mike Schuster; Melvin Johnson; Nikhil Thorat (November 22, 2016), "Zero-Shot Translation with Google's Multilingual Neural Machine Translation System", Google Research Blog, retrieved January 11, 2017 <a href="https://research.googleblog.com/2016/11/zero-shot-translation-with-googles.html" target="_blank">https://research.googleblog.com/2016/11/zero-shot-translation-with-googles.html</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></p></li> <li id="fn:3"><p>Gil Fewster (January 5, 2017), "The mind-blowing AI announcement from Google that you probably missed", freeCodeCamp, retrieved January 11, 2017 <a href="https://medium.freecodecamp.com/the-mind-blowing-ai-announcement-from-google-that-you-probably-missed-2ffd31334805#.msj1mdvbh" target="_blank">https://medium.freecodecamp.com/the-mind-blowing-ai-announcement-from-google-that-you-probably-missed-2ffd31334805#.msj1mdvbh</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></p></li> <li id="fn:4"><p>Wu, Yonghui; Schuster, Mike; Chen, Zhifeng; Le, Quoc V.; Norouzi, Mohammad (2016). "Google's neural machine translation system: Bridging the gap between human and machine translation". arXiv:1609.08144. Bibcode:2016arXiv160908144W. {{cite journal}}: Cite journal requires |journal= (help) <a href="/wiki/ArXiv_(identifier)" target="_blank">/wiki/ArXiv_(identifier)</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></p></li> <li id="fn:5"><p>Wu, Yonghui; Schuster, Mike; Chen, Zhifeng; Le, Quoc V.; Norouzi, Mohammad (2016). "Google's neural machine translation system: Bridging the gap between human and machine translation". arXiv:1609.08144. Bibcode:2016arXiv160908144W. {{cite journal}}: Cite journal requires |journal= (help) <a href="/wiki/ArXiv_(identifier)" target="_blank">/wiki/ArXiv_(identifier)</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></p></li> <li id="fn:6"><p>"Peeking into the neural network architecture used for Google's Neural Machine Translation". <a href="https://smerity.com/articles/2016/google_nmt_arch.html" target="_blank">https://smerity.com/articles/2016/google_nmt_arch.html</a> <a href="#fnref:6" class="footnote-back-ref">↩</a></p></li> <li id="fn:7"><p>Qin, Minghai; Zhang, Tianyun; Sun, Fei; Chen, Yen-Kuang; Fardad, Makan; Wang, Yanzhi; Xie, Yuan (2021). "Compact Multi-level Sparse Neural Networks with Input Independent Dynamic Rerouting". arXiv:2112.10930 [cs.NE]. <a href="/wiki/ArXiv_(identifier)" target="_blank">/wiki/ArXiv_(identifier)</a> <a href="#fnref:7" class="footnote-back-ref">↩</a></p></li> <li id="fn:8"><p>"Compression of Google Neural Machine Translation Model – NLP Architect by Intel® AI Lab 0.5.5 documentation". <a href="https://intellabs.github.io/nlp-architect/sparse_gnmt.html" target="_blank">https://intellabs.github.io/nlp-architect/sparse_gnmt.html</a> <a href="#fnref:8" class="footnote-back-ref">↩</a></p></li> <li id="fn:9"><p>Langroudi, Hamed F.; Karia, Vedant; Pandit, Tej; Kudithipudi, Dhireesha (2021). "TENT: Efficient Quantization of Neural Networks on the tiny Edge with Tapered FixEd PoiNT". arXiv:2104.02233 [cs.LG]. <a href="/wiki/ArXiv_(identifier)" target="_blank">/wiki/ArXiv_(identifier)</a> <a href="#fnref:9" class="footnote-back-ref">↩</a></p></li> <li id="fn:10"><p>"Data Augmentation | How to use Deep Learning when you have Limited Data". May 19, 2021. <a href="https://nanonets.com/blog/data-augmentation-how-to-use-deep-learning-when-you-have-limited-data-part-2" target="_blank">https://nanonets.com/blog/data-augmentation-how-to-use-deep-learning-when-you-have-limited-data-part-2</a> <a href="#fnref:10" class="footnote-back-ref">↩</a></p></li> <li id="fn:11"><p>"Recent Advances in Google Translate". research.google. Retrieved May 8, 2024. <a href="https://research.google/blog/recent-advances-in-google-translate/" target="_blank">https://research.google/blog/recent-advances-in-google-translate/</a> <a href="#fnref:11" class="footnote-back-ref">↩</a></p></li> <li id="fn:12"><p>Mike Schuster; Melvin Johnson; Nikhil Thorat (November 22, 2016), "Zero-Shot Translation with Google's Multilingual Neural Machine Translation System", Google Research Blog, retrieved January 11, 2017 <a href="https://research.googleblog.com/2016/11/zero-shot-translation-with-googles.html" target="_blank">https://research.googleblog.com/2016/11/zero-shot-translation-with-googles.html</a> <a href="#fnref:12" class="footnote-back-ref">↩</a></p></li> <li id="fn:13"><p>Mike Schuster; Melvin Johnson; Nikhil Thorat (November 22, 2016), "Zero-Shot Translation with Google's Multilingual Neural Machine Translation System", Google Research Blog, retrieved January 11, 2017 <a href="https://research.googleblog.com/2016/11/zero-shot-translation-with-googles.html" target="_blank">https://research.googleblog.com/2016/11/zero-shot-translation-with-googles.html</a> <a href="#fnref:13" class="footnote-back-ref">↩</a></p></li> <li id="fn:14"><p>Barak Turovsky (November 15, 2016), "Found in translation: More accurate, fluent sentences in Google Translate", Google Blog, retrieved January 11, 2017 <a href="https://blog.google/products/translate/found-translation-more-accurate-fluent-sentences-google-translate/" target="_blank">https://blog.google/products/translate/found-translation-more-accurate-fluent-sentences-google-translate/</a> <a href="#fnref:14" class="footnote-back-ref">↩</a></p></li> <li id="fn:15"><p>Barak Turovsky (November 15, 2016), "Found in translation: More accurate, fluent sentences in Google Translate", Google Blog, retrieved January 11, 2017 <a href="https://blog.google/products/translate/found-translation-more-accurate-fluent-sentences-google-translate/" target="_blank">https://blog.google/products/translate/found-translation-more-accurate-fluent-sentences-google-translate/</a> <a href="#fnref:15" class="footnote-back-ref">↩</a></p></li> <li id="fn:16"><p>Mike Schuster; Melvin Johnson; Nikhil Thorat (November 22, 2016), "Zero-Shot Translation with Google's Multilingual Neural Machine Translation System", Google Research Blog, retrieved January 11, 2017 <a href="https://research.googleblog.com/2016/11/zero-shot-translation-with-googles.html" target="_blank">https://research.googleblog.com/2016/11/zero-shot-translation-with-googles.html</a> <a href="#fnref:16" class="footnote-back-ref">↩</a></p></li> <li id="fn:17"><p>Boitet, Christian; Blanchon, Hervé; Seligman, Mark; Bellynck, Valérie (2010). "MT on and for the Web" (PDF). Archived from the original (PDF) on March 29, 2017. Retrieved December 1, 2016. <a href="https://web.archive.org/web/20170329125916/http://www-clips.imag.fr/geta/herve.blanchon/Pdfs/NLP-KE-10.pdf" target="_blank">https://web.archive.org/web/20170329125916/http://www-clips.imag.fr/geta/herve.blanchon/Pdfs/NLP-KE-10.pdf</a> <a href="#fnref:17" class="footnote-back-ref">↩</a></p></li> <li id="fn:18"><p>Robert D. Hof (August 14, 2014). "A Chinese Internet Giant Starts to Dream: Baidu is a fixture of online life in China, but it wants to become a global power. Can one of the world's leading artificial intelligence researchers help it challenge Silicon Valley's biggest companies?". Technology Review. Retrieved January 11, 2017. <a href="https://www.technologyreview.com/s/530016/a-chinese-internet-giant-starts-to-dream/" target="_blank">https://www.technologyreview.com/s/530016/a-chinese-internet-giant-starts-to-dream/</a> <a href="#fnref:18" class="footnote-back-ref">↩</a></p></li> <li id="fn:19"><p>Jeff Dean and Andrew Ng (June 26, 2012). "Using large-scale brain simulations for machine learning and A.I." Official Google Blog. Retrieved January 26, 2015. <a href="http://googleblog.blogspot.com/2012/06/using-large-scale-brain-simulations-for.html" target="_blank">http://googleblog.blogspot.com/2012/06/using-large-scale-brain-simulations-for.html</a> <a href="#fnref:19" class="footnote-back-ref">↩</a></p></li> <li id="fn:20"><p>"Google's Large Scale Deep Neural Networks Project". YouTube. Retrieved October 25, 2015. <a href="https://www.youtube.com/watch?v=KELYHjq9Gbs" target="_blank">https://www.youtube.com/watch?v=KELYHjq9Gbs</a> <a href="#fnref:20" class="footnote-back-ref">↩</a></p></li> <li id="fn:21"><p>Markoff, John (June 25, 2012). "How Many Computers to Identify a Cat? 16,000". New York Times. Retrieved February 11, 2014. <a href="/wiki/John_Markoff" target="_blank">/wiki/John_Markoff</a> <a href="#fnref:21" class="footnote-back-ref">↩</a></p></li> <li id="fn:22"><p>Robert D. Hof (August 14, 2014). "A Chinese Internet Giant Starts to Dream: Baidu is a fixture of online life in China, but it wants to become a global power. Can one of the world's leading artificial intelligence researchers help it challenge Silicon Valley's biggest companies?". Technology Review. Retrieved January 11, 2017. <a href="https://www.technologyreview.com/s/530016/a-chinese-internet-giant-starts-to-dream/" target="_blank">https://www.technologyreview.com/s/530016/a-chinese-internet-giant-starts-to-dream/</a> <a href="#fnref:22" class="footnote-back-ref">↩</a></p></li> <li id="fn:23"><p>Barak Turovsky (November 15, 2016), "Found in translation: More accurate, fluent sentences in Google Translate", Google Blog, retrieved January 11, 2017 <a href="https://blog.google/products/translate/found-translation-more-accurate-fluent-sentences-google-translate/" target="_blank">https://blog.google/products/translate/found-translation-more-accurate-fluent-sentences-google-translate/</a> <a href="#fnref:23" class="footnote-back-ref">↩</a></p></li> <li id="fn:24"><p>Katyanna Quach (November 17, 2016), "Google's neural network learns to translate languages it hasn't been trained on: First time machine translation has used true transfer learning", The Register, retrieved January 11, 2017 <a href="https://www.theregister.co.uk/2016/11/17/googles_neural_net_translates_languages_not_trained_on" target="_blank">https://www.theregister.co.uk/2016/11/17/googles_neural_net_translates_languages_not_trained_on</a> <a href="#fnref:24" class="footnote-back-ref">↩</a></p></li> <li id="fn:25"><p>Lewis-Kraus, Gideon (December 14, 2016). "The Great A.I. Awakening". The New York Times. Retrieved January 11, 2017. <a href="https://www.nytimes.com/2016/12/14/magazine/the-great-ai-awakening.html" target="_blank">https://www.nytimes.com/2016/12/14/magazine/the-great-ai-awakening.html</a> <a href="#fnref:25" class="footnote-back-ref">↩</a></p></li> <li id="fn:26"><p>Le, Quoc; Schuster, Mike (September 27, 2016). "A Neural Network for Machine Translation, at Production Scale". Google Research Blog. Retrieved December 1, 2016. <a href="https://research.googleblog.com/2016/09/a-neural-network-for-machine.html" target="_blank">https://research.googleblog.com/2016/09/a-neural-network-for-machine.html</a> <a href="#fnref:26" class="footnote-back-ref">↩</a></p></li> <li id="fn:27"><p>Google Switches to its Own Translation System, October 22, 2007 <a href="http://googlesystem.blogspot.com/2007/10/google-translate-switches-to-googles.html" target="_blank">http://googlesystem.blogspot.com/2007/10/google-translate-switches-to-googles.html</a> <a href="#fnref:27" class="footnote-back-ref">↩</a></p></li> <li id="fn:28"><p>Barry Schwartz (October 23, 2007). "Google Translate Drops SYSTRAN for Home-Brewed Translation". Search Engine Land. <a href="http://searchengineland.com/google-translate-drops-systran-for-home-brewed-translation-12502" target="_blank">http://searchengineland.com/google-translate-drops-systran-for-home-brewed-translation-12502</a> <a href="#fnref:28" class="footnote-back-ref">↩</a></p></li> <li id="fn:29"><p>"AI and compute". <a href="https://openai.com/research/ai-and-compute" target="_blank">https://openai.com/research/ai-and-compute</a> <a href="#fnref:29" class="footnote-back-ref">↩</a></p></li> <li id="fn:30"><p>"Table of contents". GitHub. <a href="https://github.com/kingoflolz/mesh-transformer-jax" target="_blank">https://github.com/kingoflolz/mesh-transformer-jax</a> <a href="#fnref:30" class="footnote-back-ref">↩</a></p></li> <li id="fn:31"><p>Barak Turovsky (November 15, 2016), "Found in translation: More accurate, fluent sentences in Google Translate", Google Blog, retrieved January 11, 2017 <a href="https://blog.google/products/translate/found-translation-more-accurate-fluent-sentences-google-translate/" target="_blank">https://blog.google/products/translate/found-translation-more-accurate-fluent-sentences-google-translate/</a> <a href="#fnref:31" class="footnote-back-ref">↩</a></p></li> <li id="fn:32"><p>Mike Schuster; Melvin Johnson; Nikhil Thorat (November 22, 2016), "Zero-Shot Translation with Google's Multilingual Neural Machine Translation System", Google Research Blog, retrieved January 11, 2017 <a href="https://research.googleblog.com/2016/11/zero-shot-translation-with-googles.html" target="_blank">https://research.googleblog.com/2016/11/zero-shot-translation-with-googles.html</a> <a href="#fnref:32" class="footnote-back-ref">↩</a></p></li> <li id="fn:33"><p>Gil Fewster (January 5, 2017), "The mind-blowing AI announcement from Google that you probably missed", freeCodeCamp, retrieved January 11, 2017 <a href="https://medium.freecodecamp.com/the-mind-blowing-ai-announcement-from-google-that-you-probably-missed-2ffd31334805#.msj1mdvbh" target="_blank">https://medium.freecodecamp.com/the-mind-blowing-ai-announcement-from-google-that-you-probably-missed-2ffd31334805#.msj1mdvbh</a> <a href="#fnref:33" class="footnote-back-ref">↩</a></p></li> <li id="fn:34"><p>Mike Schuster; Melvin Johnson; Nikhil Thorat (November 22, 2016), "Zero-Shot Translation with Google's Multilingual Neural Machine Translation System", Google Research Blog, retrieved January 11, 2017 <a href="https://research.googleblog.com/2016/11/zero-shot-translation-with-googles.html" target="_blank">https://research.googleblog.com/2016/11/zero-shot-translation-with-googles.html</a> <a href="#fnref:34" class="footnote-back-ref">↩</a></p></li> <li id="fn:35"><p>Barak Turovsky (November 15, 2016), "Found in translation: More accurate, fluent sentences in Google Translate", Google Blog, retrieved January 11, 2017 <a href="https://blog.google/products/translate/found-translation-more-accurate-fluent-sentences-google-translate/" target="_blank">https://blog.google/products/translate/found-translation-more-accurate-fluent-sentences-google-translate/</a> <a href="#fnref:35" class="footnote-back-ref">↩</a></p></li> <li id="fn:36"><p>Mike Schuster; Melvin Johnson; Nikhil Thorat (November 22, 2016), "Zero-Shot Translation with Google's Multilingual Neural Machine Translation System", Google Research Blog, retrieved January 11, 2017 <a href="https://research.googleblog.com/2016/11/zero-shot-translation-with-googles.html" target="_blank">https://research.googleblog.com/2016/11/zero-shot-translation-with-googles.html</a> <a href="#fnref:36" class="footnote-back-ref">↩</a></p></li> <li id="fn:37"><p>Chris McDonald (January 7, 2017), Commenting on Gil Fewster's January 5th article in the Atlantic, retrieved January 11, 2017 <a href="https://medium.com/@chrismcdonald_94568/ok-slow-down-516f93f83ac8#.l0ti3ct0b" target="_blank">https://medium.com/@chrismcdonald_94568/ok-slow-down-516f93f83ac8#.l0ti3ct0b</a> <a href="#fnref:37" class="footnote-back-ref">↩</a></p></li> <li id="fn:38"><p>Turovsky, Barak (November 15, 2016). "Found in translation: More accurate, fluent sentences in Google Translate". The Keyword Google Blog. Retrieved December 1, 2016. <a href="https://www.blog.google/products/translate/found-translation-more-accurate-fluent-sentences-google-translate/" target="_blank">https://www.blog.google/products/translate/found-translation-more-accurate-fluent-sentences-google-translate/</a> <a href="#fnref:38" class="footnote-back-ref">↩</a></p></li> <li id="fn:39"><p>Perez, Sarah (March 6, 2017). "Google's smarter, A.I.-powered translation system expands to more languages". TechCrunch. Oath Inc. <a href="https://techcrunch.com/2017/03/06/googles-smarter-a-i-powered-translation-system-expands-to-more-languages/" target="_blank">https://techcrunch.com/2017/03/06/googles-smarter-a-i-powered-translation-system-expands-to-more-languages/</a> <a href="#fnref:39" class="footnote-back-ref">↩</a></p></li> <li id="fn:40"><p>Turovsky, Barak (March 6, 2017). "Higher quality neural translations for a bunch more languages". The Keyword Google Blog. Retrieved March 6, 2017. <a href="https://blog.google/products/translate/higher-quality-neural-translations-bunch-more-languages/" target="_blank">https://blog.google/products/translate/higher-quality-neural-translations-bunch-more-languages/</a> <a href="#fnref:40" class="footnote-back-ref">↩</a></p></li> <li id="fn:41"><p>Novet, Jordan (March 30, 2017). "Google now provides AI-powered translations for Arabic and Hebrew". VentureBeat. <a href="https://venturebeat.com/2017/03/30/google-now-provides-ai-powered-translations-for-arabic-and-hebrew/" target="_blank">https://venturebeat.com/2017/03/30/google-now-provides-ai-powered-translations-for-arabic-and-hebrew/</a> <a href="#fnref:41" class="footnote-back-ref">↩</a></p></li> <li id="fn:42"><p>Finge, Rachid (April 19, 2017). "Grote verbetering voor het Nederlands in Google Translate" [Big improvement for Dutch in Google Translate]. Google Netherlands Blog (in Dutch). <a href="https://nederland.googleblog.com/2017/04/grote-verbetering-voor-het-nederlands.html" target="_blank">https://nederland.googleblog.com/2017/04/grote-verbetering-voor-het-nederlands.html</a> <a href="#fnref:42" class="footnote-back-ref">↩</a></p></li> <li id="fn:43"><p>Turovsky, Barak (April 25, 2017). "Making the internet more inclusive in India". The Keyword. <a href="https://blog.google/products/translate/making-internet-more-inclusive-india/" target="_blank">https://blog.google/products/translate/making-internet-more-inclusive-india/</a> <a href="#fnref:43" class="footnote-back-ref">↩</a></p></li> <li id="fn:44"><p>"Recent Advances in Google Translate". research.google. Retrieved May 8, 2024. <a href="https://research.google/blog/recent-advances-in-google-translate/" target="_blank">https://research.google/blog/recent-advances-in-google-translate/</a> <a href="#fnref:44" class="footnote-back-ref">↩</a></p></li> <li id="fn:45"><p>Mike Schuster; Melvin Johnson; Nikhil Thorat (November 22, 2016), "Zero-Shot Translation with Google's Multilingual Neural Machine Translation System", Google Research Blog, retrieved January 11, 2017 <a href="https://research.googleblog.com/2016/11/zero-shot-translation-with-googles.html" target="_blank">https://research.googleblog.com/2016/11/zero-shot-translation-with-googles.html</a> <a href="#fnref:45" class="footnote-back-ref">↩</a></p></li> <li id="fn:46"><p>Boitet, Christian; Blanchon, Hervé; Seligman, Mark; Bellynck, Valérie (2010). "MT on and for the Web" (PDF). Archived from the original (PDF) on March 29, 2017. Retrieved December 1, 2016. <a href="https://web.archive.org/web/20170329125916/http://www-clips.imag.fr/geta/herve.blanchon/Pdfs/NLP-KE-10.pdf" target="_blank">https://web.archive.org/web/20170329125916/http://www-clips.imag.fr/geta/herve.blanchon/Pdfs/NLP-KE-10.pdf</a> <a href="#fnref:46" class="footnote-back-ref">↩</a></p></li> <li id="fn:47"><p>Jackson, Jeffrey L; Kuriyama, Akira; Anton, Andreea; Choi, April; Fournier, Jean-Pascal; Geier, Anne-Kathrin; Jacquerioz, Frederique; Kogan, Dmitry; Scholcoff, Cecilia; Sun, Rao (July 30, 2019). "The Accuracy of Google Translate for Abstracting Data From Non–English-Language Trials for Systematic Reviews". Annals of Internal Medicine. 171 (9): 678. doi:10.7326/M19-0891. ISSN 0570-183X. PMID 31357212. S2CID 198980789. <a href="/wiki/Doi_(identifier)" target="_blank">/wiki/Doi_(identifier)</a> <a href="#fnref:47" class="footnote-back-ref">↩</a></p></li> </ol>