IBM alignment models

The IBM alignment models are a sequence of increasingly complex models used in <a href="/facts/Statistical_machine_translation/rzJ8Gfyj">statistical machine translation</a> to train a translation model and an alignment model, starting with lexical translation probabilities and moving to reordering and word duplication. They underpinned the majority of statistical machine translation systems for almost twenty years starting in the early 1990s, until <a href="/facts/Neural_machine_translation/BsjdmTSt">neural machine translation</a> began to dominate. These models offer principled probabilistic formulation and (mostly) tractable inference.
The IBM alignment models were published in parts in 1988 and 1990, and the entire series is published in 1993. Every author of the 1993 paper subsequently went to the hedge fund <a href="/facts/Renaissance_Technologies/7eoJmxFv">Renaissance Technologies</a>.
The original work on statistical machine translation at <a href="/facts/IBM/QszA7nwd">IBM</a> proposed five models, and a model 6 was proposed later. The sequence of the six models can be summarized as:

<ul><li>Model 1: lexical translation</li>
<li>Model 2: additional absolute alignment model</li>
<li>Model 3: extra fertility model</li>
<li>Model 4: added relative alignment model</li>
<li>Model 5: fixed deficiency problem.</li>
<li>Model 6: Model 4 combined with a <a href="/facts/Hidden_Markov_model/ur1zTAhP">HMM</a> alignment model in a log linear way</li></ul>

IBM alignment models open-in-new

IBM alignment models