Lehmer's GCD algorithm

<h2 id="algorithm">Algorithm</h2>
Lehmer noted that most of the <a href="/facts/Quotient/JekSq1Ko">quotients</a> from each step of the division part of the standard algorithm are small. (For example, <a href="/facts/Donald_Knuth/GozNzDM6">Knuth</a> observed that the quotients 1, 2, and 3 comprise 67.7% of all quotients.<a class="footnote-ref" id="fnref:1" href="#fn:1">1</a>) Those small quotients can be identified from only a few leading digits. Thus the algorithm starts by splitting off those leading digits and computing the sequence of quotients as long as it is correct.
Say we want to obtain the GCD of the two integers a and b. Let a ≥ b.

<ul><li>If b contains only one digit (in the chosen <a href="/facts/Radix/J5RGWRJF">base</a>, say β = 1000 or β = 232), use some other method, such as the <a href="/facts/Euclidean_algorithm/wApql29c">Euclidean algorithm</a>, to obtain the result.</li>
<li>If a and b differ in the length of digits, perform a division so that a and b are equal in length, with length equal to m.</li>
<li>Outer loop: Iterate until one of a or b is zero:
<ul><li>Decrease m by one. Let x be the leading (most significant) digit in a, x = a div β m and y the leading digit in b, y = b div β m.</li>
<li>Initialize a 2 by 3 <a href="/facts/Matrix_(mathematics)/qa8FI4ko">matrix</a></li></ul>

[
 
 
 
 A
 
 
 B
 
 
 x
 
 
 
 
 C
 
 
 D
 
 
 y
 
 
 
 ]
 
 
 
 
 
 {\displaystyle \textstyle {\begin{bmatrix}A&B&x\\C&D&y\end{bmatrix}}}
 
 to an extended <a href="/facts/Identity_matrix/Glbcf6ol">identity matrix</a> 
 
 
 
 
 
 
 [
 
 
 
 1
 
 
 0
 
 
 x
 
 
 
 
 0
 
 
 1
 
 
 y
 
 
 
 ]
 
 
 ,
 
 
 
 {\displaystyle \textstyle {\begin{bmatrix}1&0&x\\0&1&y\end{bmatrix}},}

and perform the euclidean algorithm simultaneously on the pairs (x + A, y + C) and (x + B, y + D), until the quotients differ. That is, iterate as an inner loop:
<ul><li>Compute the quotients w1 of the long divisions of (x + A) by (y + C) and w2 of (x + B) by (y + D) respectively. Also let w be the (not computed) quotient from the current long division in the chain of long divisions of the euclidean algorithm.</li></ul>
<ul><li><ul><li>If w1 ≠ w2, then break out of the inner iteration. Else set w to w1 (or w2).</li>
<li>Replace the current matrix</li></ul>

[
              
                
                  
                    A
                  
                  
                    B
                  
                  
                    x
                  
                
                
                  
                    C
                  
                  
                    D
                  
                  
                    y
                  
                
              
              ]
            
          
        
      
    
    {\displaystyle \textstyle {\begin{bmatrix}A&B&x\\C&D&y\end{bmatrix}}}

with the matrix product

[
              
                
                  
                    0
                  
                  
                    1
                  
                
                
                  
                    1
                  
                  
                    −
                    w
                  
                
              
              ]
            
          
          ⋅
          
            
              [
              
                
                  
                    A
                  
                  
                    B
                  
                  
                    x
                  
                
                
                  
                    C
                  
                  
                    D
                  
                  
                    y
                  
                
              
              ]
            
          
          =
          
            
              [
              
                
                  
                    C
                  
                  
                    D
                  
                  
                    y
                  
                
                
                  
                    A
                    −
                    w
                    C
                  
                  
                    B
                    −
                    w
                    D
                  
                  
                    x
                    −
                    w
                    y
                  
                
              
              ]
            
          
        
      
    
    {\displaystyle \textstyle {\begin{bmatrix}0&1\\1&-w\end{bmatrix}}\cdot {\begin{bmatrix}A&B&x\\C&D&y\end{bmatrix}}={\begin{bmatrix}C&D&y\\A-wC&B-wD&x-wy\end{bmatrix}}}

according to the matrix formulation of the extended euclidean algorithm.
<ul><li>If B ≠ 0, go to the start of the inner loop.</li></ul></li>
<li>If B = 0, we have reached a deadlock; perform a normal step of the euclidean algorithm with a and b, and restart the outer loop.</li>
<li>Set a to aA + bB and b to Ca + Db (again simultaneously). This applies the steps of the euclidean algorithm that were performed on the leading digits in compressed form to the long integers a and b. If b ≠ 0 go to the start of the outer loop.</li></ul></li></ul>

<ul><li><a href="/facts/Kapil_Hari_Paranjape/XtMmE95X">Kapil Paranjape</a>, <a href="http://www.imsc.res.in/~kapil/crypto/notes/node11.html">Lehmer's Algorithm</a></li></ul>

<h2 id="references">References</h2>

<ol>
<li id="fn:1">Knuth, The Art of Computer Programming vol 2 "Seminumerical algorithms", chapter 4.5.3 Theorem E. <a href="/wiki/Donald_Knuth" target="_blank">/wiki/Donald_Knuth</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></li>
</ol>

Lehmer's GCD algorithm open-in-new

Lehmer's GCD algorithm