PP (complexity)

<h2 id="definition">Definition</h2>
A language L is in PP if and only if there exists a probabilistic Turing machine M, such that

<ul><li>M runs for polynomial time on all inputs</li>
<li>For all x in L, M outputs 1 with probability no less than 1/2</li>
<li>For all x not in L, M outputs 1 with probability strictly less than 1/2.</li></ul>
Alternatively, PP can be defined using only deterministic Turing machines. A language L is in PP if and only if there exists a polynomial p and deterministic Turing machine M, such that

<ul><li>M runs for polynomial time on all inputs</li>
<li>For all x in L, the fraction of strings y of length p(|x|) which satisfy M(x,y) = 1 is greater than 1/2</li>
<li>For all x not in L, the fraction of strings y of length p(|x|) which satisfy M(x,y) = 1 is less than 1/2.</li></ul>
In this definition, the string y corresponds to the output of the random coin flips that the probabilistic Turing machine would have made.
In both definitions, "less than" can be changed to "less than or equal to" (see below), and the threshold 1/2 can be replaced by any fixed rational number in (0,1), without changing the class.

<h2 id="pp-vs-bpp">PP vs BPP</h2>
<a href="/facts/Bounded-error_probabilistic_polynomial/6woy25bz">BPP</a> is a subset of PP; it can be seen as the subset for which there are efficient probabilistic algorithms. The distinction is in the error probability that is allowed: in BPP, an algorithm must give correct answer (YES or NO) with probability exceeding some fixed constant c > 1/2, such as 2/3 or 501/1000. If this is the case, then we can run the algorithm a number of times and take a majority vote to achieve any desired probability of correctness less than 1, using the <a href="/facts/Chernoff_bound/RLC6VlRU">Chernoff bound</a>. This number of repeats increases if c becomes closer to 1/2, but it does not depend on the input size n.
More generally, if c can depend on the input size 
 
 
 
 n
 
 
 {\displaystyle n}
 
 polynomially, as 
 
 
 
 c
 =
 O
 (
 
 n
 
 −
 k
 
 
 )
 
 
 {\displaystyle c=O(n^{-k})}
 
, then we can rerun the algorithm for 
 
 
 
 O
 (
 
 n
 
 2
 k
 
 
 )
 
 
 {\displaystyle O(n^{2k})}
 
 and take the majority vote. By <a href="/facts/Hoeffding%27s_inequality/PH4yQpIX">Hoeffding's inequality</a>, this gives us a BPP algorithm.
The important thing is that this constant c is not allowed to depend on the input. On the other hand, a PP algorithm is permitted to do something like the following:

<ul><li>On a YES instance, output YES with probability 1/2 + 1/2n, where n is the length of the input.</li>
<li>On a NO instance, output YES with probability 1/2 − 1/2n.</li></ul>
Because these two probabilities are exponentially close together, even if we run it for a polynomial number of times it is very difficult to tell whether we are operating on a YES instance or a NO instance. Attempting to achieve a fixed desired probability level using a majority vote and the Chernoff bound requires a number of repetitions that is exponential in n.

<h2 id="pp-compared-to-other-complexity-classes">PP compared to other complexity classes</h2>
PP includes BPP, since probabilistic algorithms described in the definition of BPP form a subset of those in the definition of PP.
PP also includes <a href="/facts/NP_(complexity_class)/6muUfVMI">NP</a>. To prove this, we show that the <a href="/facts/NP-complete/NFPv56DU">NP-complete</a> <a href="/facts/Boolean_satisfiability_problem/wBVRjWoy">satisfiability</a> problem belongs to PP. Consider a probabilistic algorithm that, given a formula F(x1, x2, ..., xn) chooses an assignment x1, x2, ..., xn uniformly at random. Then, the algorithm checks if the assignment makes the formula F true. If yes, it outputs YES. Otherwise, it outputs YES with probability 
 
 
 
 
 
 1
 2
 
 
 −
 
 
 1
 
 2
 
 n
 +
 1
 
 
 
 
 
 
 {\displaystyle {\frac {1}{2}}-{\frac {1}{2^{n+1}}}}
 
 and NO with probability 
 
 
 
 
 
 1
 2
 
 
 +
 
 
 1
 
 2
 
 n
 +
 1
 
 
 
 
 
 
 {\displaystyle {\frac {1}{2}}+{\frac {1}{2^{n+1}}}}
 
.
If the formula is unsatisfiable, the algorithm will always output YES with probability 
 
 
 
 
 
 1
 2
 
 
 −
 
 
 1
 
 2
 
 n
 +
 1
 
 
 
 
 <
 
 
 1
 2
 
 
 
 
 {\displaystyle {\frac {1}{2}}-{\frac {1}{2^{n+1}}}<{\frac {1}{2}}}
 
. If there exists a satisfying assignment, it will output YES with probability at least

(
          
            
              
                1
                2
              
            
            −
            
              
                1
                
                  2
                  
                    n
                    +
                    1
                  
                
              
            
          
          )
        
        ⋅
        
          (
          
            1
            −
            
              
                1
                
                  2
                  
                    n
                  
                
              
            
          
          )
        
        +
        1
        ⋅
        
          
            1
            
              2
              
                n
              
            
          
        
        =
        
          
            1
            2
          
        
        +
        
          
            1
            
              2
              
                2
                n
                +
                1
              
            
          
        
        >
        
          
            1
            2
          
        
      
    
    {\displaystyle \left({\frac {1}{2}}-{\frac {1}{2^{n+1}}}\right)\cdot \left(1-{\frac {1}{2^{n}}}\right)+1\cdot {\frac {1}{2^{n}}}={\frac {1}{2}}+{\frac {1}{2^{2n+1}}}>{\frac {1}{2}}}

(exactly 1/2 if it picked an unsatisfying assignment and 1 if it picked a satisfying assignment, averaging to some number greater than 1/2). Thus, this algorithm puts satisfiability in PP. As SAT is NP-complete, and we can prefix any deterministic <a href="/facts/Polynomial-time_many-one_reduction/bBvfFxyM">polynomial-time many-one reduction</a> onto the PP algorithm, NP is included in PP. Because PP is closed under complement, it also includes co-NP.
Furthermore, PP includes <a href="/facts/Arthur%E2%80%93Merlin_protocol/UV1f2aLt">MA</a>,<a class="footnote-ref" id="fnref:4" href="#fn:4">4</a> which subsumes the previous two inclusions.
PP also includes <a href="/facts/BQP/whjD9eyf">BQP</a>, the class of decision problems solvable by efficient polynomial time <a href="/facts/Quantum_computer/nbbcgmvq">quantum computers</a>. In fact, BQP is <a href="/facts/Low_(complexity)/xxd0DptC">low</a> for PP, meaning that a PP machine achieves no benefit from being able to solve BQP problems instantly. The class of polynomial time on quantum computers with <a href="/facts/Postselection/cQLt0MMC">postselection</a>, <a href="/facts/PostBQP/UnfaU0TS">PostBQP</a>, is equal to PP<a class="footnote-ref" id="fnref:5" href="#fn:5">5</a> (see #PostBQP below).
Furthermore, PP includes <a href="/facts/QMA/AtQsb09s">QMA</a>, which subsumes inclusions of MA and BQP.
A polynomial time Turing machine with a PP <a href="/facts/Oracle_machine/6ScMuvvY">oracle</a> (PPP) can solve all problems in <a href="/facts/PH_(complexity)/Q9vRKYVp">PH</a>, the entire <a href="/facts/Polynomial_hierarchy/73N468Dv">polynomial hierarchy</a>. This result was shown by <a href="/facts/Seinosuke_Toda/0C0L1cc3">Seinosuke Toda</a> in 1989 and is known as <a href="/facts/Toda%27s_theorem/aJYS4QH0">Toda's theorem</a>. This is evidence of how hard it is to solve problems in PP. The class <a href="/facts/Sharp-P/tY95TU7t">#P</a> is in some sense about as hard, since P#P = PPP and therefore P#P includes PH as well.<a class="footnote-ref" id="fnref:6" href="#fn:6">6</a>
PP strictly includes uniform <a href="/facts/TC0/bVAP8vqz">TC0</a>, the class of constant-depth, unbounded-fan-in <a href="/facts/Boolean_circuit/TwhfJp0q">boolean circuits</a> with <a href="/facts/Majority_gate/Ntpb4wDr">majority gates</a> that are uniform (generated by a polynomial-time algorithm).<a class="footnote-ref" id="fnref:7" href="#fn:7">7</a>
PP is included in <a href="/facts/PSPACE/RIkAClvG">PSPACE</a>. This can be easily shown by exhibiting a polynomial-space algorithm for MAJSAT, defined below; simply try all assignments and count the number of satisfying ones.
PP is not included in SIZE(nk) for any k, by <a href="/facts/Karp-Lipton_theorem/yxtvuKDk">Kannan's theorem</a>.

<h2 id="complete-problems-and-other-properties">Complete problems and other properties</h2>
Unlike BPP, PP is a syntactic rather than semantic class. Any polynomial-time probabilistic machine recognizes some language in PP. In contrast, given a description of a polynomial-time probabilistic machine, it is undecidable in general to determine if it recognizes a language in BPP.
PP has natural complete problems, for example, MAJSAT.<a class="footnote-ref" id="fnref:8" href="#fn:8">8</a> MAJSAT is a decision problem in which one is given a Boolean formula F. The answer must be YES if more than half of all assignments x1, x2, ..., xn make F true and NO otherwise.

<h3>Proof that PP is closed under complement</h3>
Let L be a language in PP. Let 
 
 
 
 
 L
 
 c
 
 
 
 
 {\displaystyle L^{c}}
 
 denote the complement of L. By the definition of PP there is a polynomial-time probabilistic algorithm A with the property that

x
        ∈
        L
        ⇒
        Pr
        [
        A
        
           accepts 
        
        x
        ]
        >
        
          
            1
            2
          
        
        
        
          and
        
        
        x
        ∉
        L
        ⇒
        Pr
        [
        A
        
           accepts 
        
        x
        ]
        ≤
        
          
            1
            2
          
        
        .
      
    
    {\displaystyle x\in L\Rightarrow \Pr[A{\text{ accepts }}x]>{\frac {1}{2}}\quad {\text{and}}\quad x\not \in L\Rightarrow \Pr[A{\text{ accepts }}x]\leq {\frac {1}{2}}.}

We claim that <a href="/facts/Without_loss_of_generality/gVP4dmEe">without loss of generality</a>, the latter inequality is always strict; the theorem can be deduced from this claim: let 
 
 
 
 
 A
 
 c
 
 
 
 
 {\displaystyle A^{c}}
 
 denote the machine which is the same as A except that 
 
 
 
 
 A
 
 c
 
 
 
 
 {\displaystyle A^{c}}
 
 accepts when A would reject, and vice versa. Then

x
 ∈
 
 L
 
 c
 
 
 ⇒
 Pr
 [
 
 A
 
 c
 
 
 
  accepts 
 
 x
 ]
 >
 
 
 1
 2
 
 
 
 
 and
 
 
 x
 ∉
 
 L
 
 c
 
 
 ⇒
 Pr
 [
 
 A
 
 c
 
 
 
  accepts 
 
 x
 ]
 <
 
 
 1
 2
 
 
 ,
 
 
 {\displaystyle x\in L^{c}\Rightarrow \Pr[A^{c}{\text{ accepts }}x]>{\frac {1}{2}}\quad {\text{and}}\quad x\not \in L^{c}\Rightarrow \Pr[A^{c}{\text{ accepts }}x]<{\frac {1}{2}},}

which implies that 
 
 
 
 
 L
 
 c
 
 
 
 
 {\displaystyle L^{c}}
 
 is in PP.
Now we justify our without loss of generality assumption. Let 
 
 
 
 f
 (
 
 |
 
 x
 
 |
 
 )
 
 
 {\displaystyle f(|x|)}
 
 be the polynomial upper bound on the running time of A on input x. Thus A makes at most 
 
 
 
 f
 (
 
 |
 
 x
 
 |
 
 )
 
 
 {\displaystyle f(|x|)}
 
 random coin flips during its execution. In particular the probability of acceptance is an integer multiple of 
 
 
 
 
 2
 
 −
 f
 (
 
 |
 
 x
 
 |
 
 )
 
 
 
 
 {\displaystyle 2^{-f(|x|)}}
 
 and we have:

x
        ∈
        L
        ⇒
        Pr
        [
        A
        
           accepts 
        
        x
        ]
        ≥
        
          
            1
            2
          
        
        +
        
          
            1
            
              2
              
                f
                (
                
                  |
                
                x
                
                  |
                
                )
              
            
          
        
        .
      
    
    {\displaystyle x\in L\Rightarrow \Pr[A{\text{ accepts }}x]\geq {\frac {1}{2}}+{\frac {1}{2^{f(|x|)}}}.}

Define a machine A′ as follows: on input x, A′ runs A as a subroutine, and rejects if A would reject; otherwise, if A would accept, A′ flips 
 
 
 
 f
 (
 
 |
 
 x
 
 |
 
 )
 +
 1
 
 
 {\displaystyle f(|x|)+1}
 
 coins and rejects if they are all heads, and accepts otherwise. Then

x
 ∉
 L
 ⇒
 Pr
 [
 
 A
 ′
 
 
  accepts 
 
 x
 ]
 ≤
 
 
 1
 2
 
 
 ⋅
 
 (
 
 1
 −
 
 
 1
 
 2
 
 f
 (
 
 |
 
 x
 
 |
 
 )
 +
 1
 
 
 
 
 
 )
 
 <
 
 
 1
 2
 
 
 
 
 {\displaystyle x\not \in L\Rightarrow \Pr[A'{\text{ accepts }}x]\leq {\frac {1}{2}}\cdot \left(1-{\frac {1}{2^{f(|x|)+1}}}\right)<{\frac {1}{2}}}

and

x
        ∈
        L
        ⇒
        Pr
        [
        
          A
          ′
        
        
           accepts 
        
        x
        ]
        ≥
        
          (
          
            
              
                1
                2
              
            
            +
            
              
                1
                
                  2
                  
                    f
                    (
                    
                      |
                    
                    x
                    
                      |
                    
                    )
                  
                
              
            
          
          )
        
        ⋅
        
          (
          
            1
            −
            
              
                1
                
                  2
                  
                    f
                    (
                    
                      |
                    
                    x
                    
                      |
                    
                    )
                    +
                    1
                  
                
              
            
          
          )
        
        >
        
          
            1
            2
          
        
        .
      
    
    {\displaystyle x\in L\Rightarrow \Pr[A'{\text{ accepts }}x]\geq \left({\frac {1}{2}}+{\frac {1}{2^{f(|x|)}}}\right)\cdot \left(1-{\frac {1}{2^{f(|x|)+1}}}\right)>{\frac {1}{2}}.}

This justifies the assumption (since A′ is still a polynomial-time probabilistic algorithm) and completes the proof.
David Russo proved in his 1985 Ph.D. thesis<a class="footnote-ref" id="fnref:9" href="#fn:9">9</a> that PP is closed under <a href="/facts/Symmetric_difference/W2QST1Qr">symmetric difference</a>. It was an <a href="/facts/Open_problem/VuR6yLsW">open problem</a> for 14 years whether PP was closed under <a href="/facts/Union_(set_theory)/KVVXKfWl">union</a> and <a href="/facts/Intersection_(set_theory)/RPfUNJh9">intersection</a>; this was settled in the affirmative by Beigel, Reingold, and Spielman.<a class="footnote-ref" id="fnref:10" href="#fn:10">10</a> Alternate proofs were later given by Li<a class="footnote-ref" id="fnref:11" href="#fn:11">11</a> and Aaronson (see #PostBQP below).

<h2 id="other-equivalent-complexity-classes">Other equivalent complexity classes</h2>
<h3>PostBQP</h3>
The quantum complexity class <a href="/facts/BQP/whjD9eyf">BQP</a> is the class of problems solvable in <a href="/facts/Polynomial_time/77T62gmf">polynomial time</a> on a <a href="/facts/Quantum_Turing_machine/tTJ8P43B">quantum Turing machine</a>. By adding <a href="/facts/Postselection/cQLt0MMC">postselection</a>, a larger class called <a href="/facts/PostBQP/UnfaU0TS">PostBQP</a> is obtained. Informally, postselection gives the computer the following power: whenever some event (such as measuring a qubit in a certain state) has nonzero probability, you are allowed to assume that it takes place.<a class="footnote-ref" id="fnref:12" href="#fn:12">12</a> <a href="/facts/Scott_Aaronson/htGK5zuz">Scott Aaronson</a> showed in 2004 that PostBQP is equal to PP.<a class="footnote-ref" id="fnref:13" href="#fn:13">13</a><a class="footnote-ref" id="fnref:14" href="#fn:14">14</a> This reformulation of PP makes it easier to show certain results, such as that PP is closed under intersection (and hence, under union), that BQP is <a href="/facts/Low_(complexity)/xxd0DptC">low</a> for PP, and that <a href="/facts/QMA/AtQsb09s">QMA</a> is included in PP.

<h3>PQP</h3>
PP is also equal to another quantum complexity class known as PQP, which is the unbounded error analog of BQP. It denotes the class of decision problems solvable by a quantum computer in polynomial time, with an error probability of less than 1/2 for all instances. Even if all amplitudes used for PQP-computation are drawn from algebraic numbers, still PQP coincides with PP.<a class="footnote-ref" id="fnref:15" href="#fn:15">15</a>

<h2 id="notes">Notes</h2>

<ul><li><a href="/facts/Christos_Papadimitriou/rXflR4or">Papadimitriou, C.</a> (1994). "chapter 11". Computational Complexity. Addison-Wesley..</li>
<li>Allender, E. (1996). "A note on uniform circuit lower bounds for the counting hierarchy". Proceedings 2nd International Computing and Combinatorics Conference (COCOON). Lecture Notes in Computer Science. Vol. 1090. Springer-Verlag. pp. 127–135..</li>
<li>Burtschick, Hans-Jörg; Vollmer, Heribert (1998). "Lindström quantifiers and leaf language definability". Int. J. Found. Comput. Sci. 9 (3): 277–294. <a href="/facts/Doi_(identifier)/muM9Etpq">doi</a>:<a href="https://doi.org/10.1142%2FS0129054198000180">10.1142/S0129054198000180</a>. <a href="/facts/Electronic_Colloquium_on_Computational_Complexity/6Tl8NPAM">ECCC</a> <a href="https://eccc.weizmann.ac.il/report/1996/005/">TR96-005</a>.</li></ul>
<h2 id="external-links">External links</h2>
<ul><li><a href="/facts/Complexity_Zoo/htGK5zuz">Complexity Zoo</a>: <a href="https://complexityzoo.net/Complexity_Zoo:P#pp">PP</a></li></ul>

<h2 id="references">References</h2>

<ol>
<li id="fn:1">Gill, John (1977). "Computational Complexity of Probabilistic Turing Machines". SIAM Journal on Computing. 6 (4): 675–695. doi:10.1137/0206049. <a href="/wiki/Doi_(identifier)" target="_blank">/wiki/Doi_(identifier)</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></li>
<li id="fn:2">Lindell, Yehuda; Katz, Jonathan (2015). Introduction to Modern Cryptography (2 ed.). Chapman and Hall/CRC. p. 46. ISBN 978-1-4665-7027-6. <a href="978-1-4665-7027-6" target="_blank">978-1-4665-7027-6</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></li>
<li id="fn:3">Lance Fortnow. Computational Complexity: Wednesday, September 4, 2002: Complexity Class of the Week: PP. http://weblog.fortnow.com/2002/09/complexity-class-of-week-pp.html <a href="http://weblog.fortnow.com/2002/09/complexity-class-of-week-pp.html" target="_blank">http://weblog.fortnow.com/2002/09/complexity-class-of-week-pp.html</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></li>
<li id="fn:4">N.K. Vereshchagin, "On the Power of PP" <a href="http://lpcs.math.msu.su/~ver/papers/am-pp.ps" target="_blank">http://lpcs.math.msu.su/~ver/papers/am-pp.ps</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></li>
<li id="fn:5">Aaronson, Scott (2005). "Quantum computing, postselection, and probabilistic polynomial-time". Proceedings of the Royal Society A. 461 (2063): 3473–3482. arXiv:quant-ph/0412187. Bibcode:2005RSPSA.461.3473A. doi:10.1098/rspa.2005.1546. S2CID 1770389. <a href="/wiki/ArXiv_(identifier)" target="_blank">/wiki/ArXiv_(identifier)</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></li>
<li id="fn:6">Toda, Seinosuke (1991). "PP is as hard as the polynomial-time hierarchy". SIAM Journal on Computing. 20 (5): 865–877. doi:10.1137/0220053. MR 1115655. <a href="/wiki/Seinosuke_Toda" target="_blank">/wiki/Seinosuke_Toda</a> <a href="#fnref:6" class="footnote-back-ref">↩</a></li>
<li id="fn:7">Allender 1996, as cited in Burtschick 1999 <a href="#fnref:7" class="footnote-back-ref">↩</a></li>
<li id="fn:8">Gill, John (1977). "Computational Complexity of Probabilistic Turing Machines". SIAM Journal on Computing. 6 (4): 675–695. doi:10.1137/0206049. <a href="/wiki/Doi_(identifier)" target="_blank">/wiki/Doi_(identifier)</a> <a href="#fnref:8" class="footnote-back-ref">↩</a></li>
<li id="fn:9">David Russo (1985). Structural Properties of Complexity Classes (Ph.D Thesis). University of California, Santa Barbara. <a href="#fnref:9" class="footnote-back-ref">↩</a></li>
<li id="fn:10">R. Beigel, N. Reingold, and D. A. Spielman, "PP is closed under intersection", Proceedings of ACM Symposium on Theory of Computing 1991, pp. 1–9, 1991. <a href="http://citeseer.ist.psu.edu/152946.html" target="_blank">http://citeseer.ist.psu.edu/152946.html</a> <a href="#fnref:10" class="footnote-back-ref">↩</a></li>
<li id="fn:11">Lide Li (1993). On the Counting Functions (Ph.D Thesis). University of Chicago. <a href="#fnref:11" class="footnote-back-ref">↩</a></li>
<li id="fn:12">Aaronson, Scott. "The Amazing Power of Postselection". Retrieved 2009-07-27. <a href="http://www.scottaaronson.com/talks/postselect.ppt" target="_blank">http://www.scottaaronson.com/talks/postselect.ppt</a> <a href="#fnref:12" class="footnote-back-ref">↩</a></li>
<li id="fn:13">Aaronson, Scott (2005). "Quantum computing, postselection, and probabilistic polynomial-time". Proceedings of the Royal Society A. 461 (2063): 3473–3482. arXiv:quant-ph/0412187. Bibcode:2005RSPSA.461.3473A. doi:10.1098/rspa.2005.1546. S2CID 1770389. <a href="/wiki/ArXiv_(identifier)" target="_blank">/wiki/ArXiv_(identifier)</a> <a href="#fnref:13" class="footnote-back-ref">↩</a></li>
<li id="fn:14">Aaronson, Scott (2004-01-11). "Complexity Class of the Week: PP". Computational Complexity Weblog. Retrieved 2008-05-02. <a href="http://weblog.fortnow.com/2004/01/complexity-class-of-week-pp-by-guest.html" target="_blank">http://weblog.fortnow.com/2004/01/complexity-class-of-week-pp-by-guest.html</a> <a href="#fnref:14" class="footnote-back-ref">↩</a></li>
<li id="fn:15">Yamakami, Tomoyuki (1999). "Analysis of Quantum Functions". Int. J. Found. Comput. Sci. 14 (5): 815–852. arXiv:quant-ph/9909012. Bibcode:1999quant.ph..9012Y. doi:10.1142/S0129054103002047. S2CID 3265603. <a href="/wiki/ArXiv_(identifier)" target="_blank">/wiki/ArXiv_(identifier)</a> <a href="#fnref:15" class="footnote-back-ref">↩</a></li>
</ol>

PP (complexity) open-in-new

PP (complexity)