ThinThread

<h2 id="whistleblowing">Whistleblowing</h2>

A group of former NSA workers—Kirk Wiebe, <a href="/facts/William_Binney_(U.S._intelligence_official)/5sPeRc9j">William Binney</a>, Ed Loomis, and <a href="/facts/Thomas_Andrews_Drake/B4wk3mfK">Thomas A. Drake</a>, along with House Intelligence Committee staffer <a href="/facts/Diane_Roark/qjf4WMYw">Diane Roark</a> (an expert on the NSA budget<a class="footnote-ref" id="fnref:5" href="#fn:5">5</a>)—believed the operational prototype system called ThinThread was a better solution than Trailblazer, which was just a concept on paper at the time. They complained to the DoD Inspector General office in 2002 about mismanagement and the waste of taxpayer money at the NSA surrounding the Trailblazer program. In 2007 the FBI raided the homes of these people, an evolution of President Bush's crackdown on whistleblowers and "<a href="/facts/Leak/QT96bERT">leaks</a>" after the New York Times disclosed a separate program (see <a href="/facts/NSA_warrantless_surveillance_controversy/ovTMv9vy">NSA warrantless surveillance controversy</a>). In 2010, one of the people who had helped the IG in the ensuing investigation, NSA official <a href="/facts/Thomas_Andrews_Drake/B4wk3mfK">Thomas Andrews Drake</a>, was charged with <a href="/facts/Espionage_Act_of_1917/8RDXdMuW">espionage</a>,<a class="footnote-ref" id="fnref:6" href="#fn:6">6</a><a class="footnote-ref" id="fnref:7" href="#fn:7">7</a> part of the Obama administration's crackdown on whistleblowers and "leaks".<a class="footnote-ref" id="fnref:8" href="#fn:8">8</a><a class="footnote-ref" id="fnref:9" href="#fn:9">9</a><a class="footnote-ref" id="fnref:10" href="#fn:10">10</a> The original charges against him were later dropped and he pleaded to a misdemeanor.
The result of the DoD IG complaint was a 2004 audit report that was released under FOIA in 2011.<a class="footnote-ref" id="fnref:11" href="#fn:11">11</a> Although highly redacted, the report contained significant criticisms of Trailblazer, and included some relatively minor criticisms of ThinThread, for example, citing a low "quality of service and support" from the ThinThread program team, a lack of <a href="/facts/Documentation/IdrD9jer">documentation</a>, a lack of a <a href="/facts/Configuration_management/BRDwuKRk">configuration management</a> system, and a lack of a <a href="/facts/Bug_tracking_system/xCdIz6Kx">trouble ticket</a> system. However, "The findings that led to the recommendations would not have prevented the successful deployment of THINTHREAD ... the recommendations were made to improve the operational efficiency of THINTHREAD after it was deployed ..."<a class="footnote-ref" id="fnref:12" href="#fn:12">12</a>

<h2 id="technical-details">Technical details</h2>
The program would have used a technique of encrypting sensitive privacy information in an effort to comply with legal concerns, and would have automatically identified potential threats. The sources of the data for this program would have included "massive phone and e-mail data," but the extent of this information is not clear. Only once a threat was discovered, would the data be decrypted for analysis by agents.<a class="footnote-ref" id="fnref:13" href="#fn:13">13</a>
ThinThread would have bundled together four cutting-edge surveillance tools.:<a class="footnote-ref" id="fnref:14" href="#fn:14">14</a>

<ul><li>Used more sophisticated methods of sorting through massive phone and e-mail data to identify suspect communications.</li>
<li>Identified U.S. phone numbers and other communications data and encrypted them to ensure caller privacy.</li>
<li>Employed an automated auditing system to monitor how analysts handled the information, in order to prevent misuse and improve efficiency.</li>
<li>Analyzed the data to identify relationships between callers and chronicle their contacts. Only when evidence of a potential threat had been developed would analysts be able to request decryption of the records. This component is known as <a href="/facts/MAINWAY/gdA84Lek">MAINWAY</a> and, according to <a href="/facts/Pulitzer_Prize/wD4PN6Xs">Pulitzer Prize</a> winning journalist <a href="/facts/James_Risen/u3Y9p5gE">James Risen</a>, "MAINWAY [became] the heart of the NSA's domestic spying program."<a class="footnote-ref" id="fnref:15" href="#fn:15">15</a></li></ul>
Intelligence experts describe as rigorous the testing of ThinThread in 1998, the project succeeding at each task with high marks. For example, its ability to sort through massive amounts of data to find threat-related communications far surpassed the existing system. It also was able to rapidly separate and encrypt U.S.-related communications to ensure privacy.<a class="footnote-ref" id="fnref:16" href="#fn:16">16</a>
The Pentagon report concluded that ThinThread's ability to sort through data in 2001 was far superior to that of another NSA system in place in 2004, and that the program should be launched and enhanced. ThinThread was designed to address two key challenges: One, the NSA had more information than it could digest, and, two, increasingly its targets were in contact with people in the United States whose calls the agency was prohibited from monitoring.<a class="footnote-ref" id="fnref:17" href="#fn:17">17</a>
Trailblazer had more political support internally because it was initiated by <a href="/facts/Michael_Hayden_(general)/0ysFuEtm">Michael Hayden</a> when he first arrived at the NSA.<a class="footnote-ref" id="fnref:18" href="#fn:18">18</a>
NSA's existing system for data-sorting had produced a database clogged with corrupted and useless information. The mass collection of relatively unsorted data, combined with system flaws erroneously flagging people as suspect, had produced numerous false leads, draining analyst resources. NSA leads had resulted in numerous dead ends.<a class="footnote-ref" id="fnref:19" href="#fn:19">19</a>
NSA dropped the component that monitored for abuse of records. It not only tracked the use of the database, but hunted for the most effective analysis techniques, and some analysts thought it would be used to judge their performance. Within the NSA, the primary advocate for the ThinThread program was Richard Taylor. Taylor has retired from the NSA.
One intelligence official told the Baltimore Sun that ThinThread "was designed very carefully from a legal point of view, so that even in non-wartime, you could have done it legitimately."<a class="footnote-ref" id="fnref:20" href="#fn:20">20</a> However, Michael Hayden asserts in his memoir that in 2000 lawyers at the NSA and Justice Department would not allow the deployment of ThinThread because it would be illegal, despite its use of encryption for US citizen data: "The answer from Justice was... clear: 'You can't do this...'"<a class="footnote-ref" id="fnref:21" href="#fn:21">21</a>

<h2 id="end-of-the-project">End of the project</h2>
The project was ended by General <a href="/facts/Michael_Hayden_(general)/0ysFuEtm">Michael Hayden</a> after successful testing, and while the privacy elements were not retained, Hayden admitted that the analysis technology is the underlying basis of current NSA analysis techniques, saying in an interview: "But we judged fundamentally that as good as [ThinThread] was, and believe me, we pulled a whole bunch of elements out of it and used it for our final solution for these problems, as good as it was, it couldn’t scale sufficiently to the volume of modern communications .<a class="footnote-ref" id="fnref:22" href="#fn:22">22</a>
Some anonymous NSA officials told Hosenball of Newsweek that the ThinThread program, like Trailblazer, was a "wasteful failure".<a class="footnote-ref" id="fnref:23" href="#fn:23">23</a> However, as noted, the MAINWAY component of ThinThread was deployed after 9/11. NSA even tried to put ThinThread into effect before 9/11. Hayden confessed in his memoir that in 2000, fearing further terrorist attacks like the <a href="/facts/Millennium_Plot/frqeQmo5">Millennium Plot</a>, he gave the order to put ThinThread into action: "Let me be clear: This was me arguing for a limited use of the Thin Thread approach prior to 9/11." The only reason ThinThread was not put into use was because it was deemed to be illegal under US law at that time.<a class="footnote-ref" id="fnref:24" href="#fn:24">24</a>

<h2 id="see-also">See also</h2>
<ul><li><a href="/facts/NSA_electronic_surveillance_program/8WFconTf">NSA electronic surveillance program</a></li>
<li><a href="/facts/Stellar_Wind_(code_name)/ln8C3yHe">Stellar Wind (code name)</a></li>
<li><a href="/facts/Trailblazer_Project/Lf5W5X6E">Trailblazer Project</a></li>
<li><a href="/facts/PRISM_(surveillance_program)/EhejEd35">PRISM (surveillance program)</a></li>
<li><a href="/facts/Mark_Klein/FQ77GWMJ">Mark Klein</a></li>
<li><a href="/facts/Thomas_Tamm/xhceLs5o">Thomas Tamm</a></li>
<li><a href="/facts/Russ_Tice/KHzSVJgd">Russ Tice</a></li>
<li><a href="/facts/Edward_Snowden/yRDLtpH9">Edward Snowden</a></li>
<li><a href="/facts/A_Good_American/6w8NXxUl">A Good American</a>, 2015 documentary film about the program and its discontinuation</li></ul>

<h2 id="external-links">External links</h2>
<ul><li><a href="https://www.dailymotion.com/video/xs8zd7_william-binney-hope-9-keynote-part1_tech">William.Binney.HOPE.9.KEYNOTE.Part1</a>, related to Thinthread development</li>
<li><a href="https://www.dailymotion.com/video/xs8zl4_william-binney-hope-9-keynote-part2_tech">William.Binney.HOPE.9.KEYNOTE.Part2</a>, related to Thinthread development</li>
<li><a href="http://agoodamerican.org/film">Film on Thinthread and the SARC team</a></li></ul>

<h2 id="references">References</h2>

<ol>
<li id="fn:1">Gorman, Siobhan (17 May 2006). "NSA killed system that sifted phone data legally". Baltimore Sun. Archived from the original on 27 September 2007. Retrieved 12 January 2017. - Archive does not provide second page; full text currently available at Pundita <a href="https://web.archive.org/web/20070927193047/http://www.baltimoresun.com/news/nationworld/bal-te.nsa18may18,1,5386811.story?ctrack=1&cset=true" target="_blank">https://web.archive.org/web/20070927193047/http://www.baltimoresun.com/news/nationworld/bal-te.nsa18may18,1,5386811.story?ctrack=1&cset=true</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></li>
<li id="fn:2">"Obama's Crackdown on Whistleblowers." <a href="http://www.thenation.com/article/173521/obamas-crackdown-whistleblowers#axzz2WIl382MU" target="_blank">http://www.thenation.com/article/173521/obamas-crackdown-whistleblowers#axzz2WIl382MU</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></li>
<li id="fn:3">"NSA datamining pushes tech envelope". PhysOrg.com. May 25, 2006.. <a href="http://www.physorg.com/news67784662.html" target="_blank">http://www.physorg.com/news67784662.html</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></li>
<li id="fn:4">"SAIC Team Wins National Security Agency TRAILBLAZER Contract". SAIC. October 21, 2002. <a href="http://www.thefreelibrary.com/SAIC+Team+Wins+National+Security+Agency+TRAILBLAZER+Contract.-a093081931" target="_blank">http://www.thefreelibrary.com/SAIC+Team+Wins+National+Security+Agency+TRAILBLAZER+Contract.-a093081931</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></li>
<li id="fn:5">Exclusive: House Republican Staffer Introduced Alleged NSA Leaker to Reporter, Mark Hosenball, Declassified, Newsweek.com, 2010 Apr 16, accessed 2010 Apr 17 <a href="https://web.archive.org/web/20100421194756/http://blog.newsweek.com/blogs/declassified/archive/2010/04/16/exclusive-house-republican-staffer-introduced-alleged-nsa-leaker-to-reporter.aspx" target="_blank">https://web.archive.org/web/20100421194756/http://blog.newsweek.com/blogs/declassified/archive/2010/04/16/exclusive-house-republican-staffer-introduced-alleged-nsa-leaker-to-reporter.aspx</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></li>
<li id="fn:6">Exclusive: House Republican Staffer Introduced Alleged NSA Leaker to Reporter, Mark Hosenball, Declassified, Newsweek.com, 2010 Apr 16, accessed 2010 Apr 17 <a href="https://web.archive.org/web/20100421194756/http://blog.newsweek.com/blogs/declassified/archive/2010/04/16/exclusive-house-republican-staffer-introduced-alleged-nsa-leaker-to-reporter.aspx" target="_blank">https://web.archive.org/web/20100421194756/http://blog.newsweek.com/blogs/declassified/archive/2010/04/16/exclusive-house-republican-staffer-introduced-alleged-nsa-leaker-to-reporter.aspx</a> <a href="#fnref:6" class="footnote-back-ref">↩</a></li>
<li id="fn:7">Indictment Continues Obama Administration's War on Leaks, Shane Harris, Washingtonian, 01/25/2011, retrieved 3/9/11 <a href="http://www.washingtonian.com/blogarticles/18114.html" target="_blank">http://www.washingtonian.com/blogarticles/18114.html</a> <a href="#fnref:7" class="footnote-back-ref">↩</a></li>
<li id="fn:8">Indictment Continues Obama Administration's War on Leaks, Shane Harris, Washingtonian, 01/25/2011, retrieved 3/9/11 <a href="http://www.washingtonian.com/blogarticles/18114.html" target="_blank">http://www.washingtonian.com/blogarticles/18114.html</a> <a href="#fnref:8" class="footnote-back-ref">↩</a></li>
<li id="fn:9">Scott Shane (11 June 2010). "Obama Takes a Hard Line Against Leaks to Press". The New York Times. <a href="https://www.nytimes.com/2010/06/12/us/politics/12leak.html" target="_blank">https://www.nytimes.com/2010/06/12/us/politics/12leak.html</a> <a href="#fnref:9" class="footnote-back-ref">↩</a></li>
<li id="fn:10">Checkpoint Washington - Setback in case against accused NSA leaker, Ellen Nakashima, Washington Post, 2010 Nov, retrieved from voices.washingtonpost.com on 2011 03 10] <a href="https://web.archive.org/web/20120112034622/http://voices.washingtonpost.com/checkpoint-washington/2010/11/setback_in_case_against_accuse.html" target="_blank">https://web.archive.org/web/20120112034622/http://voices.washingtonpost.com/checkpoint-washington/2010/11/setback_in_case_against_accuse.html</a> <a href="#fnref:10" class="footnote-back-ref">↩</a></li>
<li id="fn:11">Too Classified to Try Myth in Failed Drake Prosecution, Jesselyn Radack, DailyKos, 6/11/11 <a href="https://www.dailykos.com/story/2011/06/11/984192/-Too-Classified-to-Try-Myth-in-Failed-Drake-Prosecution" target="_blank">https://www.dailykos.com/story/2011/06/11/984192/-Too-Classified-to-Try-Myth-in-Failed-Drake-Prosecution</a> <a href="#fnref:11" class="footnote-back-ref">↩</a></li>
<li id="fn:12">See the report, linked above. page 79 & preceding <a href="#fnref:12" class="footnote-back-ref">↩</a></li>
<li id="fn:13">The Secret Sharer, Jane Mayer, The New Yorker, 2011 May, retrieved from www.newyorker.com on 2011 05 29] <a href="https://www.newyorker.com/reporting/2011/05/23/110523fa_fact_mayer?currentPage=all" target="_blank">https://www.newyorker.com/reporting/2011/05/23/110523fa_fact_mayer?currentPage=all</a> <a href="#fnref:13" class="footnote-back-ref">↩</a></li>
<li id="fn:14">Gorman, Siobhan (17 May 2006). "NSA killed system that sifted phone data legally". Baltimore Sun. Archived from the original on 27 September 2007. Retrieved 12 January 2017. - Archive does not provide second page; full text currently available at Pundita <a href="https://web.archive.org/web/20070927193047/http://www.baltimoresun.com/news/nationworld/bal-te.nsa18may18,1,5386811.story?ctrack=1&cset=true" target="_blank">https://web.archive.org/web/20070927193047/http://www.baltimoresun.com/news/nationworld/bal-te.nsa18may18,1,5386811.story?ctrack=1&cset=true</a> <a href="#fnref:14" class="footnote-back-ref">↩</a></li>
<li id="fn:15">Risen, James (2014). Pay Any Price: Greed, Power, and Endless War. Houghton Mifflin Harcourt. ISBN 9780544341418. <a href="9780544341418" target="_blank">9780544341418</a> <a href="#fnref:15" class="footnote-back-ref">↩</a></li>
<li id="fn:16">Gorman, Siobhan (17 May 2006). "NSA killed system that sifted phone data legally". Baltimore Sun. Archived from the original on 27 September 2007. Retrieved 12 January 2017. - Archive does not provide second page; full text currently available at Pundita <a href="https://web.archive.org/web/20070927193047/http://www.baltimoresun.com/news/nationworld/bal-te.nsa18may18,1,5386811.story?ctrack=1&cset=true" target="_blank">https://web.archive.org/web/20070927193047/http://www.baltimoresun.com/news/nationworld/bal-te.nsa18may18,1,5386811.story?ctrack=1&cset=true</a> <a href="#fnref:16" class="footnote-back-ref">↩</a></li>
<li id="fn:17">Gorman, Siobhan (17 May 2006). "NSA killed system that sifted phone data legally". Baltimore Sun. Archived from the original on 27 September 2007. Retrieved 12 January 2017. - Archive does not provide second page; full text currently available at Pundita <a href="https://web.archive.org/web/20070927193047/http://www.baltimoresun.com/news/nationworld/bal-te.nsa18may18,1,5386811.story?ctrack=1&cset=true" target="_blank">https://web.archive.org/web/20070927193047/http://www.baltimoresun.com/news/nationworld/bal-te.nsa18may18,1,5386811.story?ctrack=1&cset=true</a> <a href="#fnref:17" class="footnote-back-ref">↩</a></li>
<li id="fn:18">Gorman, Siobhan (17 May 2006). "NSA killed system that sifted phone data legally". Baltimore Sun. Archived from the original on 27 September 2007. Retrieved 12 January 2017. - Archive does not provide second page; full text currently available at Pundita <a href="https://web.archive.org/web/20070927193047/http://www.baltimoresun.com/news/nationworld/bal-te.nsa18may18,1,5386811.story?ctrack=1&cset=true" target="_blank">https://web.archive.org/web/20070927193047/http://www.baltimoresun.com/news/nationworld/bal-te.nsa18may18,1,5386811.story?ctrack=1&cset=true</a> <a href="#fnref:18" class="footnote-back-ref">↩</a></li>
<li id="fn:19">Gorman, Siobhan (17 May 2006). "NSA killed system that sifted phone data legally". Baltimore Sun. Archived from the original on 27 September 2007. Retrieved 12 January 2017. - Archive does not provide second page; full text currently available at Pundita <a href="https://web.archive.org/web/20070927193047/http://www.baltimoresun.com/news/nationworld/bal-te.nsa18may18,1,5386811.story?ctrack=1&cset=true" target="_blank">https://web.archive.org/web/20070927193047/http://www.baltimoresun.com/news/nationworld/bal-te.nsa18may18,1,5386811.story?ctrack=1&cset=true</a> <a href="#fnref:19" class="footnote-back-ref">↩</a></li>
<li id="fn:20">NSA Killed System That Sifted Phone Data Legally Archived 2008-03-31 at the Wayback Machine <a href="http://www.commondreams.org/headlines06/0518-07.htm" target="_blank">http://www.commondreams.org/headlines06/0518-07.htm</a> <a href="#fnref:20" class="footnote-back-ref">↩</a></li>
<li id="fn:21">Hayden, Michael V. (2017-02-21). Playing to the Edge: American Intelligence in the Age of Terror. Penguin. ISBN 9780143109983. <a href="9780143109983" target="_blank">9780143109983</a> <a href="#fnref:21" class="footnote-back-ref">↩</a></li>
<li id="fn:22">"Former CIA and NSA Director General Michael Hayden (UAF ret) On His New Book "Playing To The Edge" « The Hugh Hewitt Show". The Hugh Hewitt Show. 2016-02-23. Retrieved 2017-10-09. <a href="http://www.hughhewitt.com/former-cia-nsa-director-general-michael-hayden-uaf-ret-new-book-playing-edge/" target="_blank">http://www.hughhewitt.com/former-cia-nsa-director-general-michael-hayden-uaf-ret-new-book-playing-edge/</a> <a href="#fnref:22" class="footnote-back-ref">↩</a></li>
<li id="fn:23">Exclusive: House Republican Staffer Introduced Alleged NSA Leaker to Reporter, Mark Hosenball, Declassified, Newsweek.com, 2010 Apr 16, accessed 2010 Apr 17 <a href="https://web.archive.org/web/20100421194756/http://blog.newsweek.com/blogs/declassified/archive/2010/04/16/exclusive-house-republican-staffer-introduced-alleged-nsa-leaker-to-reporter.aspx" target="_blank">https://web.archive.org/web/20100421194756/http://blog.newsweek.com/blogs/declassified/archive/2010/04/16/exclusive-house-republican-staffer-introduced-alleged-nsa-leaker-to-reporter.aspx</a> <a href="#fnref:23" class="footnote-back-ref">↩</a></li>
<li id="fn:24">Hayden, Michael V. (2017-02-21). Playing to the Edge: American Intelligence in the Age of Terror. Penguin. ISBN 9780143109983. <a href="9780143109983" target="_blank">9780143109983</a> <a href="#fnref:24" class="footnote-back-ref">↩</a></li>
</ol>

ThinThread open-in-new

ThinThread