Enron Corpus

<h2 id="creation">Creation</h2>
In the legal investigation into Enron's collapse, the <a href="/facts/Discovery_(law)/pHMb5suV">discovery</a> process required collecting and preserving vast amounts of data, for which the FERC hired Aspen Systems (now part of <a href="/facts/Lockheed_Martin/URp9BQpA">Lockheed Martin</a>). The emails were collected at Enron Corporation headquarters in <a href="/facts/Houston/1v8AwQUN">Houston</a> during two weeks in May 2002 by Joe Bartling,<a class="footnote-ref" id="fnref:4" href="#fn:4">4</a> a litigation support and data analysis contractor for Aspen. In addition to the Enron employee emails, all of Enron's enterprise database systems,<a class="footnote-ref" id="fnref:5" href="#fn:5">5</a> hosted in <a href="/facts/Oracle_database/FHv5g732">Oracle databases</a> on <a href="/facts/Sun_Microsystems/VJ9EzEFd">Sun Microsystems</a> servers, were captured and preserved, including its online <a href="/facts/Energy_trading/2vH05eJ5">energy trading</a> platform, EnronOnline.
Once collected, the Enron emails were processed and hosted in proprietary <a href="/facts/Electronic_discovery/J1HulEb5">electronic discovery</a> platforms (first Concordance, then iCONECT) for review by investigators from the FERC, <a href="/facts/Commodity_Futures_Trading_Commission/CkMVRt4h">Commodity Futures Trading Commission</a>, and <a href="/facts/United_States_Department_of_Justice/2SuTuevo">Department of Justice</a>. At the conclusion of the investigation, and upon the issuance of the FERC staff report,<a class="footnote-ref" id="fnref:6" href="#fn:6">6</a> the emails and information collected were deemed to be in the <a href="/facts/Public_domain/YWKMDKw4">public domain</a>, to be used for <a href="/facts/Historical_research/TRvVAAns">historical research</a> and academic purposes. The email archive was made publicly available and searchable via the web using iCONECT 24/7, but the sheer volume of email of over 160GB made it impractical to use. Copies of the collected emails and databases were made available on <a href="/facts/Hard_drive/kekLSGSE">hard drives</a>.
Jitesh Shetty and Jafar Adibi from the <a href="/facts/University_of_Southern_California/N0v9R5gs">University of Southern California</a> processed the data in 2004 and released a <a href="/facts/MySQL/QEEDNBDP">MySQL</a> version.<a class="footnote-ref" id="fnref:7" href="#fn:7">7</a> In 2010, EDRM.net published a revised and expanded version 2 of the corpus,<a class="footnote-ref" id="fnref:8" href="#fn:8">8</a> containing over 1.7 million messages, which has been made available on <a href="/facts/Amazon_S3/bqAXYCxq">Amazon S3</a> for easy access to the researchers. 

<h2 id="exploitation">Exploitation</h2>

The corpus is valued as one of the few publicly available mass collections of real emails easily available for study; such collections are typically bound by numerous privacy and legal restrictions which render them prohibitively difficult to access, such as <a href="/facts/Non-disclosure_agreement/3q1t9J05">non-disclosure agreements</a> and <a href="/facts/Sanitization_(classified_information)/MY4wqegs">data sanitization</a>.<a class="footnote-ref" id="fnref:9" href="#fn:9">9</a> Shetty and Adibi, based on their MySQL version, published some <a href="/facts/Link_analysis/E2Cq9BFf">link analysis</a> of which user accounts emailed which.<a class="footnote-ref" id="fnref:10" href="#fn:10">10</a> Linguistic comparison with more recent email <a href="/facts/Language_corpus/bYeEQQdh">corpora</a> shows <a href="/facts/Language_change/ycYsECY0">changes</a> in the email <a href="/facts/Language_register/q1eujwX8">register</a> of English. It is also used as <a href="/facts/Training%2c_validation%2c_and_test_sets/V3mMQb2G">test or training data</a> for research in <a href="/facts/Natural_language_processing/1hjMKsSN">natural language processing</a> and <a href="/facts/Machine_learning/e0w0XJTu">machine learning</a>.<a class="footnote-ref" id="fnref:11" href="#fn:11">11</a> <a href="/facts/The_Pile_(dataset)/Bk4vnVtg">The Pile dataset</a> uses it.

<h2 id="external-links">External links</h2>
<ul><li><a href="https://web.archive.org/web/20140508025018/https://foundationdb.com/documentation/enron.html">Tutorial on data modeling with the Enron Corpus</a></li>
<li><a href="https://s3.amazonaws.com/enron-shetty-adibi/enron-mysqldump.tar.gz">Shetty and Adibi's enron email dataset download on S3</a> (178 MB)</li>
<li>Nathan Heller: <a href="http://www.newyorker.com/magazine/2017/07/24/what-the-enron-e-mails-say-about-us">What the Enron E-mails Say About Us</a> The New Yorker, July 24, 2017</li>
<li><a href="https://threads.cloud/resource/threads-enron-database/">Searchable Enron Email Database</a> (requires registration)</li></ul>

<h2 id="references">References</h2>

<ol>
<li id="fn:1">Klimt, Bryan; Yiming Yang (2004). "The Enron Corpus: A New Dataset for Email Classification Research". pp. 217–226. CiteSeerX 10.1.1.61.1645. <a href="/wiki/CiteSeerX_(identifier)" target="_blank">/wiki/CiteSeerX_(identifier)</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></li>
<li id="fn:2">"The Enron Email Corpus Archived 2011-03-08 at the Wayback Machine" Retrieved March 5, 2011. <a href="http://sgi.nu/enron/" target="_blank">http://sgi.nu/enron/</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></li>
<li id="fn:3">Markoff, John. "Armies of Expensive Lawyers, Replaced by Cheaper Software". New York Times March 5, 2011. p A1. <a href="https://www.nytimes.com/2011/03/05/science/05legal.html?hp" target="_blank">https://www.nytimes.com/2011/03/05/science/05legal.html?hp</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></li>
<li id="fn:4">Bartling, Joe (September 3, 2015). "The Enron Data Set - Where Did It Come From?". Bartling Forensic and Advisory. Archived from the original on April 15, 2016. Retrieved September 3, 2015. <a href="https://web.archive.org/web/20160415195501/http://www.bartlingforensic.com/?p=8633" target="_blank">https://web.archive.org/web/20160415195501/http://www.bartlingforensic.com/?p=8633</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></li>
<li id="fn:5">"FERC: Industries - Enron's Energy Trading Business Process and Databases". www.ferc.gov. Archived from the original on 2020-01-05. Retrieved 2015-09-02. <a href="https://web.archive.org/web/20200105030521/https://www.ferc.gov/industries/electric/indus-act/wec/enron/enrondata.asp" target="_blank">https://web.archive.org/web/20200105030521/https://www.ferc.gov/industries/electric/indus-act/wec/enron/enrondata.asp</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></li>
<li id="fn:6">FERC Staff Report - Price Manipulation in Western Markets - Findings at a Glance Archived 2006-02-21 at the Wayback Machine (3-26-2003) <a href="http://www.ferc.gov/industries/electric/indus-act/wec/enron/summary-findings.pdf" target="_blank">http://www.ferc.gov/industries/electric/indus-act/wec/enron/summary-findings.pdf</a> <a href="#fnref:6" class="footnote-back-ref">↩</a></li>
<li id="fn:7">"Enron processed database" <a href="https://www.cs.cmu.edu/~./enron/" target="_blank">https://www.cs.cmu.edu/~./enron/</a> <a href="#fnref:7" class="footnote-back-ref">↩</a></li>
<li id="fn:8">Socha, George. "EDRM Enron Email Data Set v2 Now Available". EDRM.net. Archived from the original on 2011-09-04. Retrieved 2012-09-03. <a href="https://web.archive.org/web/20110904065923/http://www.edrm.net/archives/6462" target="_blank">https://web.archive.org/web/20110904065923/http://www.edrm.net/archives/6462</a> <a href="#fnref:8" class="footnote-back-ref">↩</a></li>
<li id="fn:9">Markoff, John. "Armies of Expensive Lawyers, Replaced by Cheaper Software". New York Times March 5, 2011. p A1. <a href="https://www.nytimes.com/2011/03/05/science/05legal.html?hp" target="_blank">https://www.nytimes.com/2011/03/05/science/05legal.html?hp</a> <a href="#fnref:9" class="footnote-back-ref">↩</a></li>
<li id="fn:10">Shetty, Jitesh; Adibi, Jafar (2005). "Discovering important nodes through graph entropy the case of Enron email database". Proceedings of the 3rd international workshop on Link discovery - LinkKDD '05. pp. 74–81. doi:10.1145/1134271.1134282. ISBN 978-1595932150. S2CID 10122735. <a href="978-1595932150" target="_blank">978-1595932150</a> <a href="#fnref:10" class="footnote-back-ref">↩</a></li>
<li id="fn:11">Friginal, Eric; Hardy, Jack (2013). Corpus-Based Sociolinguistics: A Guide for Students. Routledge. p. 167. ISBN 978-1-136-29277-4. Retrieved 29 May 2020. <a href="978-1-136-29277-4" target="_blank">978-1-136-29277-4</a> <a href="#fnref:11" class="footnote-back-ref">↩</a></li>
</ol>

Enron Corpus open-in-new

Enron Corpus