Menu
Home
People
Places
Arts
History
Plants & Animals
Science
Life & Culture
Technology
Reference.org
Future of Humanity Institute
open-in-new
<h2 id="history">History</h2> <p>Nick Bostrom established the institute in November 2005 as part of the Oxford Martin School, then the James Martin 21st Century School.<a class="footnote-ref" id="fnref:8" href="#fn:8"><sup>8</sup></a> Between 2008 and 2010, FHI hosted the Global Catastrophic Risks conference, wrote 22 academic journal articles, and published 34 chapters in academic volumes. FHI researchers have given policy advice at the <a href="/facts/World_Economic_Forum/91KlC7Cb">World Economic Forum</a>, to the private and non-profit sector (such as the <a href="/facts/Macarthur_Foundation/jx3tnW9u">Macarthur Foundation</a>, and the <a href="/facts/World_Health_Organization/YNN3bgug">World Health Organization</a>), as well as to governmental bodies in Sweden, Singapore, Belgium, the United Kingdom, and the United States. </p><p>Bostrom and bioethicist <a href="/facts/Julian_Savulescu/PlMJ8Pta">Julian Savulescu</a> also published the book <i>Human Enhancement</i> in March 2009.<a class="footnote-ref" id="fnref:9" href="#fn:9"><sup>9</sup></a> Most recently, FHI has focused on the dangers of advanced <a href="/facts/Artificial_intelligence/lJGauQwX">artificial intelligence</a> (AI). In 2014, its researchers published several books on AI risk, including Stuart Armstrong's <i>Smarter Than Us</i> and Bostrom's <i><a href="/facts/Superintelligence%3a_Paths%2c_Dangers%2c_Strategies/mQkwHpAL">Superintelligence: Paths, Dangers, Strategies</a></i>.<a class="footnote-ref" id="fnref:10" href="#fn:10"><sup>10</sup></a><a class="footnote-ref" id="fnref:11" href="#fn:11"><sup>11</sup></a> </p><p>In 2018, <a href="/facts/Open_Philanthropy_(organization)/bHPRvdhx">Open Philanthropy</a> recommended a grant of up to approximately £13.4 million to FHI over three years, with a large portion conditional on successful hiring.<a class="footnote-ref" id="fnref:12" href="#fn:12"><sup>12</sup></a> </p> <h2 id="existential-risk">Existential risk</h2> <p class="note">Main article: <a href="/facts/Existential_risk/P74aJr4H">Existential risk</a></p> <p>The largest topic FHI has spent time exploring is <a href="/facts/Global_catastrophic_risk/P74aJr4H">global catastrophic risk</a>, and in particular existential risk. In a 2002 paper, Bostrom defined an "existential risk" as one "where an adverse outcome would either annihilate Earth-originating intelligent life or permanently and drastically curtail its potential".<a class="footnote-ref" id="fnref:13" href="#fn:13"><sup>13</sup></a> This includes scenarios where humanity is not directly harmed, but it fails to <a href="/facts/Space_colonization/3xUDzls1">colonize space</a> and make use of the observable universe's available resources in humanly valuable projects, as discussed in Bostrom's 2003 paper, "Astronomical Waste: The <a href="/facts/Opportunity_cost/FYJTAXd6">Opportunity Cost</a> of Delayed Technological Development".<a class="footnote-ref" id="fnref:14" href="#fn:14"><sup>14</sup></a> </p><p>Bostrom and <a href="/facts/Milan_M._%25C4%2586irkovi%25C4%2587/KzqH180P">Milan Ćirković</a>'s 2008 book <i>Global Catastrophic Risks</i> collects essays on a variety of such risks, both natural and anthropogenic. Possible catastrophic risks from nature include <a href="/facts/Supervolcano/wTWrBEja">super-volcanism</a>, <a href="/facts/Impact_event/fbWu9Q4p">impact events</a>, and energetic astronomical events such as <a href="/facts/Gamma-ray_burst/oRRU6Fhn">gamma-ray bursts</a>, <a href="/facts/Cosmic_ray/uxCVdTKd">cosmic rays</a>, <a href="/facts/Solar_flare/6kCvPKxD">solar flares</a>, and <a href="/facts/Supernova/Pfo2J23l">supernovae</a>. These dangers are characterized as relatively small and relatively well understood, though <a href="/facts/Pandemic/KaJe9rTu">pandemics</a> may be exceptions as a result of being more common, and of dovetailing with technological trends.<a class="footnote-ref" id="fnref:15" href="#fn:15"><sup>15</sup></a><a class="footnote-ref" id="fnref:16" href="#fn:16"><sup>16</sup></a> </p><p>Synthetic pandemics via weaponized <a href="/facts/Biological_agent/4YnbS6Em">biological agents</a> are given more attention by FHI. Technological outcomes the institute is particularly interested in include <a href="/facts/Global_warming/rEN4BDE7">anthropogenic climate change</a>, <a href="/facts/Nuclear_warfare/HLRLRh4F">nuclear warfare</a> and <a href="/facts/Nuclear_terrorism/b1PUoPdB">nuclear terrorism</a>, <a href="/facts/Molecular_nanotechnology/D6GsTH54">molecular nanotechnology</a>, and <a href="/facts/Artificial_general_intelligence/vbxwaq8t">artificial general intelligence</a>. In expecting the largest risks to stem from future technologies, and from advanced artificial intelligence in particular, FHI agrees with other existential risk reduction organizations, such as the <a href="/facts/Centre_for_the_Study_of_Existential_Risk/Ruu4Md49">Centre for the Study of Existential Risk</a> and the <a href="/facts/Machine_Intelligence_Research_Institute/LfTdXVp9">Machine Intelligence Research Institute</a>.<a class="footnote-ref" id="fnref:17" href="#fn:17"><sup>17</sup></a><a class="footnote-ref" id="fnref:18" href="#fn:18"><sup>18</sup></a> FHI researchers have also studied the impact of technological progress on social and institutional risks, such as <a href="/facts/Totalitarianism/Txc6sJvM">totalitarianism</a>, <a href="/facts/Technological_unemployment/96aJLKzD">automation-driven unemployment</a>, and information hazards.<a class="footnote-ref" id="fnref:19" href="#fn:19"><sup>19</sup></a> </p><p>In 2020, FHI Senior Research Fellow Toby Ord published his book <i><a href="/facts/The_Precipice%3a_Existential_Risk_and_the_Future_of_Humanity/u8KhPy4d">The Precipice: Existential Risk and the Future of Humanity</a></i>, in which he argues that safeguarding humanity's future is among the most important moral issues of our time.<a class="footnote-ref" id="fnref:20" href="#fn:20"><sup>20</sup></a><a class="footnote-ref" id="fnref:21" href="#fn:21"><sup>21</sup></a> </p> <h2 id="anthropic-reasoning">Anthropic reasoning</h2> <p class="note">Main article: <a href="/facts/Anthropic_principle/LrJDwfC9">Anthropic principle</a></p> <p>FHI devotes much of its attention to exotic threats that have been little explored by other organizations, and to methodological considerations that inform existential risk reduction and forecasting. The institute has particularly emphasized <a href="/facts/Anthropic_principle/LrJDwfC9">anthropic reasoning</a> in its research, as an under-explored area with general epistemological implications. </p><p>Anthropic arguments FHI has studied include the <a href="/facts/Doomsday_argument/WAdhNHvb">doomsday argument</a>, which claims that humanity is likely to go extinct soon because it is unlikely that one is observing a point in human history that is extremely early. Instead, present-day humans are likely to be near the middle of the distribution of humans that will ever live.<a class="footnote-ref" id="fnref:22" href="#fn:22"><sup>22</sup></a> Bostrom has also popularized the <a href="/facts/Simulation_argument/IVrml807">simulation argument</a>. </p><p>A recurring theme in FHI's research is the <a href="/facts/Fermi_paradox/P85yfUo0">Fermi paradox</a>, the surprising absence of observable alien civilizations. Robin Hanson has argued that there must be a "<a href="/facts/Great_Filter/nNDuT6UF">Great Filter</a>" preventing space colonization to account for the paradox. That filter may lie in the past, if intelligence is much more rare than current biology would predict; or it may lie in the future, if existential risks are even larger than is currently recognized. </p> <h2 id="human-enhancement-and-rationality">Human enhancement and rationality</h2> <p>Closely linked to FHI's work on risk assessment, astronomical waste, and the dangers of future technologies is its work on the promise and risks of <a href="/facts/Human_enhancement/2b0Kpvdd">human enhancement</a>. The modifications in question may be biological, digital, or sociological, and an emphasis is placed on the most radical hypothesized changes, rather than on the likeliest short-term innovations. FHI's <a href="/facts/Bioethics/deT0les8">bioethics</a> research focuses on the potential consequences of <a href="/facts/Gene_therapy/CaxRLfKM">gene therapy</a>, <a href="/facts/Life_extension/uQj1vQdg">life extension</a>, <a href="/facts/Brain_implant/eaHAKydz">brain implants</a> and <a href="/facts/Brain%25E2%2580%2593computer_interface/wdXWqFVr">brain–computer interfaces</a>, and <a href="/facts/Mind_uploading/Egs4sJpN">mind uploading</a>.<a class="footnote-ref" id="fnref:23" href="#fn:23"><sup>23</sup></a> </p><p>FHI's focus has been on methods for assessing and enhancing human intelligence and rationality, as a way of shaping the speed and direction of technological and social progress. FHI's work on human irrationality, as exemplified in <a href="/facts/Heuristics_in_judgment_and_decision-making/gwyv5AkX">cognitive heuristics</a> and <a href="/facts/Cognitive_bias/49YKVhmN">biases</a>, includes an ongoing collaboration with <a href="/facts/Amlin/gQE5kcEr">Amlin</a> to study the <a href="/facts/Systemic_risk/r0XxpxpV">systemic risk</a> arising from biases in modeling.<a class="footnote-ref" id="fnref:24" href="#fn:24"><sup>24</sup></a><a class="footnote-ref" id="fnref:25" href="#fn:25"><sup>25</sup></a> </p> <h2 id="selected-publications">Selected publications</h2> <ul><li><a href="/facts/Toby_Ord/1MrSvutj">Toby Ord</a>: <i><a href="/facts/The_Precipice%3a_Existential_Risk_and_the_Future_of_Humanity/u8KhPy4d">The Precipice: Existential Risk and the Future of Humanity</a></i>, 2020. <a href="/facts/ISBN_(identifier)/15AdSPa9">ISBN</a> 1526600218</li> <li><a href="/facts/Nick_Bostrom/kyNalABj">Nick Bostrom</a>: <i><a href="/facts/Superintelligence%3a_Paths%2c_Dangers%2c_Strategies/mQkwHpAL">Superintelligence: Paths, Dangers, Strategies</a></i>, 2014. <a href="/facts/ISBN_(identifier)/15AdSPa9">ISBN</a> 0-415-93858-9</li> <li>Nick Bostrom and <a href="/facts/Milan_M._%25C4%2586irkovi%25C4%2587/KzqH180P">Milan Ćirković</a>: <i><a href="/facts/Global_Catastrophic_Risks_(book)/94oWjIhI">Global Catastrophic Risks</a></i>, 2011. <a href="/facts/ISBN_(identifier)/15AdSPa9">ISBN</a> 978-0-19-857050-9</li> <li>Nick Bostrom and <a href="/facts/Julian_Savulescu/PlMJ8Pta">Julian Savulescu</a>: <i><a href="/facts/Human_Enhancement/Jb97qI4L">Human Enhancement</a></i>, 2011. <a href="/facts/ISBN_(identifier)/15AdSPa9">ISBN</a> 0-19-929972-2</li> <li><a href="https://www.amazon.com/Anthropic-Bias-Observation-Selection-Philosophy/dp/0415883946/">Nick Bostrom: <i>Anthropic Bias: Observation Selection Effects in Science and Philosophy</i></a>, 2010. <a href="/facts/ISBN_(identifier)/15AdSPa9">ISBN</a> 0-415-93858-9</li> <li><a href="https://www.fhi.ox.ac.uk/brain-emulation-roadmap-report.pdf">Nick Bostrom and Anders Sandberg: <i>Brain Emulation Roadmap</i></a>, 2008.</li></ul> <h2 id="see-also">See also</h2> <ul><li><a href="/facts/Future_of_Life_Institute/9uVkYMLb">Future of Life Institute</a></li> <li><a href="/facts/Futures_studies/h59ennpW">Futures studies</a></li> <li><a href="/facts/Leverhulme_Centre_for_the_Future_of_Intelligence/Xpsq3L0j">Leverhulme Centre for the Future of Intelligence</a></li> <li><a href="/facts/Effective_altruism/dIIN7SrC">Effective altruism</a></li></ul> <h2 id="further-reading">Further reading</h2> <ul><li>Anthony, Andrew (28 April 2024). <a href="https://www.theguardian.com/technology/2024/apr/28/nick-bostrom-controversial-future-of-humanity-institute-closure-longtermism-affective-altruism">"'Eugenics on steroids': the toxic and contested legacy of Oxford's Future of Humanity Institute"</a>. <i><a href="/facts/The_Observer/mY7AHeEp">The Observer</a></i>.</li></ul> <h2 id="external-links">External links</h2> <ul><li><a href="http://www.fhi.ox.ac.uk/">FHI official website</a></li></ul> <h2 id="references">References</h2> <ol> <li id="fn:1"><p>"Humanity's Future: Future of Humanity Institute". Oxford Martin School. Archived from the original on 17 March 2014. Retrieved 28 March 2014. <a href="https://web.archive.org/web/20140317012357/http://www.oxfordmartin.ox.ac.uk/institutes/future_humanity" target="_blank">https://web.archive.org/web/20140317012357/http://www.oxfordmartin.ox.ac.uk/institutes/future_humanity</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></p></li> <li id="fn:2"><p>"Staff". Future of Humanity Institute. Retrieved 28 March 2014. <a href="http://www.fhi.ox.ac.uk/about/staff/" target="_blank">http://www.fhi.ox.ac.uk/about/staff/</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></p></li> <li id="fn:3"><p>"About FHI". Future of Humanity Institute. Archived from the original on 1 December 2015. Retrieved 28 March 2014. <a href="https://web.archive.org/web/20151201023727/http://www.fhi.ox.ac.uk/about/mission/" target="_blank">https://web.archive.org/web/20151201023727/http://www.fhi.ox.ac.uk/about/mission/</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></p></li> <li id="fn:4"><p>Ross Andersen (25 February 2013). "Omens". Aeon Magazine. Archived from the original on 9 February 2014. Retrieved 28 March 2014. <a href="https://web.archive.org/web/20140209121924/http://aeon.co/magazine/world-views/ross-andersen-human-extinction/" target="_blank">https://web.archive.org/web/20140209121924/http://aeon.co/magazine/world-views/ross-andersen-human-extinction/</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></p></li> <li id="fn:5"><p>"Support FHI". Future of Humanity Institute. 2021. Archived from the original on 20 October 2021. Retrieved 23 July 2022. <a href="https://www.fhi.ox.ac.uk/support-fhi/" target="_blank">https://www.fhi.ox.ac.uk/support-fhi/</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></p></li> <li id="fn:6"><p>"Future of Humanity Institute". 17 April 2024. Archived from the original on 17 April 2024. Retrieved 17 April 2024.{{cite web}}: CS1 maint: bot: original URL status unknown (link) <a href="https://web.archive.org/web/20240417000845/https://www.futureofhumanityinstitute.org/" target="_blank">https://web.archive.org/web/20240417000845/https://www.futureofhumanityinstitute.org/</a> <a href="#fnref:6" class="footnote-back-ref">↩</a></p></li> <li id="fn:7"><p>Maiberg, Emanuel (17 April 2024). "Institute That Pioneered AI 'Existential Risk' Research Shuts Down". 404 Media. Retrieved 17 April 2024. <a href="https://www.404media.co/institute-that-pioneered-ai-existential-risk-research-shuts-down/" target="_blank">https://www.404media.co/institute-that-pioneered-ai-existential-risk-research-shuts-down/</a> <a href="#fnref:7" class="footnote-back-ref">↩</a></p></li> <li id="fn:8"><p>"Humanity's Future: Future of Humanity Institute". Oxford Martin School. Archived from the original on 17 March 2014. Retrieved 28 March 2014. <a href="https://web.archive.org/web/20140317012357/http://www.oxfordmartin.ox.ac.uk/institutes/future_humanity" target="_blank">https://web.archive.org/web/20140317012357/http://www.oxfordmartin.ox.ac.uk/institutes/future_humanity</a> <a href="#fnref:8" class="footnote-back-ref">↩</a></p></li> <li id="fn:9"><p>Nick Bostrom (18 July 2007). Achievements Report: 2008-2010 (PDF) (Report). Future of Humanity Institute. Archived from the original (PDF) on 21 December 2012. Retrieved 31 March 2014. <a href="https://web.archive.org/web/20121221144029/http://www.fhi.ox.ac.uk/__data/assets/pdf_file/0019/19900/Achievements_Report_2008-2010.pdf" target="_blank">https://web.archive.org/web/20121221144029/http://www.fhi.ox.ac.uk/__data/assets/pdf_file/0019/19900/Achievements_Report_2008-2010.pdf</a> <a href="#fnref:9" class="footnote-back-ref">↩</a></p></li> <li id="fn:10"><p>Mark Piesing (17 May 2012). "AI uprising: humans will be outsourced, not obliterated". Wired. Retrieved 31 March 2014. <a href="https://www.wired.co.uk/news/archive/2012-05/17/the-dangers-of-an-ai-smarter-than-us" target="_blank">https://www.wired.co.uk/news/archive/2012-05/17/the-dangers-of-an-ai-smarter-than-us</a> <a href="#fnref:10" class="footnote-back-ref">↩</a></p></li> <li id="fn:11"><p>Coughlan, Sean (24 April 2013). "How are humans going to become extinct?". BBC News. Retrieved 29 March 2014. <a href="https://www.bbc.com/news/business-22002530" target="_blank">https://www.bbc.com/news/business-22002530</a> <a href="#fnref:11" class="footnote-back-ref">↩</a></p></li> <li id="fn:12"><p>Open Philanthropy Project (July 2018). "Future of Humanity Institute — Work on Global Catastrophic Risks". <a href="/wiki/Open_Philanthropy_Project" target="_blank">/wiki/Open_Philanthropy_Project</a> <a href="#fnref:12" class="footnote-back-ref">↩</a></p></li> <li id="fn:13"><p>Nick Bostrom (March 2002). "Existential Risks: Analyzing Human Extinction Scenarios and Related Hazards". Journal of Evolution and Technology. 15 (3): 308–314. Retrieved 31 March 2014. <a href="http://www.jetpress.org/volume9/risks.html" target="_blank">http://www.jetpress.org/volume9/risks.html</a> <a href="#fnref:13" class="footnote-back-ref">↩</a></p></li> <li id="fn:14"><p>Nick Bostrom (November 2003). "Astronomical Waste: The Opportunity Cost of Delayed Technological Development". Utilitas. 15 (3): 308–314. CiteSeerX 10.1.1.429.2849. doi:10.1017/s0953820800004076. S2CID 15860897. Retrieved 31 March 2014. <a href="http://www.nickbostrom.com/astronomical/waste.html" target="_blank">http://www.nickbostrom.com/astronomical/waste.html</a> <a href="#fnref:14" class="footnote-back-ref">↩</a></p></li> <li id="fn:15"><p>Ross Andersen (6 March 2012). "We're Underestimating the Risk of Human Extinction". The Atlantic. Retrieved 29 March 2014. <a href="https://www.theatlantic.com/technology/archive/2012/03/were-underestimating-the-risk-of-human-extinction/253821/" target="_blank">https://www.theatlantic.com/technology/archive/2012/03/were-underestimating-the-risk-of-human-extinction/253821/</a> <a href="#fnref:15" class="footnote-back-ref">↩</a></p></li> <li id="fn:16"><p>Ross Andersen (25 February 2013). "Omens". Aeon Magazine. Archived from the original on 9 February 2014. Retrieved 28 March 2014. <a href="https://web.archive.org/web/20140209121924/http://aeon.co/magazine/world-views/ross-andersen-human-extinction/" target="_blank">https://web.archive.org/web/20140209121924/http://aeon.co/magazine/world-views/ross-andersen-human-extinction/</a> <a href="#fnref:16" class="footnote-back-ref">↩</a></p></li> <li id="fn:17"><p>Kate Whitehead (16 March 2014). "Cambridge University study centre focuses on risks that could annihilate mankind". South China Morning Post. Retrieved 29 March 2014. <a href="http://www.scmp.com/lifestyle/technology/article/1449541/cambridge-university-study-centre-focuses-risks-could" target="_blank">http://www.scmp.com/lifestyle/technology/article/1449541/cambridge-university-study-centre-focuses-risks-could</a> <a href="#fnref:17" class="footnote-back-ref">↩</a></p></li> <li id="fn:18"><p>Jenny Hollander (September 2012). "Oxford Future of Humanity Institute knows what will make us extinct". Bustle. Retrieved 31 March 2014. <a href="http://www.bustle.com/articles/4682-oxford-future-of-humanity-institute-knows-what-will-make-us-extinct" target="_blank">http://www.bustle.com/articles/4682-oxford-future-of-humanity-institute-knows-what-will-make-us-extinct</a> <a href="#fnref:18" class="footnote-back-ref">↩</a></p></li> <li id="fn:19"><p>Nick Bostrom. "Information Hazards: A Typology of Potential Harms from Knowledge" (PDF). Future of Humanity Institute. Retrieved 31 March 2014. <a href="http://www.nickbostrom.com/information-hazards.pdf" target="_blank">http://www.nickbostrom.com/information-hazards.pdf</a> <a href="#fnref:19" class="footnote-back-ref">↩</a></p></li> <li id="fn:20"><p>Ord, Toby. "The Precipice: Existential Risk and the Future of Humanity". The Precipice Website. Retrieved 18 October 2020. <a href="https://theprecipice.com/" target="_blank">https://theprecipice.com/</a> <a href="#fnref:20" class="footnote-back-ref">↩</a></p></li> <li id="fn:21"><p>Chivers, Tom (7 March 2020). "How close is humanity to destroying itself?". The Spectator. Retrieved 18 October 2020. <a href="https://www.spectator.co.uk/article/how-close-is-humanity-to-destroying-itself" target="_blank">https://www.spectator.co.uk/article/how-close-is-humanity-to-destroying-itself</a> <a href="#fnref:21" class="footnote-back-ref">↩</a></p></li> <li id="fn:22"><p>Ross Andersen (6 March 2012). "We're Underestimating the Risk of Human Extinction". The Atlantic. Retrieved 29 March 2014. <a href="https://www.theatlantic.com/technology/archive/2012/03/were-underestimating-the-risk-of-human-extinction/253821/" target="_blank">https://www.theatlantic.com/technology/archive/2012/03/were-underestimating-the-risk-of-human-extinction/253821/</a> <a href="#fnref:22" class="footnote-back-ref">↩</a></p></li> <li id="fn:23"><p>Anders Sandberg and Nick Bostrom. "Whole Brain Emulation: A Roadmap" (PDF). Future of Humanity Institute. Retrieved 31 March 2014. <a href="http://www.fhi.ox.ac.uk/brain-emulation-roadmap-report.pdf" target="_blank">http://www.fhi.ox.ac.uk/brain-emulation-roadmap-report.pdf</a> <a href="#fnref:23" class="footnote-back-ref">↩</a></p></li> <li id="fn:24"><p>"Amlin and Oxford University launch major research project into the Systemic Risk of Modelling" (Press release). Amlin. 11 February 2014. Archived from the original on 13 April 2014. Retrieved 31 March 2014. <a href="https://web.archive.org/web/20140413083047/http://www.amlin.com/media/press-releases/2014/11-2-2014.aspx" target="_blank">https://web.archive.org/web/20140413083047/http://www.amlin.com/media/press-releases/2014/11-2-2014.aspx</a> <a href="#fnref:24" class="footnote-back-ref">↩</a></p></li> <li id="fn:25"><p>"Amlin and Oxford University to collaborate on modelling risk study". Continuity, Insurance & Risk Magazine. 11 February 2014. Retrieved 31 March 2014. <a href="http://www.cirmagazine.com/cir/Amlin-and-Oxford-University-to-collaborate-on-modelling-risk-study.php" target="_blank">http://www.cirmagazine.com/cir/Amlin-and-Oxford-University-to-collaborate-on-modelling-risk-study.php</a> <a href="#fnref:25" class="footnote-back-ref">↩</a></p></li> </ol>