Spanner (database)

<h2 id="features">Features</h2>
Spanner stores large amounts of mutable structured data. Spanner allows users to perform arbitrary queries using SQL with relational data while maintaining strong consistency and high availability for that data with synchronous replication.
Key features of Spanner:

<ul><li>Transactions can be applied across rows, columns, tables, and databases within a Spanner universe.</li>
<li>Clients can control the replication and placement of data using automatic multi-site replication and failover.</li>
<li>Replication is synchronous and strongly consistent.</li>
<li>Reads are strongly consistent and data is versioned to allow for stale reads: clients can read previous versions of data, subject to garbage collection windows.</li>
<li>Supports a native SQL interface for reading and writing data.</li></ul>
<h2 id="history">History</h2>
Spanner was first described in 2012 for internal <a href="/facts/Google_data_centers/WeRBWwtd">Google data centers</a>.<a class="footnote-ref" id="fnref:4" href="#fn:4">4</a>
Spanner's SQL capability was added in 2017 and documented in a <a href="/facts/SIGMOD/WjPo3dWP">SIGMOD</a> 2017 paper.<a class="footnote-ref" id="fnref:5" href="#fn:5">5</a> It became available as part of <a href="/facts/Google_Cloud_Platform/lPTNk7l6">Google Cloud Platform</a> in 2017, under the name "Cloud Spanner".<a class="footnote-ref" id="fnref:6" href="#fn:6">6</a>

<h2 id="architecture">Architecture</h2>
Spanner uses the <a href="/facts/Paxos_algorithm/S7KYPNb6">Paxos algorithm</a> as part of its operation to <a href="/facts/Shard_(database_architecture)/YSE3YS0M">shard</a> (partition) data across up to hundreds of servers.<a class="footnote-ref" id="fnref:7" href="#fn:7">7</a> It makes heavy use of hardware-assisted <a href="/facts/Clock_synchronization/xKykfAJ5">clock synchronization</a> using <a href="/facts/GPS_clock/UdEegbB4">GPS clocks</a> and <a href="/facts/Atomic_clock/MF8nsXDR">atomic clocks</a> to ensure <a href="/facts/Global_consistency/WUxG1d41">global consistency</a>.<a class="footnote-ref" id="fnref:8" href="#fn:8">8</a> TrueTime is the brand name for Google's distributed cloud infrastructure, which provides Spanner with the ability to generate monotonically increasing timestamps in data centers around the world.<a class="footnote-ref" id="fnref:9" href="#fn:9">9</a>
Google's F1 SQL <a href="/facts/Database_management_system/VYcpkevb">database management system</a> (DBMS) is built on top of Spanner,<a class="footnote-ref" id="fnref:10" href="#fn:10">10</a> replacing Google's custom <a href="/facts/MySQL/QEEDNBDP">MySQL</a> variant.<a class="footnote-ref" id="fnref:11" href="#fn:11">11</a>

<h2 id="bibliography">Bibliography</h2>
<ul><li>Corbett, James C; <a href="/facts/Jeff_Dean_(computer_scientist)/YIEWyTM4">Dean, Jeffrey</a>; Epstein, Michael; Fikes, Andrew; Frost, Christopher; Furman, JJ; <a href="/facts/Sanjay_Ghemawat/ppwWMYHj">Ghemawat, Sanjay</a>; Gubarev, Andrey; Heiser, Christopher; Hochschild, Peter; Hsieh, Wilson; Kanthak, Sebastian; Kogan, Eugene; Li, Hongyi; Lloyd, Alexander; Melnik, Sergey; Mwaura, David; Nagle, David; Quinlan, Sean; Rao, Rajesh; Rolig, Lindsay; Saito, Yasushi; Szymaniak, Michal; Taylor, Christopher; Wang, Ruth; Woodford, Dale (2012). <a href="http://static.googleusercontent.com/external_content/untrusted_dlcp/research.google.com/en//archive/spanner-osdi2012.pdf">Spanner: Google's Globally-Distributed Database</a> (PDF). <a href="/facts/Operating_Systems_Design_and_Implementation/pWufR8gx">10th USENIX Symposium on Operating Systems Design and Implementation</a> (OSDI'12). Hollywood, CA. Retrieved 18 September 2012.{{cite conference}}: CS1 maint: ref duplicates default (link).</li>
<li>Date, Christopher ‘Chris’ J (2004), "6. Relations, Part II. The Relational Model", <a href="https://archive.org/details/introductiontoda0000date">An Introduction to Database Systems</a> (8th ed.), Addison Wesley, <a href="/facts/ISBN_(identifier)/15AdSPa9">ISBN</a> 978-0-32119784-9.</li>
<li>Shute, Jeffrey ‘Jeff’; Oancea, Mircea; Ellner, Stephan; Handy, Benjamin ‘Ben’; Rollins, Eric; Samwel, Bart; Vingralek, Radek; Whipkey, Chad; Chen, Xin; Jegerlehner, Beat; Littlefield, Kyle; Tong, Phoenix (2012), "F1 — the Fault-Tolerant Distributed RDBMS Supporting Google's Ad Business", <a href="http://research.google.com/pubs/pub38125.html">Research</a> (presentation), <a href="/facts/SIGMOD/WjPo3dWP">SIGMOD</a>{{citation}}: CS1 maint: location missing publisher (link).</li>
<li>Shute, Jeffrey ‘Jeff’; Oancea, Mircea; Ellner, Stephan; Handy, Benjamin ‘Ben’; Rollins, Eric; Samwel, Bart; Vingralek, Radek; Whipkey, Chad; Rae, Ian; Apte, Himani; Littlefield, Kyle; Cieslewicz, John (2013), "F1: A Distributed SQL Database That Scales", <a href="https://research.google/pubs/pub41344/">Research</a> (presentation), <a href="/facts/International_Conference_on_Very_Large_Data_Bases/kI6n1DQA">International Conference on Very Large Data Bases</a>{{citation}}: CS1 maint: location missing publisher (link).</li></ul>
<h2 id="further-reading">Further reading</h2>
<ul><li>Clark, Jack (30 Aug 2013). <a href="https://www.theregister.com/2013/08/30/google_f1_deepdive/">"Google goes back to the future with SQL F1 database"</a>. www.theregister.com.</li></ul>

<h2 id="references">References</h2>

<ol>
<li id="fn:1">Corbett et al. 2012. - Corbett, James C; Dean, Jeffrey; Epstein, Michael; Fikes, Andrew; Frost, Christopher; Furman, JJ; Ghemawat, Sanjay; Gubarev, Andrey; Heiser, Christopher; Hochschild, Peter; Hsieh, Wilson; Kanthak, Sebastian; Kogan, Eugene; Li, Hongyi; Lloyd, Alexander; Melnik, Sergey; Mwaura, David; Nagle, David; Quinlan, Sean; Rao, Rajesh; Rolig, Lindsay; Saito, Yasushi; Szymaniak, Michal; Taylor, Christopher; Wang, Ruth; Woodford, Dale (2012). Spanner: Google's Globally-Distributed Database (PDF). 10th USENIX Symposium on Operating Systems Design and Implementation (OSDI'12). Hollywood, CA. Retrieved 18 September 2012. <a href="http://static.googleusercontent.com/external_content/untrusted_dlcp/research.google.com/en//archive/spanner-osdi2012.pdf" target="_blank">http://static.googleusercontent.com/external_content/untrusted_dlcp/research.google.com/en//archive/spanner-osdi2012.pdf</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></li>
<li id="fn:2">Shute et al. 2012. - Shute, Jeffrey ‘Jeff’; Oancea, Mircea; Ellner, Stephan; Handy, Benjamin ‘Ben’; Rollins, Eric; Samwel, Bart; Vingralek, Radek; Whipkey, Chad; Chen, Xin; Jegerlehner, Beat; Littlefield, Kyle; Tong, Phoenix (2012), "F1 — the Fault-Tolerant Distributed RDBMS Supporting Google's Ad Business", Research (presentation), SIGMOD <a href="http://research.google.com/pubs/pub38125.html" target="_blank">http://research.google.com/pubs/pub38125.html</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></li>
<li id="fn:3">"Announcing Cloud Spanner Price Performance Updates". <a href="https://cloud.google.com/blog/products/databases/announcing-cloud-spanner-price-performance-updates" target="_blank">https://cloud.google.com/blog/products/databases/announcing-cloud-spanner-price-performance-updates</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></li>
<li id="fn:4">Clark, Jack (September 18, 2012). "Google reveals Spanner, the database tech that can span the planet". ZDNet. Retrieved August 4, 2021. <a href="https://www.zdnet.com/article/google-reveals-spanner-the-database-tech-that-can-span-the-planet/" target="_blank">https://www.zdnet.com/article/google-reveals-spanner-the-database-tech-that-can-span-the-planet/</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></li>
<li id="fn:5">Spanner: Becoming a SQL System. 9 May 2017. pp. 331–343. doi:10.1145/3035918.3056103. ISBN 9781450341974. S2CID 3055672. <a href="9781450341974" target="_blank">9781450341974</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></li>
<li id="fn:6">Srivastava, Deepti (February 14, 2017). "Introducing Cloud Spanner: a global database service for mission-critical applications". Google Cloud Blog. Retrieved August 4, 2021. <a href="https://cloud.google.com/blog/products/gcp/introducing-cloud-spanner-a-global-database-service-for-mission-critical-applications" target="_blank">https://cloud.google.com/blog/products/gcp/introducing-cloud-spanner-a-global-database-service-for-mission-critical-applications</a> <a href="#fnref:6" class="footnote-back-ref">↩</a></li>
<li id="fn:7">Corbett et al. 2012. - Corbett, James C; Dean, Jeffrey; Epstein, Michael; Fikes, Andrew; Frost, Christopher; Furman, JJ; Ghemawat, Sanjay; Gubarev, Andrey; Heiser, Christopher; Hochschild, Peter; Hsieh, Wilson; Kanthak, Sebastian; Kogan, Eugene; Li, Hongyi; Lloyd, Alexander; Melnik, Sergey; Mwaura, David; Nagle, David; Quinlan, Sean; Rao, Rajesh; Rolig, Lindsay; Saito, Yasushi; Szymaniak, Michal; Taylor, Christopher; Wang, Ruth; Woodford, Dale (2012). Spanner: Google's Globally-Distributed Database (PDF). 10th USENIX Symposium on Operating Systems Design and Implementation (OSDI'12). Hollywood, CA. Retrieved 18 September 2012. <a href="http://static.googleusercontent.com/external_content/untrusted_dlcp/research.google.com/en//archive/spanner-osdi2012.pdf" target="_blank">http://static.googleusercontent.com/external_content/untrusted_dlcp/research.google.com/en//archive/spanner-osdi2012.pdf</a> <a href="#fnref:7" class="footnote-back-ref">↩</a></li>
<li id="fn:8">Corbett et al. 2012. - Corbett, James C; Dean, Jeffrey; Epstein, Michael; Fikes, Andrew; Frost, Christopher; Furman, JJ; Ghemawat, Sanjay; Gubarev, Andrey; Heiser, Christopher; Hochschild, Peter; Hsieh, Wilson; Kanthak, Sebastian; Kogan, Eugene; Li, Hongyi; Lloyd, Alexander; Melnik, Sergey; Mwaura, David; Nagle, David; Quinlan, Sean; Rao, Rajesh; Rolig, Lindsay; Saito, Yasushi; Szymaniak, Michal; Taylor, Christopher; Wang, Ruth; Woodford, Dale (2012). Spanner: Google's Globally-Distributed Database (PDF). 10th USENIX Symposium on Operating Systems Design and Implementation (OSDI'12). Hollywood, CA. Retrieved 18 September 2012. <a href="http://static.googleusercontent.com/external_content/untrusted_dlcp/research.google.com/en//archive/spanner-osdi2012.pdf" target="_blank">http://static.googleusercontent.com/external_content/untrusted_dlcp/research.google.com/en//archive/spanner-osdi2012.pdf</a> <a href="#fnref:8" class="footnote-back-ref">↩</a></li>
<li id="fn:9">"Cloud Spanner: TrueTime and external consistency". Google Cloud. Retrieved 2020-11-24. <a href="https://cloud.google.com/spanner/docs/true-time-external-consistency" target="_blank">https://cloud.google.com/spanner/docs/true-time-external-consistency</a> <a href="#fnref:9" class="footnote-back-ref">↩</a></li>
<li id="fn:10">Shute et al. 2012. - Shute, Jeffrey ‘Jeff’; Oancea, Mircea; Ellner, Stephan; Handy, Benjamin ‘Ben’; Rollins, Eric; Samwel, Bart; Vingralek, Radek; Whipkey, Chad; Chen, Xin; Jegerlehner, Beat; Littlefield, Kyle; Tong, Phoenix (2012), "F1 — the Fault-Tolerant Distributed RDBMS Supporting Google's Ad Business", Research (presentation), SIGMOD <a href="http://research.google.com/pubs/pub38125.html" target="_blank">http://research.google.com/pubs/pub38125.html</a> <a href="#fnref:10" class="footnote-back-ref">↩</a></li>
<li id="fn:11">Shute et al. 2012, p. 19: ‘Summary: We've moved a large and critical application suite from MySQL to F1.’ - Shute, Jeffrey ‘Jeff’; Oancea, Mircea; Ellner, Stephan; Handy, Benjamin ‘Ben’; Rollins, Eric; Samwel, Bart; Vingralek, Radek; Whipkey, Chad; Chen, Xin; Jegerlehner, Beat; Littlefield, Kyle; Tong, Phoenix (2012), "F1 — the Fault-Tolerant Distributed RDBMS Supporting Google's Ad Business", Research (presentation), SIGMOD <a href="http://research.google.com/pubs/pub38125.html" target="_blank">http://research.google.com/pubs/pub38125.html</a> <a href="#fnref:11" class="footnote-back-ref">↩</a></li>
</ol>

Spanner (database) open-in-new

Spanner (database)