ARCore

<h2 id="key-technologies">Key technologies</h2>
<p>ARCore uses a few key technologies to integrate virtual content with the real world as seen through the camera of a smartphone or tablet.<a class="footnote-ref" id="fnref:2" href="#fn:2"><sup>2</sup></a> Each of these technologies can be utilized by developers to create a high-quality, immersive AR experience.
</p>
<h3>Six degrees of freedom</h3>
<ul><li>Allows the phone to understand and <a href="/facts/Positional_tracking/aV3Sy9lm">track its position</a> relative to the world.</li>
<li>A <a href="/facts/Pose_tracking/aV3Sy9lm">motion tracking</a> process known as <a href="/facts/Simultaneous_localization_and_mapping/sUFsNFG9">simultaneous localization and mapping</a> (SLAM) utilizes feature points - which are visually distinct objects within camera view - to provide focal points for the phone to determine proper positioning (pose) of the device.<a class="footnote-ref" id="fnref:3" href="#fn:3"><sup>3</sup></a></li></ul>
<h3>Environmental understanding</h3>
<ul><li>Allows the phone to detect the size and location of flat surfaces - both vertical and horizontal - with feature points.</li>
<li>Geometric plane can be calculated based on detected feature points.</li>
<li>A scene semantics <a href="/facts/API/GMlN4vUr">API</a> is used to gather real-time <a href="/facts/Semantic/1L4WwLAP">semantic</a> data about the user's surroundings and uses that data to identify objects and features in view.</li></ul>
<h3>Light estimation</h3>
<ul><li>Lighting Estimation API allows the phone to estimate the environment's current lighting conditions and display images accurately in relation to real-world lighting.
<ul><li>Lighting cues such as shadows and highlights are used to more immersively display virtual objects.<a class="footnote-ref" id="fnref:4" href="#fn:4"><sup>4</sup></a></li></ul></li></ul>
<h3>Depth analysis</h3>
<ul><li>Utilizes the phone's camera to create <a href="/facts/Depth_map/7SoCpoBX">depth maps</a>, which enable the device to more accurately determine the amount of space between surfaces based on what is captured.<a class="footnote-ref" id="fnref:5" href="#fn:5"><sup>5</sup></a>
<ul><li>In order to properly assess the real world, depth maps are created to measure the amount of space between objects or surfaces.</li>
<li>A depth-from-motion algorithm takes the motion data from the user's camera and utilizes it to create a more detailed depth map.<a class="footnote-ref" id="fnref:6" href="#fn:6"><sup>6</sup></a></li></ul></li></ul>
<h3>Geospatial capabilities</h3>
<ul><li>This function's API uses <a href="/facts/GPS/DKVLnzF3">GPS</a> and allows creators to give users unique experiences based on their real-world location.<a class="footnote-ref" id="fnref:7" href="#fn:7"><sup>7</sup></a>
<ul><li>Google's visual positioning system (VPS) is utilized for this process.</li></ul></li>
<li>Matches the user's visual data with that of <a href="/facts/Google_Maps/cKQ0jaFg">Google Maps</a> to determine precise location.</li></ul>
<h2 id="see-also">See also</h2>
<ul><li><a href="/facts/ARKit/6VeDuhR1">ARKit</a> – Augmented reality API for Apple platforms</li>
<li><a href="/facts/OpenXR/QqQIgBAe">OpenXR</a> – Standard for access to virtual reality and augmented reality platforms and devices</li></ul>

<h2 id="external-links">External links</h2>
<ul><li><a href="https://developers.google.com/ar/">Official website</a></li></ul>

<h2 id="references">References</h2>

<ol>
<li id="fn:1"><p>"ARCore supported devices". Google Inc. Retrieved 23 February 2020. <a href="https://developers.google.com/ar/discover/supported-devices" target="_blank">https://developers.google.com/ar/discover/supported-devices</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></p></li>
<li id="fn:2"><p>Amadeo, Ron (29 August 2017). "Google's ARCore brings augmented reality to millions of Android devices". Ars Technica. Condé Nast. Retrieved 6 November 2017. <a href="https://arstechnica.com/gadgets/2017/08/googles-arcore-brings-augmented-reality-to-millions-of-android-devices/" target="_blank">https://arstechnica.com/gadgets/2017/08/googles-arcore-brings-augmented-reality-to-millions-of-android-devices/</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></p></li>
<li id="fn:3"><p>"Fundamental Concepts". ARCore. Google Inc. Retrieved 22 February 2024. <a href="https://developers.google.com/ar/develop/fundamentals" target="_blank">https://developers.google.com/ar/develop/fundamentals</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></p></li>
<li id="fn:4"><p>"Get the Lighting Right". ARCore. Google Inc. Retrieved 22 February 2024. <a href="https://developers.google.com/ar/develop/lighting-estimation" target="_blank">https://developers.google.com/ar/develop/lighting-estimation</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></p></li>
<li id="fn:5"><p>"Fundamental Concepts". ARCore. Google Inc. Retrieved 22 February 2024. <a href="https://developers.google.com/ar/develop/fundamentals" target="_blank">https://developers.google.com/ar/develop/fundamentals</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></p></li>
<li id="fn:6"><p>"Depth Adds Realism". ARCore. Google Inc. Retrieved 22 February 2024. <a href="https://developers.google.com/ar/develop/depth" target="_blank">https://developers.google.com/ar/develop/depth</a> <a href="#fnref:6" class="footnote-back-ref">↩</a></p></li>
<li id="fn:7"><p>"Build global-scale, immersive, location-based AR experiences with the ARCore Geospatial API". ARCore. Google Inc. Retrieved 22 February 2024. <a href="https://developers.google.com/ar/develop/geospatial" target="_blank">https://developers.google.com/ar/develop/geospatial</a> <a href="#fnref:7" class="footnote-back-ref">↩</a></p></li>
</ol>

ARCore open-in-new

ARCore