Menu
Home
People
Places
Arts
History
Plants & Animals
Science
Life & Culture
Technology
Reference.org
Pose (computer vision)
open-in-new
<h2 id="pose-estimation">Pose estimation</h2> <p class="note">Main article: <a href="/facts/3D_pose_estimation/8tB2SEy9">3D pose estimation</a></p> <p>The specific task of determining the pose of an object in an image (or stereo images, image sequence) is referred to as <i>pose estimation</i>. Pose estimation problems can be solved in different ways depending on the image sensor configuration, and choice of methodology. Three classes of methodologies can be distinguished: </p> <ul><li>Analytic or geometric methods: Given that the image sensor (camera) is calibrated and the mapping from 3D points in the scene and 2D points in the image is known. If also the geometry of the object is known, it means that the projected image of the object on the camera image is a well-known function of the object's pose. Once a set of control points on the object, typically corners or other feature points, has been identified, it is then possible to solve the pose transformation from a set of equations which relate the 3D coordinates of the points with their 2D image coordinates. Algorithms that determine the pose of a <a href="/facts/Point_cloud/dN8eG4AU">point cloud</a> with respect to another point cloud are known as <a href="/facts/Point_set_registration/EevAmm50">point set registration</a> algorithms, if the correspondences between points are not already known.</li> <li><a href="/facts/Genetic_algorithm/WP2AFWuW">Genetic algorithm</a> methods: If the pose of an object does not have to be computed in real-time a <a href="/facts/Genetic_algorithm/WP2AFWuW">genetic algorithm</a> may be used. This approach is robust especially when the images are not perfectly calibrated. In this particular case, the pose represent the <a href="/facts/Genetic_representation/Ph0A2E0R">genetic representation</a> and the error between the projection of the object control points with the image is the <a href="/facts/Fitness_function/Xeoc1I3C">fitness function</a>.</li> <li>Learning-based methods: These methods use artificial learning-based system which learn the mapping from 2D image features to pose transformation. In short, this means that a sufficiently large set of images of the object, in different poses, must be presented to the system during a learning phase. Once the learning phase is completed, the system should be able to present an estimate of the object's pose given an image of the object.</li></ul> <h2 id="camera-pose">Camera pose</h2> <p class="note">This section is an excerpt from <a href="/facts/Camera_resectioning/2KDqh2Wu">Camera resectioning</a>.[<a href="https://en.wikipedia.org/w/index.php?title=Camera_resectioning&action=edit">edit</a>]</p> <p><a href="/facts/Camera_resectioning/2KDqh2Wu">Camera resectioning</a> is the process of estimating the parameters of a <a href="/facts/Pinhole_camera_model/Y0Jn9P9s">pinhole camera model</a> approximating the camera that produced a given photograph or video; it determines which incoming <a href="/facts/Light_ray/PgUEC7Sm">light ray</a> is associated with each pixel on the resulting image. Basically, the process determines the <a href="/facts/Pose_(computing)/APuxJEKM">pose</a> of the pinhole camera. </p><p>Usually, the camera parameters are represented in a 3 × 4 <a href="/facts/Projection_matrix_(computer_graphics)/FATfGH2W">projection matrix</a> called the <i><a href="/facts/Camera_matrix/fXos7y5s">camera matrix</a></i>. The extrinsic parameters define the camera <i>pose</i> (position and orientation) while the intrinsic parameters specify the camera image format (focal length, pixel size, and image origin). </p><p>This process is often called geometric camera calibration or simply camera calibration, although that term may also refer to <a href="/facts/Photometric_camera_calibration/sPgHLPKY">photometric camera calibration</a> or be restricted for the estimation of the intrinsic parameters only. Exterior orientation and interior orientation refer to the determination of only the extrinsic and intrinsic parameters, respectively. </p><p>The classic camera calibration requires special objects in the scene, which is not required in <i><a href="/facts/Camera_auto-calibration/qFWP9Mfw">camera auto-calibration</a></i>. </p> Camera resectioning is often used in the application of <a href="/facts/Stereo_vision/AL5Ydh0m">stereo vision</a> where the camera projection matrices of two cameras are used to calculate the 3D world coordinates of a point viewed by both cameras. <h2 id="see-also">See also</h2> <ul><li><a href="/facts/Gesture_recognition/jly3YdnY">Gesture recognition</a></li> <li><a href="/facts/Homography_(computer_vision)/hE8Pc5Dx">Homography (computer vision)</a></li> <li><a href="/facts/Camera_resectioning/2KDqh2Wu">Camera calibration</a></li> <li><a href="/facts/Structure_from_motion/swh21JgG">Structure from motion</a></li> <li><a href="/facts/Essential_matrix/h5HQcuoh">Essential matrix</a> and <a href="/facts/Trifocal_tensor/7quA7kMY">Trifocal tensor</a> (relative pose)</li></ul> <h2 id="references">References</h2> <ol> <li id="fn:1"><p>Hoff, William A.; Nguyen, Khoi; Lyon, Torsten (1996-10-29). Casasent, David P. (ed.). "Computer-vision-based registration techniques for augmented reality". Intelligent Robots and Computer Vision XV: Algorithms, Techniques, Active Vision, and Materials Handling. 2904. SPIE: 538–548. Bibcode:1996SPIE.2904..538H. doi:10.1117/12.256311. S2CID 6587175. <a href="https://www.spiedigitallibrary.org/conference-proceedings-of-spie/2904/0000/Computer-vision-based-registration-techniques-for-augmented-reality/10.1117/12.256311.full" target="_blank">https://www.spiedigitallibrary.org/conference-proceedings-of-spie/2904/0000/Computer-vision-based-registration-techniques-for-augmented-reality/10.1117/12.256311.full</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></p></li> <li id="fn:2"><p>"Pose (Position and Orientation)". <a href="https://digitalrune.github.io/DigitalRune-Documentation/html/d995ee69-0650-4993-babd-1cdb1fd8fd7a.htm" target="_blank">https://digitalrune.github.io/DigitalRune-Documentation/html/d995ee69-0650-4993-babd-1cdb1fd8fd7a.htm</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></p></li> <li id="fn:3"><p>"Transformation matrices to geometry_msgs/Pose - ROS Answers: Open Source Q&A Forum". 27 May 2021. <a href="https://answers.ros.org/question/379109/transformation-matrices-to-geometry_msgspose/" target="_blank">https://answers.ros.org/question/379109/transformation-matrices-to-geometry_msgspose/</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></p></li> <li id="fn:4"><p>"Drake: Spatial Pose and Transform". <a href="https://drake.mit.edu/doxygen_cxx/group__multibody__spatial__pose.html" target="_blank">https://drake.mit.edu/doxygen_cxx/group__multibody__spatial__pose.html</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></p></li> <li id="fn:5"><p>"Apple Developer Documentation". <a href="https://developer.apple.com/documentation/realitykit/transform" target="_blank">https://developer.apple.com/documentation/realitykit/transform</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></p></li> </ol>