Menu
Home
People
Places
Arts
History
Plants & Animals
Science
Life & Culture
Technology
Reference.org
Search engine scraping
open-in-new
<p>Search engine scraping is the process of harvesting <a href="/facts/URL/pPD5g7Wq">URLs</a>, descriptions, or other information from <a href="/facts/Search_engine/SRntsbz2">search engines</a>. This is a specific form of <a href="/facts/Screen_scraping/8zLlaECG">screen scraping</a> or <a href="/facts/Web_scraping/5R4mf1bd">web scraping</a> dedicated to search engines only. </p><p>Most commonly larger <a href="/facts/Search_engine_optimization/RNzIbb62">search engine optimization</a> (SEO) providers depend on regularly scraping keywords from search engines to monitor the competitive position of their customers' websites for relevant keywords or their <a href="/facts/Search_engine_indexing/a0anbq3D">indexing</a> status. </p><p>The process of entering a website and extracting data in an automated fashion is also often called "<a href="/facts/Web_crawler/ra7D1xyb">crawling</a>". Search engines get almost all their data from automated crawling bots. </p>