To begin with, site owners submitted the handle of a site, or URL to the different search engines, which might mail an online crawler to crawl that page, extract backlinks to other webpages from it, and return details identified over the site to be indexed.[5] txt file is then parsed https://www.youtube.com/watch?v=XcL519f9jd0