Crawling: Search engines coutumes automated programs called crawlers or spiders to navigate the web. These crawlers start by visiting a list of known web passage and following links nous-mêmes those pages to discover new ones.The crawlers download the ravi of the web écrit they visit and follow the links je those écrit, repeating the process to