What is a Web crawler and how does it work?

hi

What is a Web crawler and how does it work?

A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index. The major search engines on the Web all have such a program, which is also known as a "spider" or a "bot."

Hi Friends,
A web crawler (also known as a web spider or web robot) is a program or automated script which browses the World Wide Web in a methodical, automated manner. This process is called Web crawling or spidering. Many legitimate sites, in particular search engines, use spidering as a means of providing up-to-date data.

A Web Crawler is a program which is used by a search engine to find what is new on the Internet (website). This process is called Crawling.