Magento Expert Forum - Improve your Magento experience

Results 1 to 4 of 4

web crawler

  1. #1

  2. #2
    Junior Member kajal's Avatar
    Join Date
    Sep 2014
    Location
    Bangalore
    Posts
    1,079
    Thanks
    0
    Thanked 15 Times in 15 Posts

    Default

    Hi Friends,
    Googlebot is the name of Google's web crawler. A web crawler is an automated program that systematically browses the Internet for new web pages. This is called web-indexing or web-spidering. Google and other search engines use web crawlers to update their search indexes.

  3. #3
    Junior Member
    Join Date
    Feb 2015
    Posts
    218
    Thanks
    0
    Thanked 2 Times in 2 Posts

    Default

    A Web crawler is an Internet bot which helps in Web indexing. They crawl one page at a time through a website until all pages have been indexed. Web crawlers help in collecting information about a website and the links related to them, and also help in validating the HTML code and hyperlinks.

  4. #4
    Junior Member
    Join Date
    Jul 2018
    Posts
    287
    Thanks
    4
    Thanked 0 Times in 0 Posts

    Default

    Googlebot is the name of Google's web crawler. A web crawler is an automated program that systematically browses the Internet for new web pages. This is called web-indexing or web-spidering. Google and other search engines use web crawlers to update their search indexes.

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •