Magento Expert Forum - Improve your Magento experience

Results 1 to 5 of 5

What are Spiders, Robots and Crawlers and what are their functions?

  1. #1

  2. #2
    Junior Member kajal's Avatar
    Join Date
    Sep 2014
    Location
    Bangalore
    Posts
    1,194
    Thanks
    0
    Thanked 14 Times in 14 Posts

    Default

    Spider - The browsers are like a program and to download the web page.

    Crawler – The program is automatically to follow the links are the web page.

    Robots - It had automated computer program can visit websites. It will guide by search engine algorithms.
    It can combine the tasks of crawler & spider helpful of the indexing the web pages and through the search engines.

  3. #3
    Junior Member
    Join Date
    May 2016
    Posts
    47
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    These terms are same. These terms used for search engine's crawlers. They are the automatic program which visits webpages by following links to another links.

  4. #4
    Junior Member
    Join Date
    Sep 2016
    Posts
    335
    Thanks
    0
    Thanked 2 Times in 2 Posts

    Default

    Spider - The browsers are like a program and to download the web page.
    Crawler – The program is automatically to follow the links are web page..
    Robots - It had automated computer program can visit websites. It will guided by search engine algorithms It can combine the tasks of crawler & spider helpful of the indexing the web pages and through the search engines.

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •