Magento Expert Forum - Improve your Magento experience

Results 1 to 8 of 8

What is Crawling?

  1. #1

  2. #2
    Junior Member
    Join Date
    Jul 2019
    Posts
    17
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    Crawling (or spidering) is when Google or another search engine send a bot to a web page or web post and “read” the page

  3. #3
    Junior Member
    Join Date
    Jan 2018
    Location
    Bangalore
    Posts
    115
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    Crawling in SEO is the acquisition of data about a website. Crawling is a process by which search engines crawler/ spiders/bots scan a website and collect details about each page: titles, images, keywords, other linked pages, etc.

  4. #4
    Junior Member kajal's Avatar
    Join Date
    Sep 2014
    Location
    Bangalore
    Posts
    1,446
    Thanks
    0
    Thanked 20 Times in 20 Posts

    Default

    Hi Friends,
    The process of web crawling involves a set of website URLs that need to be visited, called seeds, and then the search engine crawler visits each web page and identifies all the hyperlinks on the page, adding them to the list of places to crawl.

    Dynamic Web Design Company Bangalore | Joomla Web Development Company Bangalore | Php Web Development Company Bangalore

  5. #5
    Junior Member
    Join Date
    Jul 2019
    Posts
    418
    Thanks
    0
    Thanked 1 Time in 1 Post

    Default

    Crawling is tracking and gathering URLs to prepare for indexing. By giving them a webpage as a starting point, they will trace all the valid links on those pages.

  6. #6
    Junior Member
    Join Date
    Sep 2019
    Location
    US
    Posts
    349
    Thanks
    4
    Thanked 2 Times in 2 Posts

    Default

    Crawling is tracking and gathering URLs to prepare for indexing. By giving them a webpage as a starting point, they will trace all the valid links on those pages.

  7. #7
    Junior Member
    Join Date
    Jun 2018
    Location
    surat
    Posts
    791
    Thanks
    0
    Thanked 6 Times in 6 Posts

    Default

    Crawling is tracking and gathering URLs to prepare for indexing. By giving them a webpage as a starting point, they will trace all the valid links on those pages.

  8. #8
    Junior Member
    Join Date
    Sep 2019
    Posts
    164
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    The process of web crawling involves a set of website URLs that need to be visited, called seeds, and then the search engine crawler visits each web page and identifies all the hyperlinks on the page, adding them to the list of places to crawl.

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •