Magento Expert Forum - Improve your Magento experience

Results 1 to 2 of 2

How to Configure Robots.txt and Meta Robots for Magento 2

  1. #1
    Junior Member
    Join Date
    Dec 2017
    Location
    Bhavnagar
    Posts
    681
    Thanks
    0
    Thanked 2 Times in 2 Posts

    Default How to Configure Robots.txt and Meta Robots for Magento 2

    Robots.txt is a text file that instructs the web robots, i.e., search engines which pages to crawl and which not! Meta robots are a way for webmasters to offer search engines with details about their stores.

    Name:  How to Configure Robots.txt and Meta Robots for Magento 2-Social Share.png
Views: 2103
Size:  27.9 KB


    Read about:

    1. Importance of Robots.txt file in Magento 2

    2. Steps to create Magento 2 Robots.txt

    3. Meta robots tags

    4. The recommended default settings for meta robots tags

    5. Magento 2 robots.txt file examples

    6. Common Web crawlersVisit

    How to Configure Robots.txt and Meta Robots for Magento 2

    View more threads in the same category:


  2. #2
    Junior Member
    Join Date
    Sep 2018
    Location
    Oman, Muscat
    Posts
    2,084
    Thanks
    0
    Thanked 4 Times in 4 Posts

    Default

    Following strides to Configure robots.txt in Magento 2

    1. On the Admin board, click Stores . In the Settings segment, select Configuration .

    2. Select Design under General in the board on the left.

    3. Open the Search Engine Robots segment, and proceed with following: ...

    3. Whenever complete, click Save Config .

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •