Magento Expert Forum - Improve your Magento experience

Page 2 of 2 FirstFirst 12
Results 21 to 31 of 31

Which is better Robots.txt or Meta Robots Tag?

  1. #21
    Junior Member
    Join Date
    Feb 2016
    Posts
    42
    Thanks
    1
    Thanked 2 Times in 2 Posts

    Default

    In robot.txt you can block whole file but in meta robot you can only & only one web page block.

  2. #22
    New member
    Join Date
    Apr 2016
    Posts
    4
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    robot.txt is indispensable, while robot tag many less used

  3. #23
    Junior Member
    Join Date
    Apr 2016
    Posts
    116
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    robots.txt is better then robot tag. you should use robots.txt file in your website to block any web pages from any search engine.

  4. #24
    Junior Member
    Join Date
    Dec 2015
    Posts
    76
    Thanks
    2
    Thanked 9 Times in 8 Posts

    Default

    Both are equally playing similar role. I prefer to use robot.txt because it is easy to use.

  5. #25
    Junior Member
    Join Date
    Mar 2016
    Location
    Mumbai, India
    Posts
    61
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    Both Meta robot tag or Meta robots.txt file helps serves the common solution. The only difference is robots.txt is mentioned in the root of the domain, whereas robots tag is mentioned in each and every page of the wbesite.

  6. #26
    Junior Member
    Join Date
    Mar 2016
    Posts
    168
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    Robot.txt is much better.

  7. #27
    Junior Member
    Join Date
    Sep 2018
    Location
    Canada
    Posts
    873
    Thanks
    0
    Thanked 1 Time in 1 Post

    Default

    Meta Robots tag is much better as it helps in forcing the search engine crawlers not to index and display the hidden pages in your server. The Meta tag option tells bots not to index individual files, whereas Robots.txt can be used to restrict access to entire directories. Both are supported by all crawlers.
    Hoverboards|Electric bikesegway cart|hoverboard uk|Driving lessons Birmingham|Driving lessons in Birmingham|Birmingham driving lesson|Kids Scooter for Sale

  8. #28
    Junior Member
    Join Date
    Jul 2019
    Posts
    418
    Thanks
    0
    Thanked 1 Time in 1 Post

    Default

    Meta Robots tag is much better as it helps in forcing the search engine crawlers not to index and display the hidden pages in your server. The Meta tag option tells bots not to index individual files, whereas Robots.txt can be used to restrict access to entire directories. Both are supported by all crawlers

  9. #29
    Junior Member emmaalfie's Avatar
    Join Date
    Aug 2019
    Posts
    14
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    In my point of view Both are important. Robots.txt can be used to restrict access to entire directories while Meta robots tag helps in forcing the search engine crawlers not to index and display the hidden pages in your server. Both are supported by all crawlers.

  10. #30
    Junior Member
    Join Date
    Sep 2018
    Location
    Canada
    Posts
    873
    Thanks
    0
    Thanked 1 Time in 1 Post

    Default

    Using a meta robots tag also ensures that your link equity is not being lost, with the use of the 'follow' command. Robots.txt files are best for disallowing a whole section of a site, such as a category whereas a meta tag is more efficient at disallowing single files and pages.

Page 2 of 2 FirstFirst 12

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •