Magento Expert Forum - Improve your Magento experience
-
In robot.txt you can block whole file but in meta robot you can only & only one web page block.
-
-
robot.txt is indispensable, while robot tag many less used
-
-
robots.txt is better then robot tag. you should use robots.txt file in your website to block any web pages from any search engine.
-
-
Both are equally playing similar role. I prefer to use robot.txt because it is easy to use.
-
-
Both Meta robot tag or Meta robots.txt file helps serves the common solution. The only difference is robots.txt is mentioned in the root of the domain, whereas robots tag is mentioned in each and every page of the wbesite.
-
-
Robot.txt is much better.
-
-
Meta Robots tag is much better as it helps in forcing the search engine crawlers not to index and display the hidden pages in your server. The Meta tag option tells bots not to index individual files, whereas Robots.txt can be used to restrict access to entire directories. Both are supported by all crawlers.
Hoverboards|Electric bikesegway cart|hoverboard uk|Driving lessons Birmingham|Driving lessons in Birmingham|Birmingham driving lesson|Kids Scooter for Sale
-
-
Meta Robots tag is much better as it helps in forcing the search engine crawlers not to index and display the hidden pages in your server. The Meta tag option tells bots not to index individual files, whereas Robots.txt can be used to restrict access to entire directories. Both are supported by all crawlers
-
-
Junior Member
In my point of view Both are important. Robots.txt can be used to restrict access to entire directories while Meta robots tag helps in forcing the search engine crawlers not to index and display the hidden pages in your server. Both are supported by all crawlers.
-
-
Using a meta robots tag also ensures that your link equity is not being lost, with the use of the 'follow' command. Robots.txt files are best for disallowing a whole section of a site, such as a category whereas a meta tag is more efficient at disallowing single files and pages.
-
Tags for this Thread
Posting Permissions
- You may not post new threads
- You may not post replies
- You may not post attachments
- You may not edit your posts
-
Forum Rules
Bookmarks