Hi,
My question is, Is it necessary to use Robots.txt?
Printable View
Hi,
My question is, Is it necessary to use Robots.txt?
It is not important use robots. txt file but it is advisable to use it, if there is any page on your websites which you don't want search engine to crawl. Robots.txt also improves better indexing for the website.
If You know please tell me
Thanks for sharing this information.
to control the google bot.. you should use the robotx.txt file
it is not compulsory but it is very use full for web site .
Iis is essential.
Not exactly ... but yes robots.txt will makes SEO more meaningful as you will control crawling and indexing of your website through google.
No, robots.txt file is not compulsory. If you want to hide or block any content or page on website then you must have to use robot.txt.file.