hi friends,
What is a robots.txt file?
Printable View
hi friends,
What is a robots.txt file?
Robots.txt is a text file that is inserted into your website and contains information for search engine robots. The file lists webpages that are allowed and disallowed from search engine crawling.
Robots.txt is txt file. which helps to handle the pages, we can tells us to google which pages index or not. read more about robots.txt read this https://support.google.com/webmaster.../6062608?hl=enQuote:
Originally Posted by orientation
Robots.txt is a text file you put on your site to tell search robots which pages you would like them not to visit.
Thanks for sharing this information.
It is a essential for a website. It contains instructions for crawlers.