What are robots.txt file?

1.	What are robots.txt file?
Answer» The robots.txt FILE is the TEXT file which tells the SEARCH ENGINES which page on your website to crawl. This is most popular SEO interview questions Example It Allow all web crawlers ACCESS to all content User-agent: * Disallow:

Answer»

The robots.txt FILE is the TEXT file which tells the SEARCH ENGINES which page on your website to crawl.

This is most popular SEO interview questions

Example

It Allow all web crawlers ACCESS to all content

User-agent: *

Disallow:

Discussion