1.

Why Is A Robots.txt File Used?

Answer»

A Robts.txt File is used to prevent the INDEXING of duplicate content on a website or for implementing a no FOLLOW rule in an area of a website. Martijn Koster invented this file in the early PART of the 90s – the file used more and more with the development well-known search engines as time progressed.

A Robts.txt File is used to prevent the indexing of duplicate content on a website or for implementing a no follow rule in an area of a website. Martijn Koster invented this file in the early part of the 90s – the file used more and more with the development well-known search engines as time progressed.



Discussion

No Comment Found