InterviewSolution
| 1. |
Why Is A Robots.txt File Used? |
|
Answer» A Robts.txt File is used to prevent the INDEXING of duplicate content on a website or for implementing a no FOLLOW rule in an area of a website. Martijn Koster invented this file in the early PART of the 90s – the file used more and more with the development well-known search engines as time progressed. A Robts.txt File is used to prevent the indexing of duplicate content on a website or for implementing a no follow rule in an area of a website. Martijn Koster invented this file in the early part of the 90s – the file used more and more with the development well-known search engines as time progressed. |
|