Robots.txt is a text file that tells search engine crawlers which parts of a website they should or shouldn't access. Located at the root of a website (yoursite.com/robots.txt), this file...
Technical SEO Glossary
Terms starting with "R" in Technical SEO