Robots.txt

A small text file included on a website that directs search engines to include/exclude specific pages from being included in the index.

« Back to Glossary Index