What is Robots.txt?

< 1 min read

A file that tells search engines which pages on your site to crawl or ignore.

Scroll to Top