What is Crawler?

A search engine bot that navigates the web to discover and process pages for indexing and showing them in the search results.