Robot
Also called: bot, spider or crawler
A robot, bot or spider is a program written specifically to search the worldwide Web. Often for the purpose of storing found pages and links in a database. Robots are used, for example, by search engines to discover new content on the Internet, or to populate a scraper site.
