Spider is the automatic programs in search engines that search the web from site to site, page by page, and word by word. They build up a massive index or database of all the words found, where they were found, how many times they appear on each page, and so on. It is this database that is actually queried when you type in a search term.
Definition