View Full Version : Web Crawlers
dougspaulding
11-14-2005, 10:38 PM
What in the heck is a Slurp Spider, and what is its purpose? I see it crawling around the site every evening late. Makes me feel like getting some insecticide or something.
Forgive me - computer illiterate.
Zombie-F
11-15-2005, 05:44 AM
A Spider is a search engine's tool for indexing web pages. The spider "crawls" to each page on the forums and adds it to the search engine. Then, when someone does a search with certain keywords found in the page that was indexed by the spider, it comes back to that person's search results.
There's also a Google Spider... watch out for him. He has really large fangs and poisonous venom.
dougspaulding
11-15-2005, 10:26 AM
I've heard of those Googlebots - shiver!
Thanks for the explanation.
Dr Morbius
11-15-2005, 10:53 AM
What in the heck is a Slurp Spider, and what is its purpose? I see it crawling around the site every evening late. Makes me feel like getting some insecticide or something.
Forgive me - computer illiterate.
What do you mean, you "see it?"
dougspaulding
11-15-2005, 11:52 AM
I see it here:
http://www.unpleasantstreet.com/forums/online.php
Either that, or I'm seeing spiders in my dreams - not a pleasant thought!
vBulletin® v3.8.7, Copyright ©2000-2012, vBulletin Solutions, Inc.