PDA

View Full Version : Admin question 2 for Kurt

Moondance
08-04-2005, 10:25 PM
Kurt, I have noticed in the "Who's Online" link, in addition to 89 members and 139 guests, there are usually several Google spiders, typically reviewing archives.

What is the story there, and do you (or should members) care about Google or other spiders "lurking"?

I'm a curious newbie who maintains that: "Just because you're paranoid, it doesn't mean they're not out to get you." :biggrin:

Moondance
kurt
08-04-2005, 10:34 PM
:floor: Skeerd of spiders?


Spiders are search engine "bots" that follow all the links ("spider") on a web site in order to catalog content. We like spiders. :cool:
Moondance
08-04-2005, 10:38 PM
Only space spiders... :eek:

Thanks for the info. :biggrin:

Moondance
kurt
08-04-2005, 10:47 PM
http://a52.g.akamaitech.net/f/52/827/1d/www.space.com/images/hf_mars_spiderbot_01.jpg


http://www.space.com/businesstechnology/technology/spider_bot_030129.html

Engineer Robert Hoggs spider sense is tingling, but hes no superhero. His spider sense comes from an insect-like robot with a leg up on its wheeled counterparts because it walks instead of rolls.

The spider-bot, developed by Hogg and his team of researchers at NASAs Jet Propulsion Laboratory (JPL), is the latest affordable addition to the agency's robot family. Its legs step over obstacles, clamber up rocks and reach areas of interest that would normally be inaccessible to wheeled rovers that run on flatter paths.
kurt
08-04-2005, 10:48 PM
Spider Bot

A spider or bot is a customizable computer program that crawls around the Web indexing Web pages and or links in those pages. Also called a crawler.

The spider indexes specific information from each web page that it visits. Many web sites get listed in the search engines when spiders visit their sites and index them to their web catalog. An example of an industrial strength spider is Google’s Googlebot. AltaVista’s spider is called Scooter.
Moondance
08-05-2005, 12:10 AM
OK, then I'm only skeered ;-) of cyberbots, since they likely are "an insect-like robot with a leg up on its wheeled counterparts because it walks instead of rolls."

I'm just sayin'... Thanks for the info. :clap_1:
OhioBeachBum
08-05-2005, 08:43 AM
:floor: Skeerd of spiders?

Spiders are search engine "bots" that follow all the links ("spider") on a web site in order to catalog content. We like spiders. :cool:
just don't like spiders in the lounge, right? :biggrin:
OhioBeachBum
08-05-2005, 08:45 AM
I'm a curious newbie who maintains that: "Just because you're paranoid, it doesn't mean they're not out to get you." :biggrin:
Moondance
Don't worry about google - whatever you sent across the net was already sifted by some NSA super computer farm long before any google spide got to it :shock:
RiverOtter
08-05-2005, 08:49 AM
Kurt, I have noticed in the "Who's Online" link, in addition to 89 members and 139 guests, there are usually several Google spiders, typically reviewing archives.


How can you see this?
OhioBeachBum
08-05-2005, 08:50 AM
How can you see this?
Quick Links pull-down menu?
RiverOtter
08-05-2005, 09:08 AM
Quick Links pull-down menu?

But how do you know they are Google Spiders?
Miss Kitty
08-05-2005, 09:14 AM
Quick Links pull-down menu?


BIG BROTHER is watching us!!!!!!!!!! Actually, everyone is watching us and they know what we do....be careful out there!
OhioBeachBum
08-05-2005, 09:22 AM
But how do you know they are Google Spiders?
I haven't seen that (a spider tagged as such in the list), but I expect kurt has something set to tag them as distinct from "regular" guests. A web server can ident quite a bit about any client, including their IP address. Also I believe search engine spidies identify themselves as such in a block of data called the HTTP request header (RFC 2616 in case you're into heavy reading: http://rfc.sunsite.dk/rfc/rfc2616.html).