Which are the major robots? - Knowledge Base Answers - The Kolberg Partnership UK
Knowledge Base

Which are the major robots?

The following table displays the main search engine robots belonging to some of the best known search engines. You can see which robots are visiting your website by reviewing your log files, the user agent field is the best way to identify the robots.

Spider Belongs to
GoogleBot Google
TeomaAgent Teoma
Zyborg Wisenut
Gulliver NorthernLight
Architext Excite
FAST-WebCrawler FAST
Slurp Inktomi
Ask Jeeves Ask Jeeves
ia_archiver Alexa
Scooter AltaVista
InfoSeek sidewinder InfoSeek
Lycos_Spider_(T-Rex) Lycos
T-H-U-N-D-E-R-S-T-O-N-E Thunderstone
WebCrawler WebCrawler


Back to the Knowledge Base

 

Related Information

  Search engine optimisation

Search engine optimisation can be a cost effective way of driving more traffic to your website. Search Engine Optimisation


  Pay per click management

Kolberg can offer a range of pay per click services that can put your website at the top of some of the most popular search engines. Pay Per Click Management


  Pay for inclusion

Pay for inclusion is the easiest way into some of the major search engines Paid Inclusion Strategies


  Authority development

Generate more qualified traffic by turning your website into an industry authority. Authority Development