digg

Facebook Connect Join Digg About

Today's Google Bots and What They Do

sitepronews.com — Google uses a number of spiders to crawl the Web. You can catch these spiders by examining your log files. This article will reveal some of the most important Google spiders, their function, and how they affect you as a web master.

Who dugg this?

Digg DudeWhat is Digg?

Digg is a place for people to discover and share content from anywhere on the web. Digg surfaces the best stuff as submitted and voted on by the community. Take the Tour to learn more.

5 Comments

show profanity settings
expand all
  • matthewhall, on 10/12/2007, -0/+1Great little guide to GoogleBots.
  • bestempire, on 10/12/2007, -0/+0great article, thanks a ton
  • Baccillus, on 10/12/2007, -0/+0love this great article too. very well written and easy to understand.
  • stanchee, on 10/12/2007, -0/+0I love this great article--very well written and easy to understand.
    Keep more coming Kim ! Will look out for your next.
  • prk60091, on 10/12/2007, -1/+0googles three laws: 1. a bot may not allow content to go without indexing or or, through inaction, allow content to go without indexing. 2. a bot must obey the orders given to it by advertisers except where such orders would conflict with the First Law. 3 a bot must protect its own existence, as long as such protection does not conflict with the First or Second Law or do evil.

  • Add a Comment

    Login or register to comment!
    Or, sign-in super fast with your Facebook account ...


© Digg Inc. 2009 — Content created and posted by Digg users is dedicated to the public domain | Terms of Use Updated | Privacy Policy
DIGG, DIGG IT, DUGG, DIGG THIS, Digg graphics, logos, designs, page headers, button icons, scripts, and other service names are the trademarks of Digg Inc.