Crawlers, bots and spiders are those critters that come along when you least expect or you can’t wait ’til they show up uninvited. Once they come and visit and check out your goods they will make a note and come back.
You can identify the bots by looking in your web logs and will discover that the big 3 are:
Google – Googlebot
Yahoo – Yahoo Slurp
Bing – MSNbot (wondering if they’ll change that soon, like Bingbot)
