|
ou812 -> Crawling (2/27/2005 23:12:23)
|
A friend of mine has a very big homestyle webpage. It probably has well over 200 pages and 90 completely different subject areas of content on the different pages. He just started to get statistics (awstats) for his site for fun and has gotten crawled 1300 times by googlebot this month and 350 by msnbot, as well as many others.
His site, and many of the site's pages, have many other sites that link to his. He has a google search on his pages too. He gets about 5000 unique visitors a month. I also see he has had 2000 refered this month from Google. This isn't included in the bot, is it? He sells and advertises nothing. All the pages are pure information on the many different subjects.
I'm just curious, is this normal for google, msn, and other crawlers, to visit so often? This seems ridiculous to me. Why so much?
Any thoughts?
|
|
|
|
