google bots wont leave (Full Version)

All Forums >> [Web Development] >> Search Engine Optimization and Web Business



Message

J-man -> google bots wont leave (6/5/2005 1:43:11)

Hi created a new site and 1 year later the google climb is ending, since i've been bumped into 6th place..ive notice ever since then that the date beside the listing has stayed for at least 4 maybe 5 days, ... is this good and should i be including somethnig the robot root file?
also from a marketing standpoint is third place the best poition to be in?



Mojo -> RE: google bots wont leave (6/5/2005 22:37:38)

I woudn't worry about the date.

No, third place is not the best. In study after study and also with my own many positions - #1 is the best place to be.

It is interesting in that some research has shown it is better to be #11 than #8, 9 or 10. #11 is at the top of the second page. Again, it *looks* like another #1 - to some eyes.



dpf -> RE: google bots wont leave (6/6/2005 8:10:36)

the #11 almost makes good intuitive sense... as you move down page one without satisfaction, you get weary/discouraged - clicking for a new page is like "spring" (lol ) hope springs eternal



Mojo -> RE: google bots wont leave (6/6/2005 9:50:52)

quote:

clicking for a new page is like "spring" (lol ) hope springs eternal

:) Exactly. Clicking to another page gives you a fresh group of winners.



J-man -> RE: google bots wont leave (6/14/2005 23:08:28)

Ok, i know enough to know something's weird... casue the timestamp in my google listing is still there from the original post, i check it every day on 4 different computers over 4 different ip addresses, and i know this is not a cache issue of sorts,

I originally posted 6/5/2005 1:43:11 and then it was around 4 days ealier so that makes a total of
14 days with my listing having a time beside it... I wonder if i trapped a bot ?




BobbyDouglas -> RE: google bots wont leave (6/15/2005 3:57:35)

Well, if the Google bots won't leave your page, you can always redirect them to mine- I won't complain [8D]



Taz -> RE: google bots wont leave (6/15/2005 4:14:48)

quote:

ORIGINAL: J-man

I wonder if i trapped a bot ?


Send Google a ransom note and see what they say. ;)



Reflect -> RE: google bots wont leave (6/15/2005 15:09:29)

Dear Google,

We have your bot named Googlebot. We will be sending a picture of it with todays newspaper as poof.

We demand:

No more sandbox penalties
explanations to your algos past and future
guaranteed permanent ranking for sites of our choice present and future
PR of 11
No more redirects in the SERPS stealing our sites
Unlimited AdWord funds

Unless our demands are met we will turn your bot loose in the pornogrpahy neighborhood on the web. We will make sure its mind is permanently demented.

You have 24 hours to respond, it's your choice.

Thank you,

MSN



Taz -> RE: google bots wont leave (6/15/2005 20:06:03)

[:)]



J-man -> RE: google bots wont leave (6/16/2005 1:53:36)

Timestamp still listed, todays the 16th and its currently show on the listing:
...5k - 14 Jun 2005

Here in case someone is interested i search the site's stats for browser tags that have google in them and this is what i found for the week so far:
History for: Googlebot/2.1 ( http://www.google.com/bot.html)

Date and Time Total
Thu Jun 16th, 2005 0
Wed Jun 15th, 2005 2
Tue Jun 14th, 2005 4
Mon Jun 13rd, 2005 2
Sun Jun 12nd, 2005 1
Total 9
Average 1.80

////////////////////////////

History for: Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)

Date and Time Total
Thu Jun 16th, 2005 0
Wed Jun 15th, 2005 1
Tue Jun 14th, 2005 1
Mon Jun 13rd, 2005 0
Sun Jun 12nd, 2005 1
Total 3
Average 0.60

/////////////////////////////

History for: Mediapartners-Google/2.1

Date and Time Total
Thu Jun 16th, 2005 0
Wed Jun 15th, 2005 0
Tue Jun 14th, 2005 0
Mon Jun 13rd, 2005 0
Sun Jun 12nd, 2005 1
Total 1
Average 0.20

.....................................
also searching thru the sessions by net identity stats i found these, for the same time period above:

66.249.65.232 crawl-66-249-65-232.googlebot.com
66.249.71.1 crawl-66-249-71-1.googlebot.com
66.249.71.13 crawl-66-249-71-13.googlebot.com
66.249.71.42 crawl-66-249-71-42.googlebot.com
66.249.66.134 crawl-66-249-66-134.googlebot.com
66.249.71.72 crawl-66-249-71-72.googlebot.com
66.249.71.70 crawl-66-249-71-70.googlebot.com
66.249.64.7 crawl-66-249-64-7.googlebot.com
66.249.66.232 crawl-66-249-66-232.googlebot.com
66.249.71.69 crawl-66-249-71-69.googlebot.com
66.249.71.14 crawl-66-249-71-14.googlebot.com



J-man -> RE: google bots wont leave (6/22/2005 1:29:34)

still.. happening

saw the date change to 19 then to where it is now: ...com/ - 5k - 20 Jun 2005 - Cached - Similar pages

Note sure how long its been..

but the bot is still displaying, actualy many google ips are repeating, no new ips ,no ips that wernt.

Everything is constant and the google ranking has not improved. but the listings under me have changed, hmmm... am i part of a ripple effect with a bot net in my hands...

Dear Googlier,
I hope this does not seem offending, but your request are always sent my way. I could add a new page into each major search engine... hmmm guess i prob wait 3-4 months to see what that does...

when will the time stamp leave?



J-man -> RE: google bots wont leave (6/22/2005 1:34:54)

BobbyDouglas, does your site have good stats?

i would like to try to transfer a repetive bot request to another ip. I think i can simply accomplish this by
assuming... hmmm... :http://www.google.com/robots.txt



BobbyDouglas -> RE: google bots wont leave (6/22/2005 3:58:22)

You can use .htaccess I believe to tell a certain bot to go somewhere else.....

Post your question here: http://www.webmasterworld.com/forum92/

"How do I tell the Googlebot to redirect to a different IP or domain name?"

Doing this will cause a decrease in your PR w/ Google, and they might end up dropping you.



J-man -> RE: google bots wont leave (6/22/2005 17:09:33)

As an experiment i would like to send the bot to you to see what happens, but first i need to know if you have the ability to view stats on the site to see if the bot ip actually goes there and for you to transfer it back, the experiment could be called bot sharing - send a site a bot on its off indexing days to see if a time stamp appears, and to help increase indexing.
I wonder if there are any articles on this?....

let me know



BobbyDouglas -> RE: google bots wont leave (6/22/2005 18:24:12)

Let's see if Joe/Brian pickup this thread. They should be able to give an answer as to if this will even help.



J-man -> RE: google bots wont leave (6/24/2005 13:58:24)

still have a time stamp, but now the date has changed again, also i have moved up 2 places in the listing, current timestamp: 5k - 22 Jun 2005 - Cached - Similar pages



J-man -> RE: google bots wont leave (6/29/2005 11:20:41)

well this morning the bots left. June 29th the time stamp is currently gone this morning.

In total the bot crawled since 1/6/2005 - 29/6/2005

that 28 days of 5 particular google bots constantly crawling the site, each more that once a day.

All that to move up 2 places, geesh!



Reflect -> RE: google bots wont leave (6/29/2005 15:09:48)

quote:

As an experiment i would like to send the bot to you to see what happens, but first i need to know if you have the ability to view stats on the site to see if the bot ip actually goes there


I'm game if you still want to try this at a later date if it happens again.

I would even generate a HTML report on the IPs of the bot to send off to you so you may study my sites results with the bot.

Take care,

Brian



J-man -> RE: google bots wont leave (7/1/2005 3:36:22)

What do you know, they are back! But under different search terms[&:] caught wind from viewing stats[;)]I guess its ready to go.[8D] but how does this begin? Happen to have an example of htaccess for certain bot control?

-email_me How do you propose we go about this?



Reflect -> RE: google bots wont leave (7/1/2005 10:09:06)

Researching on my end on how to go about this.

Take care,

Brian



BobbyDouglas -> RE: google bots wont leave (7/1/2005 11:09:48)

Hehe, looks like they found the thread and are now playing with your head!



lu lu -> RE: google bots wont leave (7/6/2005 11:41:13)

If you create the code can you display it here, i think it would be helpful

cheers



J-man -> RE: google bots wont leave (7/6/2005 11:55:35)

Brian, am working on some code, should have something for tommorrow will post it



J-man -> RE: google bots wont leave (7/7/2005 10:50:16)

hmm... maybe something like this at the top of the home page...not completely sure haven't tested it.. any thoughts on this 

if (preg_match("#(google)#si", $_SERVER['HTTP_USER_AGENT'])) { 

    header("Location: http://www.new-location.com/"); 
    exit; 
}





BobbyDouglas -> RE: google bots wont leave (7/7/2005 12:45:26)

I would use .htaccess, so it does it for every page.



J-man -> RE: google bots wont leave (7/8/2005 1:21:20)

Hey arn't we in a frontpage extension forum?[&:] curption may be at hand casue site uses extensions, and i don't really care to edit into a custom file





Page: [1]

Valid CSS!




Forum Software © ASPPlayground.NET Advanced Edition 2.4.5 ANSI
0.1396484