|
Richard Knight -> Web logs....very strange....! (6/10/2002 14:56:18)
|
I am completly puzzled and could relly do with some help and inspiration on this one!
I have a custom error 404 page (www.marsbrookboating.com/scripts/sorry.htm) which is served up as necessary. It may be something I've done incorrectly with this but if so, I can't see where.
Most days I get a number of page views from web robots seemingly arbitrarily putting together directory names ending with a file name which whilst all in exhistance, bear no relation to the structure of the site. As a result the error page gets served up. Yesterday I had 4,251 on these errors!
Here's an example of what I see in my log file:
404;http://www.marsbrookboating.com/CharterGuide/newsletter/newsletter/YachtCharter/sailtraining/AdventureCruises/cruises.htm 200 23509 308 Mozilla/4.0_(compatible;_MSIE_5.0;_Windows_95)_VoilaBot/1.6+libwww/5.3.2 - -
2002-06-09 13:40:32 195.101.94.209 - 66.46.105.13 80 GET /scripts/sorry.htm
Lately, it's been VoilaBot in particular which is hitting me - I get no such problems from Google though.
I have considered changing the error page for something extremely simple to help identify if this is the problem, hoowever, before I do this can anyone shed any light on this extemely annoying problem!
Thanks people.
Richard
|
|
|
|
