Anti-spam, anti-spider codes? (Full Version)

All Forums >> [Web Development] >> General Web Development



Message


MonZaTino -> Anti-spam, anti-spider codes? (9/24/2002 12:59:52)

Our website literally has hundreds of e-mails listed throughout it.

Does anyone know of a script or code that I can use to prevent e-mail harvesters/spiders from using our site for their spam? It' s causing my advertisers to get uppity!




Richard Dudley -> RE: Anti-spam, anti-spider codes? (9/24/2002 14:04:30)

There are all sorts of ones out there, but they' re only as good as the spambots are dumb (which means even many of these will cease to work one day).

The only foolproff way is to have people submit a form, and have a back-end script send the message. Another way is to have a small graphic that looks like a text link actuate a script that creates a new mail message. In the absence of that, here are a few colled from recent editions of the bCentral Daily Digest:

1) e-mail cloak http://www.email-cloak.com/default.asp
2) Clean My Mailbox: http://www.cleanmymailbox.com/free.html
3) Disguise your e-mail links: http://www.colmgallagher.com/encode_all.html
4) Spamlib.pl, PERL scripts: http://www.phaget4.org/seidel/CodeMonkey/spamlib.html

Other options discussed were:

Mailwasher, a utility to scrub your messages before you download them. Available at http://www.mailwasher.net/

Bounce Spam Mail, which sends back a fake bounce message, at http://www.pcworld.com/downloads/file_description/0,fid,5402,00.asp

quote:

Create a contact page with all your email addresses coded
normally *and* create a file called robots.txt in the root
directory of your site which contains the lines:

User-agent: *
Disallow: /contacts.htm

This tells automated programs (such as search engine crawlers) to
ignore that page. Email harvesters respect it too, because if they
don' t, they get flooded by fake emails on sites set up by people
who really hate spammers. (Peter Lapinskas, Daily #1414)


and

quote:


However, if you don' t need total protection, just replace some or
all of the characters in the address with the equivalent HTML
character code.

Thus,

myname@nospamplease.com

could become

myname@nospamplease.com

I use this latter technique on my own site and it has been enough
to stop 95% of the spam, yet there is no observable difference for
your visitors -- you have to view the source code to see the changes.

If you are using NoteTab as your HTML editor (and I would recommend
it), there is a free routine to do this at the touch of a button,
called HideEmail ( www.notetab.com/html.htm#Utilities ). (-ibid)


Something else to watch out for:

quote:

Shotgunning Your Daemon Mailer

This has become the most pervasive and common method of hackers to
flood the internet with spam. Many hosting companies now are
inhibiting unprotected versions of formmail.pl.

There are newer versions of formmail that only allow email to
selected addressees and / or from a pre-determined domain server.
Get one! THIS IS VITALLY IMPORTANT!

Not only will you begin protecting yourself, but also your friendly
ISP and your gracious hosting company and... you will reduce the
enormous thievery of hardware, wasted bandwidth and time of every
responsible internet user! (Bill Davison, Daily #1416)


Unfortunately, there is no archive for this digest, but I still have these issues in my deleted items box. E-mail me and I' ll forward them to you.

rich




rdouglass -> RE: Anti-spam, anti-spider codes? (9/24/2002 14:05:01)

That problem has many ideas / advice to fix it. However, my favorite is using a simple DB (2 fields) and having the emails form-based. IOW, I let the server and an email script take care of it (sending the email). That way, the email ' addy' never actually displays on the web site.

Since it' s ASP-based, the webbot won' t be able to do much with it. I know there are other ways, but IMO that one is one of the simplest....




MonZaTino -> RE: Anti-spam, anti-spider codes? (9/24/2002 17:24:58)

Here' s a dumb question:

If I create an e-mail form, would the " spider" still be able to harvest the e-mails from the source? (My site is based in FP and would create forms in FP too)

As of right now, my website has both graphic e-mail links and text links. It might be easier to remove the e-mail text links, which might help in preventing the harvesting of e-mails from my sites. What' s your opinion?

For an example of the pages I have now, visit http://austinweddings.com/driskill.htm





Richard Dudley -> RE: Anti-spam, anti-spider codes? (9/24/2002 17:41:09)

That depends on the capacity of the spambots and where you put the e-mail address.

If I were designing a spambot, I would look for hidden form fields, so I have to assume that someone else has thought of this already, and could see an e-mail address hidden here.

However, if you have the e-mail address on a server-side page or web-bot that processes the form data and sends the message, then no.

My feeling is, if you can see it in the HTML, so can the spam bot.




puiwaihin -> RE: Anti-spam, anti-spider codes? (9/25/2002 1:51:33)

May not apply to your situation:

Websites that are password protected cannot be accessed by spam-bots.




Reflect -> RE: Anti-spam, anti-spider codes? (9/25/2002 10:13:48)

I have had great luck with converting my e-mails address' s using Uni-encoding. Here is an on-line converter just cut and paste...

http://www.fantomaster.com/fantomasSuite/mailShield/famshieldsv-e.cgi

Spam dropped heavily after I implemented this.

Brian




Page: [1]

Valid CSS!




Forum Software © ASPPlayground.NET Advanced Edition 2.4.5 ANSI
0.078125