ArticlesBase.com - Free Articles Directory
Free Online Articles Directory
05.09.2008 Sign In Register Hello Guest
Email:
Password:
Remember Me 
forgot your password?


Spam Filters Explained

Author: Alan Hearnshaw Author Ranking Blue | Posted: 20-09-2005 | Comments: 0 | Views: 600 | Rating:  (56) Article Popularity - Blue (?) Got a Question? Ask.
Sign Up Now!

Spam Filters Explained What do they do? How do they work? Which one is right for me? By Alan Hearnshaw

Spam is a very real problem that many people have to deal with on a daily basis. For those that have decided to do something about it and start to investigate the options available in spam filtering, this article provides a brief introduction to your options and the types of spam filters available.

Despite the bewildering array of spam filters available today, all claiming to the best one "of its kind" there are really just five filtering methodologies in general use today and all products rely on one, or a combination of these:

Content-Based Filters "In the beginning, there were content-based filters."

These filters scan the contents of the and look for tell-tale signs that the message is spam. In the early days of spamming it was quite simple to look out for "Kill Words" such as "Lose Weight" and mark a message as spam if it was found.

Very soon though, spammers got wise to this and started resorting to all kinds of tricks to get their message past the filters. The days of "obfuscation" had begun. We started getting messages containing the phrase "L0se Welght" (Notice the zero for "o" and "l" for "i") and even more bizarre - and sometimes quite ingenious - variations. This rendered basic content-based filters somewhat ineffective, although there are one or two on the market now that are clever enough to "see through" theses attempts and still provide good results.

Bayesian Based Filters "The Reverend Bayes comes to the rescue"

Born in London 1702, the son of a minister, Thomas Bayes developed a formula which allowed him to determine the probability of an event occurring based on the probabilities of two or more independent evidentiary events.

Bayesian filters "learn" from studying known good and bad messages. Each message is split into single "word bytes", or tokens and these tokens are placed into a database along with how often they are found in each kind of message. When a new message arrives to be tested by the filter, the new message is also split into tokens and each token is looked up in the database. Extrapolating results from the database and applying a form of the good reverend's formula, know as a "Naive Bayesian" formula, the message is given a "spamicity" rating and can be dealt with accordingly.

Bayesian filters typically are capable of achieving very good accuracy rates (>97% is not uncommon), and require very little on-going maintenance.

Whitelist/Blacklist Filters "Who goes there, friend or foe?"

This very basic form of filtering is seldom used on its own nowadays, but can be useful as part of a larger filtering strategy.

A "whitelist" is nothing more than a list of e-mail addresses from which you wish to accept communications. A whitelist filter would only accept messages from these people and all others would be rejected

A "blacklist", conversely, is a list of e-mail addresses - and sometimes IP Addresses (computer identification addresses) - from which communications will not be accepted.

While this may seem like a good idea from the outset, a whitelist methodology is too restrictive for most people and, as virtually all spam e-mails carry a forged "from" address, there is little point in collecting this address to ban it in future as it is very unlikely to be the same next time. There are bodies on the internet that maintain a list of known "bad" sources of e-mail. Many filters today have the ability to query these servers to see if the message they are looking at comes from a source identified by this Internet-based blacklist, or RBL. While being quite effective, they do tend to suffer from "false positives" where good messages are incorrectly identified as spam. This happens often with newsletters.

Challenge/Response Filters "Open sesame!"

Challenge/Response filters are characterised by their ability to automatically send a response to a previously unknown sender asking them to take some further action before their message will be delivered. This is often referred to as a "Turing Test" - named after a test devised by British mathematician Alan Turing to determine if machines could "think".

Recent years have seen the appearance of some internet services which automatically perform this Challenge/Response function for the user and require the sender of an e-mail to visit their web site to facilitate the receipt of their message.

Critics of this system claim it to be too drastic a measure and that it sends a message that "my time is more important than yours" to the people trying to communicate with you.

For some low traffic e-mail users though, this system alone may be a perfectly acceptable method of completely eliminating spam from their inbox - one step above the "Whitelist" system outlined above.

Community Filters "A united front"

These types of filters work on the principal of "communal knowledge" of spam. When a user receives a spam message, they simply mark it as such in their filter. This information is sent to a central server where a "fingerprint" of the message is stored. After enough people have "voted" this message to be spam, then it is stopped from reaching all the other people in the community.

This type of filtering can prove to be quite effective, although it stands to reason that it can never be 100% effective as a few people have to receive the spam for it to be "flagged" in the first place. Just like its similar cousin the Internet black list (RBL), this system also can suffer from "false positives", or messages incorrectly identified as spam.

Hopefully you are now armed with a little more information to be able to make an informed decision on the best spam filter for you. For further information, consider reading the reviews and articles found at http://www.whichspamfilter.com

Alan Hearnshaw is the owner of http://www.whichspamfilter.com, a web site which conducts weekly in-depth reviews of current spam filters, provides help and guidance in the fight against spam and provides a useful community forum. alan@whichspamfilter.com

Rate this Article: Current: 0 / 5 stars - 0 vote(s).

Article Source: http://www.articlesbase.com/spam-articles/spam-filters-explained-2619.html

Print this Article Print article   Email to a Friend Send to friend   Publish this Article on your Website Publish this Article   Send Author Feedback Author feedback  
About the Author:
Alan Hearnshaw is a computer programmer and the owner of http://www.WhichSpamFilter.com, a site which provides weekly in-depth spam filter reviews, user help and guidance and a community forum.
Submitting articles has become one of the most popular means of generating quality backlinks and targeted traffic to your website. Join us today - It's Free!

Article Comments

Comment on this article Comment on this article
Your Name
Your Email:
Comment Body
Enter Validation Code: Captcha


Related Articles

So What Makes a Good Spam Filter Anyway?
By: Alan Hearnshaw | 20/09/2005 | Spam
Filter in the first place? This is not just a rhetorical question. It is a question that many users - and many developers - do not ask, and consequently, goes unanswered. Maybe.

Why article writing is increasingly important in this SPAM era
By: Lois S. | 19/09/2005 | SEM
Need from clients and business associates. Many times even email sites are trying to control ever rising Spam volumes. Many times this makes even genuine communication via email.

Getting Your Online Degree
By: Tim Henry | 26/09/2005 | Education
All of your life you have wanted a college degree but circumstances prevented you from going to college right after high school. Maybe you decided to go to work for a while and just ended up staying there because you got...

The Two Things You Must Do To Change Your Life
By: Jerry Lopper | 19/09/2005 | Self Help
Then you found yourself right back where you started? If you answered yes, you're not a failure, nor is change hopeless. Realize that you're among the majority of people who.

Help - I Need Traffic To My Website
By: Tim Gorman | 20/09/2005 | Viral Marketing
Poor traffic leads to disappointment and zero dollars in your pocket. This article outlines some simple techniques I use to drive traffic to my websites. I have 4 primary.

The Only Way to Start your Day: Morning Prayer
By: global beauty | 08/10/2007 | Motivational
How to Have a Prosperous and Productive Day. In the midst of all the hustle and bustle, commotion and combustion in our lives-we need more peace and calm to function daily. Our qualities of lives are being stained by the stresses of the world by TV, work, family, and interaction with people. The “little purple pill or blue pill,” can not permanently bring peace, joy and happiness in our lives during these times. Medications provide a temporary illusion of peace to the mind and body.

You dont need to starve to lose weight. Its about balance.
By: Mick | 21/09/2005 | Weight Loss
On your body and mind. You are putting less calories into your body and then making your body work harder to use those less calories. Entering into a diet and exercise.

Great Relationship Problem Solving Technique
By: Sonia Devine | 31/10/2005 | Self Help
This is one of my all time favourite problem solving techniques. If you're going around in circles with a relationship problem, it can really help to step back and break the problem down into groups. Here's how to do it:

Got a Question? Ask.

Ask the community a question about this article:

Frequently Asked Questions

What's the best dance movie you've seen in the last 5 years?
By: tre1129 | 08-10-2007
what's the best dance movie you've seen in the last 5 years?

What's one of the most important things you try to get across to a man/woman on a date?
By: relationshipGuru | 08-10-2007
What's one of the most important things you try to get across to a man/woman on a date?

Lyme Disease - 2nd time around
By: jake.brown | 08-10-2007
I'm curious to know, has anyone ever had lyme disease? And if so, have they ever treated it and had it re-occur years later? If so, what kind of symptoms did you experience the 2nd time around? And was it easier to treat the 2nd time around or harder?

What's the healthiest dog treat on the market these days?
By: tul2007tul | 07-10-2007
what's the healthiest dog treat on the market these days?

Trust : What is it, how do you manage your trust relation with others ?
By: Frederic Barre | 07-10-2007
A question about Trust What is it ?What is your definition of the "trust" ? How do you manage your trust relation with others  ?How can you tell from someone is trustable or not, do you manage level of trust ? what are your references ? 

Jaxtr.com - free phone company online?
By: tre1129 | 07-10-2007
Anyone have experience using jaxtr (a free telephone company online)? I found their information through facebook and wanted to get some feedback before I think of installing it. Thanks! 

Q&A Powered by:
Powered by Yedda 

Latest Spam Articles

Best Spyware Removal Software
By: Nick Marion | 02/09/2008
If you have notice that your computer is running unusually slower or you have annoying pop-ups your computer has been infected with spyware or adware. Learn how to make those unwanted guests dissapear and how to keep them away.

Anonymous Web Browsing
By: Justin Mongiardo | 02/09/2008
The internet is hardly a private place. In fact, with the right tools, it is possible for someone to monitor every move you make online. However, you can protect your internet identity by participating in anonymous web browsing using a proxy. This will hide your IP address and any other identifying information that may be attainable through the web. Every time you access a website, your computer transmits some personal information to the site’s server. This always includes your IP address and

SEO Spam- Protect Your Website From Getting Banned
By: Article Manager | 29/08/2008
Webmasters usually resort to unethical ways of boosting the search engine ranking of their websites which increases the search engine ranking for a certain period but temporarily. Once if the search engines detect the unethical practices then these websites might be banned for a long time. Search engines now have more advanced algorithm to detect spam but still with the use of black hat technique it has become difficult to get rid of spam.

Internet Scams- Detecting Scams Online
By: Raymond Aremonkhae | 21/08/2008
Many scammers are very cunning, so being smart is not enough to protect yourself. Are you frustrated and overwhelmed by of all of the scams, spam and other junk you see every day on the Internet and in your email box? Do you wish you had a way to know for sure what's real and what's not?

Why is Ed Spam Still so Popular?
By: Brian Welsch | 20/08/2008
One of the reasons Viagra (and, therefore, Viagra spam ) is so popular is that it is one of the most successful medicines that actually does what it claims it will do.

Halt! 5 Steps to Stop Spam Emails on your Website
By: Steve Johnson | 18/08/2008
No one likes spam email - customers, clients, and even business owners cannot always handle the amount of spam that comes from one email address placed in a public space on the web. So if you have a website, you will want to check out these five tips that will help to reduce the spam that gets into your inbox.

Stopping Nasty Spam from Taking over Your Inbox
By: Steve Johnson | 15/08/2008
There are so many different ways that people can get email addresses these days. All you need to do is find a site that offers email addresses and sign. But have you ever notice that even when you don't share your new address, you can end up with a half a dozen spam emails in your box a few hours later? If you want to get rid of this nasty problem, take a look at the following steps.

Internet Fraud Explained
By: Richard Sampson | 29/06/2008
To express it generally, Internet Fraud is any fraud scheme that uses the one or more components of the Internet. Unfortunately, due to the speed at which the internet and all of its increasing capabilities are expanding it is getting increasingly difficult to keep up with the Internet scams out there. We delve into the schemes present currently as well as provide you tips to reduce your risk when transacting over the internet.

More from Alan Hearnshaw

So What Makes a Good Spam Filter Anyway?
By: Alan Hearnshaw | 20/09/2005 | Spam
Filter in the first place? This is not just a rhetorical question. It is a question that many users - and many developers - do not ask, and consequently, goes unanswered. Maybe.

Article Categories






Give Feedback

Sign up for our email newsletter

Receive updates, enter your email below