Instructions for Training to Exaustion

TRAINING TO EXHAUSTION WITH A PRE-CLASSIFIED EMAIL DATABASE

Here's how the training set is handled.

Start with an empty word probability database.

Consecutively classify each email in the training set. Switch between ham and spam back and forth.

If an email is classified correctly, ignore it.

When an email is encountered that is misclassified, update the probability database using the misclassified email, and continue processing the emails in sequence using the updated probability database, until the last email is reached.

Go back to the first email in the training set and start again.

The above is repeated until either: a) the very last email is properly classified, or b) there is one complete iteration through the system with no improvement in accuracy.

Notes:

1) The probability database is not recreated during each iteration. Rather, the counts that lead to the probabilities are further refined with each iteration.

2) Some emails are counted more than once. In practice this happens relatively rarely. Also this can be avoided, possibly leaving wrongly classified messages in the end.

3) Experiments have shown that it is useful to use a so-called security margin. This is an interval around the cutoff value which is forbidden for all messages. For example, spams may be required to be >.7 and hams <.2. In practice, almost all mails can be made to conform to this (if you don't allow for messages used more than once, a few might not conform). Then, when .5 is used as the cutoff in testing, messages more likely get scores not close to the cutoff and are more likely to be classified correctly.

4) In preliminary tests, this procedure has let to very good performance.

5) Using this procedure, we don't need to tune the filter for parameters such as finding the ideal spam/ham cutoff point. Rather that probability database is automatically adjusted to match the cutoff point(s) initially chosen by the software developer (see 3 above).

6) In actual use in an inline spam filter, the process would ideally iterate through the entire database of emails every time there is a misclassification. If resources are limited this process might be restricted to recent messages.

Comments

[CBClinton]

http://mikardia.com/porno_pictures/big-pennis-6.jpg

My story is porn share anЭmal porn for you porn adult nuns sex mummy porn tube menstrual porn tube free video clips of mature europorn free porn preview video asian grandma sex also free gay porn tv porno sex black indian porn boyz czech porn casting tentacle porn
And also hmong sex porn fbb in porn thai loli porn porn stars movies mature vietnamese porn asia porno 3gp "free porn vivian schmitt" free porn samples on the psp beautiful porn sex also porno lesbo anal tubeporn gay adult adult adult amateur blow bsex.tv fisting free hardcore hardcore job oral porn porn porn sex sex streaming video voyeur xxx teensexmovs alisa rarfree anal movie clip also konec porn katerina porn video teens baby pissing crackheads gone wild porn beastlynes free porn
I get porn video lucia porn pokemon sexy teen sock also free porn xxx emily18 free indian porn video mom son gay speedos porn porn u kdz porn pics
And finnaly sickest most bazarre porn videos and pictures. momfucks boy 3d porn porn 3pg gay gay porno free pics also manga porno auf ziporn porn extreme symbian porn watch punjabi porn free real homemade porn porn jeans

[Kamyarola]

entre os melhores sites, com tudo o que precisa de saber sobre os melhores cassino e onde encontrar as melhores promo??es. Somos o ?nico s?tio que lhe oferece $10 gr?tis para se divertir e experimentar os excelentes Casino Europa e o Casino Tropez. Aqui pode encontrar as opini?es de profissionais em casinos online e encontrar o melhor b?nus. Se voc? gosta de jogar Blackjack, Roleta, Poker ou Dados, e tantos outros jogos, n?s temos as melhores dicas para voc? se divertir, jogar e ganhar.

[Supra Footwear]

Disappointment will come when your effort does not give you the expected return. If things don’t go as planned or if you face failure.

[Supra Footwear]

Disappointment will come when your effort does not give you the expected return. If things don’t go as planned or if you face failure.

[Minimalist Shoes]

I am addicted to your blogs because I keep coming back everyday hoping that you have updated

[ugg.com]

it's really bad when you are mislead to beleave that someone is helping there people and after reading about the rush card, i was just hirt.

[renlewei]

It is really good to share such wonderful and informative post, thank you very much for that, and just keep doing it.

[Canada Goose Parka]

The discussion an on going discussion and analysis of the moral the fact that this is so ought to be an embarrassment to white liberals who are die. Thanks for sharing informative post. beautiful !!!

[moncler outlet online]

Gotta love a bike with dick-shaped handlebars. It might actually get me to ride a bike again.

[Buy Flagyl]

Thanks for writing this. I really feel as though I know so much more about this than I did before. Your blog really brought some things to light that I never would have thought about before reading it. You should continue this, Im sure most people would agree youve got a gift.

[best online pharmacy]

If you need more traffic to your website check out the website in my name. It really helped me and i think it can help your website.

[Moncler]

This is a nice site. The discussion an on going discussion and analysis of the moral the fact that this is so ought to be an embarrassment to white liberals who are die. Thanks for sharing informative post. beautiful !!..

[Ralph Lauren Outlet]

Having read this post, I have learned for myself a lot of the new. Thanks