Malware-Test Lab: Antivirus Comparison Report (February 26, 2007)

I have a question - how many of the samples have been tested for functionality? What precautions did you take to minimize the number of corrupted samples? Hopefully you did not just scan files collected on honeypots.

 

seeing as the folder scanned was I:\Honeynet\... i wouldn't base too much on these results

 

Seems the last test results have been updated. Check out whose number 1 now.

 

Cant wait to hear from this point forward.

 

But what do these number say if they cannot confirm the samples were tested for functionality? If they are actually collected on a honeypot, obviously many of them will be corrupted and non-functional, and thus not detected by many AVs. The results are not surpising for me, but in reality some of the AVs would score much much better.

 

With all due respect to Marcus and the product he represents ( a good one which I myself use on one of my computers), one has to wonder why we are doubting a test which in the past was always held in the highest esteem.
As long as Nod32 was on top, the test was quoted and considered the
Bible of anti-virus assessment. Now that Nod32 has lost it's title to Kaspersky and Kaspersky based software, the test is ridiculed and treated as a leper.

I find this very strange and bewildering.

 

I will agree with that.

 

and when you do look at the list of order, regardless of samples used, they all pretty nuch fall in order of where you normally see them. Maybe up a few spots or down. All but one at the bottom.

 

That is really new to me: i can't imagine any person thinking and talking with respect about any ehhh "test" performed by ehhh "malware-test lab".

Please remove me from your "highest esteem list": to be mentioned on that list is very bad for my reputation.

Txs,

Smokey

 

Since when has Malware-Test ever been respectable? Even their Anti-spyware testing is a joke.

Quoting Samplas:

If that's the case why does AOL AVS free score higher than KIS 2006?

 

When and where did you read an AV expert saying that these tests are good!!!

I really would like to see that!

 

one111,

Given that both results were released in February, is it possible that you are confusing the results covered in this thread (from Malware Test lab) and those provided by av-comparatives.org. They are not the same test.

Blue

 

Thought this referred to a second test on Malware Test Lab, at least the list's order is now changed from the list that starts this thread.

 

I have to apologize

I actually was referring to the av-comparatives test and by mistake
responded in the wrong thread.

Sorry about that

 

While I do question the results and testing procedures of this current test...

I wonder...

With some experts saying that these samples are likely corrupted or not working does this mean that AVs that scored higher on this test (like Avira, BitDefender, AVG, Norman etc) detect a lot of "trash" files?
Also considering in the last retrospective test at av-comparatives that all the above mentioned AVs scored a "very few/few" false positive ratings.

Or is it not fair to make such a correlation just by simply looking into these few points?

 

See this post by FRug

 

Ahh that makes sense, I vaguely remember having read that post too but now it makes more sense as I can relate it to this test. Thank you

 

ahem...please don't take it personally We all have our preferences and opinions here.
Everyone is free either to trust or not in these tests

Good luck with your AV

 

Yes we all have our own preferences and opinions, but objectively speaking this test is methodologically flawed. So it has nothing to do with subjective sentinments, it is a matter of reason. And if you look at these tests rationally, you will find that they are indeed flawed.

 

I have sent a PM (few days ago) to IBK to request all scan log files and SHA1 values, unfortunately, I have not received any response from IBK, who can help contact him? Thanks.

Why I need this information because I want to verify their test result.

 

he would have got your PM, but either is choosing not to reply or not to give you what you want.

 

Perhaps he simply does not have the time, or maybe perhaps that info is internal and not meant to be shared. In any case, I have not seen IBK log in here for a long time now, so I suspect he is busy.

 

He told us all he was going on vacation this past weekend. He was also in here earlier today, and like most of us, has a real life to attend to. He will be popping up soon again, with maybe with a little surprise.

 

I see no good reason to give out this information to sai7sai, so i choose "not worth to reply or to discuss".
btw, i am back.

 

The "other AV test" is available online.
Thanks IBK