AV-Comparatives August 2005 Overview

[.....]

Seems IBK put the overview for the august on-demand test on his site.
One suprise to me: Dr.Web only got the "standard" rating.

To find them:
http://www.av-comparatives.org/ ->> Comparatives ->> Scroll Down ->> Click "To get an overview of the comparatives, we summarized them in tables. You can find them here."

[abhi_mittal]

From seeing the results, I again feel strongly about the thread http://www.wilderssecurity.com/showthread.php?t=95106

[IBK]

I uploaded it already just to let you a bit mentally prepare on the upcoming release of the results :P
Check the website again during next week.

[vee]

@IBK
thanks... care to give as a clue about: "* RAV and Sophos will be not included in any future tests."

well RAV is obvious :), but Sophos?

Regards,
vee

[IBK]

Sophos does no longer wish to get tested by us after this test, because it does not fit in their marketing strategy if I understood it correctly. I accepted to do not longer include them in future tests, as Sophos is not a home-user product like some others.

[vee]

@IBK

Thank you for the answer. Well it sounds fair, but still strange... (even business user products needs to be tested ::) ).

Best regards and keep up the great work,
vee

[Smokey]

{QUOTE-> I uploaded it already just to let you a bit mentally prepare on the upcoming release of the results :P
<-QUOTE}
I'm a little shocked about Dr.Web: november 2004 "advanced+", may 2005 "advanced", august 2005 "standard"...:o

[IBK]

Dr.Web always got so far always "advanced" in the on-demand tests (!). this time is what not enough to get advanced, so I had to give to DrWeb "standard".

@vee: i understand that someone could also think that it is because they do not score best, but i prefer to think that it is because they do not want to get compared against home user products.

[rothko]

first ADVANCED+ in the on-demand tests for both NOD32 and Bitdefender, looking forward to seeing the full results!

[Blackcat]

I am surprised that AntiVir scored higher than Dr Web.

Probably due to their recent big update of signatures?

[IBK]

No, the last big update of HBEDV was ~4 months ago, mainly non-replicating malware. for hbedv it was this time enough to get advanced, for drweb not. hbedv is now better than drweb against non-replicating malware. And drweb better than hbedv against replicating malware.

[rothko]

NOD32 had a huge update just before the cutoff for this test, plus a tweak to the advanced heuristics - looks like it did the trick

[Smokey]

{QUOTE-> I uploaded it already just to let you a bit mentally prepare on the upcoming release of the results :P
<-QUOTE}
Only one AV with the score "advanced+" in the period february 2004 till august 2005: Kaspersky.

Not very surprising, but in spite of this: congratulations to Kaspersky Labs!*puppy*

[IBK]

You will anyway be surprised about the results that KAV reached this time ;)

[Smokey]

{QUOTE-> You will anyway be surprised about the results that KAV reached this time ;) <-QUOTE}
For sure I will!:)

[.....]

{QUOTE-> You will anyway be surprised about the results that KAV reached this time ;) <-QUOTE}
Is that a good suprise or a bad suprise? :-\

[Smokey]

{QUOTE-> Is that a good suprise or a bad suprise? :-\ <-QUOTE}
Surprise, surprise!*puppy*

[Kye-U]

Curious to see how Kaspersky, NOD32 and Bitdefender did...

[rdsu]

Dr.Web seems to have now a lower detection level...

NOD32 and BitDefender are the surprises with the first ADVANCED+ ;D

AntiVir are doing a nice job! This detection and the incremental updates are great for a free AV...

avast! always stay with the STANDARD and they didn't improve its detection :(

By the words of IBK, it seems that Kaspersky had a worst detection that in the previous test, but maybe I'm wrong... :)

Thanks for your work, IBK ;)

[hbkh]

I continue to be amazed by BitDefender's progress... I mean 2-3 years ago I'm sure most of us won't have touched it with a ten foot stick. Now, for me atleast, I'd be proud to run it on any of my machines! :)

[IBK]

do not try to interprete my words, i want to keep the results secret until they are released ;) so it will be a surprise for anyone; maybe it also helps to earn in the meantime some cents thru the google ads :P
Avast improved, but not enough to get advanced.

[.....]

You can say weather its a good suprise or a bad one though :P

[Smokey]

{QUOTE-> do not try to interprete my words, i want to keep the results secret until they are released ;) so it will be a surprise for anyone <-QUOTE}
IMO you are torture us with a satanic pleasure!;)

[IBK]

:P ;D

[jg88swe]

Whoho thanks man :D

Glad to see NOD32 and Bitdefender at the top but im chocked about DrWeb it's a awesom AV... hmm ohh well :o ::)

[vee]

{QUOTE-> @vee: i understand that someone could also think that it is because they do not score best, but i prefer to think that it is because they do not want to get compared against home user products. <-QUOTE}

Well me too... :). The company I work for is using Sophos, my home network (4 comps) is using NOD32 and I am currently using KAV/KIS 2006 pre-beta... knock, knock - so far so good... I think all 3 are great products for enviroments they are used in, but still Sophos would do better for their marketing plans if they aimed to make their protection better (like NOD32 did) for the test, then to decide not to be in tests anymore... in the end those test are, as far as i see them, not about who scores best, but who is ready to improve upon a bad score... just my opinion.

Regards,
vee

[IBK]

if av-comparatives continues to still get more and more popularity, the pressure from the users will grow to see also sophos tested, maybe then sophos will in some years again want to get listed in the tests. i also do not understand the decision of the marketing peoples, i always tought that every kind of publicity for free (!) is good. and getting e.g. "standard" in our tests is not easy; i think it can be considered like a "passed" in the tests of e.g. WestCostLabs (with the difference that e.g. WCL tests have more importance for e.g. marketing and that they are not free of fee) :P. But I accept their decision and follow/respect their wish.

[Live]

I remember that IBK said that he`ll use an AV that got advanced+ in the August 2005 test...a don´t know, but my 6 sense says that he is (or will) using NOD32!! hehe

[Acadia]

IBK, don't let anyone or any company pressure you into doing ANYTHING. I consider, and I know many others do also, your site to be at the same time one of the most comprehensive and OBJECTIVE testing sites around ... keep on going just as you have been. 8)

Acadia

[Live]

The only AV test that I trust is Av-comparatives and Virusbulletin...

By the way, maybe the surprise that IBK is talking about KAV is that it has got 100% of all malware...:P

[mercurie]

{QUOTE-> do not try to interprete my words, i want to keep the results secret until they are released ;) so it will be a surprise for anyone; maybe it also helps to earn in the meantime some cents thru the google ads :P
Avast improved, but not enough to get advanced. <-QUOTE}No shame in earning a little money. ;)

[iwod]

Few things i notice immediately:

NOD32 & Bitdefender score their first Advanced+ in a On Demand test. Both are improving rapidly.

F-prot is not doing very well compare to 2004. ( Ironically i stop using it at start of 2005)

On the free AV side.
AVG has its first rating :D
Avast stay as " Standard "
AntiVir ( H + BEDV ) has its first advance rating. ( I hope they improve even more )

[Blackcat]

IBK,

Can I ask whether Dr Web missed the Advanced level by much?

In particular, did the DOS samples have much effect on the level reached by DW?

[IBK]

No, the DOS samples does not have affect to the decision which level is reached. I look on all tables (e.g. with and without DOS/otheros) and Drweb did scored good enough to get advanced; but it is on the top of those listed in standard if it is that what you mean). I know in the report the levels are written near the total percentages and users may think they are given exclusivly due them alone, but it is not so (but anyway easier to understand and to explain the results if I am asked). I also spare some space in the report :P

P.S.: even if it does not have affect to the levels, just for information, there were also some issues with drweb (crashing), but they are now all fixed in the meantime (at least all crashing files I reported). Even if a condition is that the program should not crash or cause major problems during the scan, i tested it anyway (even if it was known and reported before that drweb has some crashing problems).

[The Hammer]

I see Symantec made a return to Advanced + from standard.

[IBK]

No, please take a look in which kind of tests the products reached what. on-demand test (february and august) and retrospective test (may/november) are 2 different things.

[The Hammer]

{QUOTE-> No, please take a look in which kind of tests the products reached what. on-demand test (february and august) and retrospective test (may/november) are 2 different things. <-QUOTE}
So in the on demand test Symantec retained it's Advanced + rating from the previous on demand test.

[IBK]

{QUOTE-> No shame in earning a little money. ;) <-QUOTE}

:P $0.38 earned today; seems like it works worser than before...

btw, dunno if someone noticied it, but since a ~week the document with the FAQ is updated; some few more Q/A added etc.

[Firefighter]

{QUOTE-> NOD32 had a huge update just before the cutoff for this test, plus a tweak to the advanced heuristics - looks like it did the trick <-QUOTE}
The major question is, how good NOD will be after 5 months, when it is missing updates about 2 months size? ;D

Best regards,
Firefighter!

[Firefighter]

{QUOTE-> I am surprised that AntiVir scored higher than Dr Web.

Probably due to their recent big update of signatures? <-QUOTE}Don't worry, remember that DrWeb has actually over 6.6 % signatures more in their nasty/risky databases, which I assume were not within in this test.

Best regards,
Firefighter!

[IBK]

I tried that too. Even with the beta riskware signatures of Dr.Web it would not change its results, which is not a surprise, as in the test-set of av-comparatives spyware/adware/jokes/etc. are not included.

[TopperID]

That's interesting to note. So presumably AntiVir free would score the same as AntiVir Premium, even though the latter includes protection for Adware/Spyware?

[IBK]

Yes, that's very probably.

[rdsu]

IBK, I hope that you include the Adware/Spyware detection to the next tests...

[IBK]

next thing that i plan tol include is a false positive test-set and more products.
building up a new good sorted spyware/adware test-set will take time, so atm i can not even say when i will start to do that and when (and how) it will be included; for sure not before 2007 and probably only a passed/failed without percentages.

[rdsu]

Good news, IBK :)

The false-positive feature on your tests will be very handy... ;)

[shek]

I just get the details of august's test from a chinese security website. The results do surprise me... ~~snip~~

[kalpik]

Link please!

[shek]

it is a 7 pages pdf file, for member only. And I will not provide it without the permission from av-comparatives. Meanwhile it will be online very soon, so please be patient.

~~snip~~

[Kye-U]

Bootlegged AV-Comparatives August 2005 results? o_O

[IBK]

Thank you for letting me know. That reseller will now hear from me >:(

Please do not provide any details in the meantime (also remove the comment you did already please). Thx!

BTW: I just got the info from Lycos that Lycos have blocked the access to all websites they host on their servers for those who try to access from China (since March2005!). :( Reason: they had some hacker attacks. nice; just do that they block the access for such a big country like china forever. So, if someone is from china and is not able to reach my website, now you know why. Tell it to the media and to lycos if you are unhappy about this, maybe due some pressures they will grant again the access of China. One solution would be to buy an even bigger webhsoting packet from lycos, but I will not do that, it is already quite expensive and i see no reason for it; they should allow china to visit the sites. In the meantime i am going to prepare a special site for chinese people, in order that also they can access to the results...

[SDS909]

{QUOTE-> Thank you for letting me know. That reseller will now hear from me >:(

Please do not provide any details in the meantime (also remove the comment you did already please). Thx!

BTW: I just got the info from Lycos that Lycos have blocked the access to all websites they host on their servers for those who try to access from China (since March2005!). :( Reason: they had some hacker attacks. nice; just do that they block the access for such a big country like china forever. So, if someone is from china and is not able to reach my website, now you know why. Tell it to the media and to lycos if you are unhappy about this, maybe due some pressures they will grant again the access of China. One solution would be to buy an even bigger webhsoting packet from lycos, but I will not do that, it is already quite expensive and i see no reason for it; they should allow china to visit the sites. In the meantime i am going to prepare a special site for chinese people, in order that also they can access to the results... <-QUOTE}

Given that a full 75% of hacker attacks originate from China. Also add in that China is the haven for piracy, illegal copying schemes, and intellectual property violations... Do you think this isn't justified? My ISP blocks all inbounds from China, my web hosting service blocks all inbounds from China, and my router is setup to block all referers and redirections to and from China.

I think it is all justified actually given the statistics I have from my own firm regarding Chinese credit card fraud on our sites.

[InfinityAz]

{QUOTE-> Given that a full 75% of hacker attacks originate from China. Also add in that China is the haven for piracy, illegal copying schemes, and intellectual property violations... Do you think this isn't justified? My ISP blocks all inbounds from China, my web hosting service blocks all inbounds from China, and my router is setup to block all referers and redirections to and from China.

I think it is all justified actually given the statistics I have from my own firm regarding Chinese credit card fraud on our sites. <-QUOTE}

Somewhat off topic but how do you set up your router to block all referers and redirections to and from China?

[likuidkewl]

{QUOTE-> btw, dunno if someone noticied it, but since a ~week the document with the FAQ is updated; some few more Q/A added etc. <-QUOTE}

I suggest everyone read it and learn a little bit about testing methods used.
I learned that you don't just use executabe type, you use the drivers associated too. Interesting. Good job!

[IBK]

hm, do you mean the extensions? ->EXE, DLL, VXD, ELF, SYS, SWF, HLP, CLA, JS, HTA, REG, RTF, MDB, PDF, ASP, DOC, XLS, PPT, VSD, PIF, COM, PL, SH, INI, INF, XML, VBS, HTM, BAT, PHP, etc.

btw, probably during tomorrow i will upload the results. i just have to do some other thing first...

[likuidkewl]

{QUOTE-> hm, do you mean the extensions? ->EXE, DLL, VXD, ELF, SYS, SWF, HLP, CLA, JS, HTA, REG, RTF, MDB, PDF, ASP, DOC, XLS, PPT, VSD, PIF, COM, PL, SH, INI, INF, XML, VBS, HTM, BAT, PHP, etc.

btw, probably during tomorrow i will upload the results. i just have to do some other thing first... <-QUOTE}
Yes. That is what I was trying to get at. The word eluded me for a moment.

[Firecat]

Seems to be an interesting test. I'm sitting here and waiting for the results to come.....now where is my Zlaty Bazant? ;D