Roundup of Antivirus Tests 2010 (Final)

(Unable to edit old thread so posting continuation from here: https://www.wilderssecurity.com/showthread.php?t=286378)

Hey all. I have created a roundup of all the testing results throughout the year to find the overall detection capabilities of antivirus products. Considering others may find these statistics useful in general i have decided to share. Trusty excel skills were in use to find out just for my own purposes to see how my own current choice in antivirus software is holding up.

Current testing results used from the year:
AV-Test Quarterly Tests: http://www.av-test.org/certifications.php
AV-Comparatives: http://www.av-comparatives.org
VBulletin RAP (April - October): http://www.virusbtn.com/vb100/rap-index.xml, http://www.virusbtn.com/virusbulletin/archive/2010/04/vb201004-comparative
Ekaitsee Dynamic Test: http://www.ekaitse.ee/EKAITSE_TORJETEST_2010_ENG.pdf
Dennis Technology Labs: http://www.dennistechnologylabs.com/reports/s/a-m/symantec/DTL_PCVP2011_SYMC.pdf
Symantec Commission AV-Test: http://community.norton.com/norton/...feedback/3371/1/Real_World_Testing_Report.pdf, http://community.norton.com/norton/...eedback/3371/2/Remediation_Testing_Report.pdf
SL.Portal Malware Test: http://translate.google.se/translat...rose-sl-portal-malware-test-2010/&sl=de&tl=en
PC Security Labs:http://www.pcsecuritylabs.net/document/report/PCSL_Total_Protection_Test_July_2010_EN.pdf
PCMag 2011: http://www.pcmag.com/article2/0,2817,2372369,00.asp
Raymond Performance Tests: http://www.raymond.cc/antivirus/
Antivirusware: http://www.antivirusware.com/
Passmark: http://www.passmark.com/ftp/antivirus_11-performance-testing-ed2.pdf
MRG Flash Test: http://malwareresearchgroup.com/wp-content/uploads/2009/01/MRG-Flash-Tests-20101.zip

(Feel free to mention any others I may have missed as I want to get as many total samples across the categories as possible)

I have only included results for 14 products (assume Internet Security/Paid versions) that I was most interested. I may include more for the year 2011. These results have been updated to take account of all the last recently published tests and major testing vendors for the 2010 year.





Summary Information:
Amber highlighted results represent this product was not tested in all the test sets and is potentially an estimate. The result will be normalised based on the results of the other products in a test set so it is a reliable score, just not 100% guaranteed to have that exact score. For such estimates a third column lists the % of samples out of the total that have been estimated.

The results are categorised into: On Demand, Retrospective, Dynamic Real World, Removal, Performance and False positives. With all the 2010 results now in, a King of the Tests category has also been created.

On Demand: Raw detection capabilities of signitures when fully updated with latest definitions.
Retrospective: Capabilities of heuristics and generic signatures against new unknown malware.
Dynamic: Real world protection capabilities using all components of the security software to demonstrate effectiveness in the real world.
Removal: Effectiveness at cleaning a system from malware, the higher the score the better the product is at disinfection and removal of malware trace elements without damaging the system in the process.
Performance score (higher is better): All performance results are normalised to use the same AV-Comparatives scale (and takes scanning speed into account)
False Positives: Mean false positives across all tests with such information available. The results help to show which products are more prone to false positives and are not an exact result.
King of Tests: Personalised scoring system in an attempt to determine which antivirus solutions did the best across all the categories equally.

 

Thanks once again for sharing your hard work!

 

Awesome summary!

 

Good job!

 

very nice..thanks

 

Good work

 

Excellent job

 

good job norton

norton always at first

 

good job

Norton doing well

 

Great job - You may now call yourself help unlimited. Thanks.

 

Thank you!

 

Impressive results! Good job putting it together! F-Secure...G-Data looking better.

 

Maybe...

 

Well done

 

Is "Panda" their free cloud, paid pro cloud, or paid internet security?

 

I think it's their Panda Antivirus (Most of these are engine tests).
Not cloud or Internet Security or Global Protection.

Probably in the dynamic tests they used the suite not sure.
You can check what they used in their sites

 

Great job..

 

I dont remember panda cloud being included in any of the 2010 tests. Its generally either their antivirus or the internet security solution being tested and where there are multiple results for different products I went with the highest grade solution.

But as Noob stated you can check which product is used specifically with each test by visiting the testing sites themselves.

 

Really nice job!! Thanks!!

 

nice job, now it helps me decides which suite should I buy next after this one expires

So it's true that KIS do have "impact" on system performance especially on the latest version?

 

Excellent job!

 

The 8 tests give an indication of how products perform in comparison to each other. Its more likely for the products with a lower score to cause system impact for users but does not nessecarily mean it will.

 

F-Secure, FTW!!!

 

What's more interesting is how a combination of products can give a synergistic umbrella of protection.

Looking at the Appendix 1, MRG Flash Test: of the OP........
http://malwareresearchgroup.com/wp-c...ests-20101.zip

I notice that a combination of MBAM [real time] plus , say , Avira AV gives pretty much complete coverage of Green Dots(pass) [yes, a few are missed...so maybe that's where PrevX SOL comes in?].

The important point is....maybe the time has come that we need to start using MBAM real time instead of the conventional wisdom of using it OD.

Of course, it depends on the individual user Security setup......

feandur

 

Good Morning ! A Proverbial Labour of Love...many thanks. Sincerely...Securon