Roundup of Antivirus Tests 2010 (Final)

Discussion in 'other anti-virus software' started by SM_Unlimited, Jan 27, 2011.

Thread Status:
Not open for further replies.
  1. SM_Unlimited

    SM_Unlimited Registered Member

    Joined:
    Jun 8, 2010
    Posts:
    31
    (Unable to edit old thread so posting continuation from here: https://www.wilderssecurity.com/showthread.php?t=286378)

    Hey all. I have created a roundup of all the testing results throughout the year to find the overall detection capabilities of antivirus products. Considering others may find these statistics useful in general i have decided to share. Trusty excel skills were in use to find out just for my own purposes to see how my own current choice in antivirus software is holding up.

    Current testing results used from the year:
    AV-Test Quarterly Tests: http://www.av-test.org/certifications.php
    AV-Comparatives: http://www.av-comparatives.org
    VBulletin RAP (April - October): http://www.virusbtn.com/vb100/rap-index.xml, http://www.virusbtn.com/virusbulletin/archive/2010/04/vb201004-comparative
    Ekaitsee Dynamic Test: http://www.ekaitse.ee/EKAITSE_TORJETEST_2010_ENG.pdf
    Dennis Technology Labs: http://www.dennistechnologylabs.com/reports/s/a-m/symantec/DTL_PCVP2011_SYMC.pdf
    Symantec Commission AV-Test: http://community.norton.com/norton/...feedback/3371/1/Real_World_Testing_Report.pdf, http://community.norton.com/norton/...eedback/3371/2/Remediation_Testing_Report.pdf
    SL.Portal Malware Test: http://translate.google.se/translat...rose-sl-portal-malware-test-2010/&sl=de&tl=en
    PC Security Labs:http://www.pcsecuritylabs.net/document/report/PCSL_Total_Protection_Test_July_2010_EN.pdf
    PCMag 2011: http://www.pcmag.com/article2/0,2817,2372369,00.asp
    Raymond Performance Tests: http://www.raymond.cc/antivirus/
    Antivirusware: http://www.antivirusware.com/
    Passmark: http://www.passmark.com/ftp/antivirus_11-performance-testing-ed2.pdf
    MRG Flash Test: http://malwareresearchgroup.com/wp-content/uploads/2009/01/MRG-Flash-Tests-20101.zip

    (Feel free to mention any others I may have missed as I want to get as many total samples across the categories as possible)

    I have only included results for 14 products (assume Internet Security/Paid versions) that I was most interested. I may include more for the year 2011. These results have been updated to take account of all the last recently published tests and major testing vendors for the 2010 year.

    AVTests2010.PNG
    AVTests2.PNG


    Summary Information:
    Amber highlighted results represent this product was not tested in all the test sets and is potentially an estimate. The result will be normalised based on the results of the other products in a test set so it is a reliable score, just not 100% guaranteed to have that exact score. For such estimates a third column lists the % of samples out of the total that have been estimated.

    The results are categorised into: On Demand, Retrospective, Dynamic Real World, Removal, Performance and False positives. With all the 2010 results now in, a King of the Tests category has also been created.

    On Demand: Raw detection capabilities of signitures when fully updated with latest definitions.
    Retrospective: Capabilities of heuristics and generic signatures against new unknown malware.
    Dynamic: Real world protection capabilities using all components of the security software to demonstrate effectiveness in the real world.
    Removal: Effectiveness at cleaning a system from malware, the higher the score the better the product is at disinfection and removal of malware trace elements without damaging the system in the process.
    Performance score (higher is better): All performance results are normalised to use the same AV-Comparatives scale (and takes scanning speed into account)
    False Positives: Mean false positives across all tests with such information available. The results help to show which products are more prone to false positives and are not an exact result.
    King of Tests: Personalised scoring system in an attempt to determine which antivirus solutions did the best across all the categories equally.
     
    Last edited: Jan 27, 2011
  2. J_L

    J_L Registered Member

    Joined:
    Nov 6, 2009
    Posts:
    8,516
    Thanks once again for sharing your hard work!
     
  3. Noob

    Noob Registered Member

    Joined:
    Nov 6, 2009
    Posts:
    6,468
    Awesome summary! :D
     
  4. Narxis

    Narxis Registered Member

    Joined:
    Jun 10, 2009
    Posts:
    477
    Good job!
     
  5. Kernelwars

    Kernelwars Registered Member

    Joined:
    Aug 12, 2010
    Posts:
    2,155
    Location:
    TX
    very nice..thanks:thumb:
     
  6. Boyfriend

    Boyfriend Registered Member

    Joined:
    Jun 7, 2010
    Posts:
    1,070
    Location:
    Pakistan
    Good work :thumb:
     
  7. Brandonn2010

    Brandonn2010 Registered Member

    Joined:
    Jan 10, 2011
    Posts:
    1,849
    Excellent job :thumb:
     
  8. xandros

    xandros Registered Member

    Joined:
    Oct 30, 2006
    Posts:
    411
    good job norton :thumb:

    norton always at first
     
  9. Nevis

    Nevis Registered Member

    Joined:
    Aug 28, 2010
    Posts:
    786
    Location:
    255.255.255.255
    good job

    Norton doing well :)
     
  10. century

    century Registered Member

    Joined:
    Oct 13, 2007
    Posts:
    92
    Great job - You may now call yourself help unlimited. Thanks.
     
  11. PJC

    PJC Very Frequent Poster

    Joined:
    Feb 17, 2010
    Posts:
    2,959
    Location:
    Internet
    Thank you! :thumb:
     
  12. Rompin Raider

    Rompin Raider Registered Member

    Joined:
    May 6, 2010
    Posts:
    1,228
    Location:
    North Texas
    Impressive results! Good job putting it together! F-Secure...G-Data looking better.
     
  13. sweater

    sweater Registered Member

    Joined:
    Jun 24, 2005
    Posts:
    1,674
    Location:
    Philippines, the Political Dynasty Capital of the
    Maybe... :cool:
     
  14. carat

    carat Guest

    Well done :thumb:
     
  15. DBone

    DBone Registered Member

    Joined:
    Nov 24, 2010
    Posts:
    1,041
    Location:
    SoCal USA
    Is "Panda" their free cloud, paid pro cloud, or paid internet security?
     
  16. Noob

    Noob Registered Member

    Joined:
    Nov 6, 2009
    Posts:
    6,468
    I think it's their Panda Antivirus (Most of these are engine tests).
    Not cloud or Internet Security or Global Protection.

    Probably in the dynamic tests they used the suite not sure. :rolleyes:
    You can check what they used in their sites ;)
     
  17. sg09

    sg09 Registered Member

    Joined:
    Jul 11, 2009
    Posts:
    2,713
    Location:
    Kolkata, India
    Great job..:)
     
  18. SM_Unlimited

    SM_Unlimited Registered Member

    Joined:
    Jun 8, 2010
    Posts:
    31
    I dont remember panda cloud being included in any of the 2010 tests. Its generally either their antivirus or the internet security solution being tested and where there are multiple results for different products I went with the highest grade solution.

    But as Noob stated you can check which product is used specifically with each test by visiting the testing sites themselves.
     
  19. Cimmerian

    Cimmerian Registered Member

    Joined:
    Nov 29, 2010
    Posts:
    410
    Location:
    New Jersey
    Really nice job!! Thanks!!
     
  20. EternalFunction

    EternalFunction Registered Member

    Joined:
    Feb 3, 2011
    Posts:
    40
    nice job, now it helps me decides which suite should I buy next after this one expires :)

    So it's true that KIS do have "impact" on system performance especially on the latest version?
     
  21. drhu22

    drhu22 Registered Member

    Joined:
    Aug 21, 2010
    Posts:
    343
    Excellent job!
     
  22. SM_Unlimited

    SM_Unlimited Registered Member

    Joined:
    Jun 8, 2010
    Posts:
    31
    The 8 tests give an indication of how products perform in comparison to each other. Its more likely for the products with a lower score to cause system impact for users but does not nessecarily mean it will.
     
  23. Sher

    Sher Registered Member

    Joined:
    Oct 19, 2005
    Posts:
    366
    Location:
    Pakistan
    F-Secure, FTW!!!
     
  24. Feandur

    Feandur Registered Member

    Joined:
    Jun 15, 2005
    Posts:
    401
    Location:
    Australia
    What's more interesting is how a combination of products can give a synergistic umbrella of protection.

    Looking at the Appendix 1, MRG Flash Test: of the OP........
    http://malwareresearchgroup.com/wp-c...ests-20101.zip

    I notice that a combination of MBAM [real time] plus , say , Avira AV gives pretty much complete coverage of Green Dots(pass) [yes, a few are missed...so maybe that's where PrevX SOL comes in?].

    The important point is....maybe the time has come that we need to start using MBAM real time instead of the conventional wisdom of using it OD.

    Of course, it depends on the individual user Security setup......

    feandur
     
  25. Securon

    Securon Registered Member

    Joined:
    Jan 11, 2009
    Posts:
    1,935
    Location:
    London On
    Good Morning ! A Proverbial Labour of Love...many thanks. Sincerely...Securon
     
Loading...
Thread Status:
Not open for further replies.