Roundup of Antivirus Tests 2010

Discussion in 'other anti-virus software' started by SM_Unlimited, Nov 9, 2010.

Thread Status:
Not open for further replies.
  1. SM_Unlimited

    SM_Unlimited Registered Member

    Joined:
    Jun 8, 2010
    Posts:
    31
    Hey all. I have created a roundup of all the testing results throughout the year to find the overall detection capabilities of antivirus products. Considering others may find these statistics useful in general i have decided to share. Trusty excel skills were in use to find out just for my own purposes to see how my own current choice in antivirus software is holding up.

    Current testing results used from the year so far include:
    AV-Test Quarterly Tests: http://www.av-test.org/certifications.php
    AV-Comparatives: http://www.av-comparatives.org
    VBulletin RAP (April - October): http://www.virusbtn.com/vb100/rap-index.xml, http://www.virusbtn.com/virusbulletin/archive/2010/04/vb201004-comparative
    Ekaitsee Dynamic Test: http://www.ekaitse.ee/EKAITSE_TORJETEST_2010_ENG.pdf
    Dennis Technology Labs: http://www.dennistechnologylabs.com/reports/s/a-m/symantec/DTL_PCVP2011_SYMC.pdf
    Symantec Commission AV-Test: http://community.norton.com/norton/...feedback/3371/1/Real_World_Testing_Report.pdf, http://community.norton.com/norton/...eedback/3371/2/Remediation_Testing_Report.pdf
    SL.Portal Malware Test: http://translate.google.se/translat...rose-sl-portal-malware-test-2010/&sl=de&tl=en
    PC Security Labs:http://www.pcsecuritylabs.net/document/report/PCSL_Total_Protection_Test_July_2010_EN.pdf
    PCMag 2011: http://www.pcmag.com/article2/0,2817,2372369,00.asp
    Raymond Performance Tests: http://www.raymond.cc/antivirus/
    (Feel free to mention any others I may have missed as I want to get as many total samples across the categories as possible)

    I have only included results for 14 products (assume Internet Security/Paid versions). I may add more if i get time but these were the ones I was most interested in. I'll also update as the last tests for the year are published by vendors and independents and provide access to the spreadsheet I used to get the overall 2010 stats, but until then these are what the results are looking like so far.

    AntivirusTestRoundup1.PNG
    AntivirusTestRoundup2.PNG

    Summary Information:
    Amber highlighted results represent this product was not tested in all the test sets and is potentially an estimate. The result will be normalised based on the results of the other products in a test set so it is a reliable score, just not 100% guaranteed to have that exact score. For such estimates a third column lists the % of samples out of the total that have been estimated.

    The results are categorised into: On Demand, Retrospective, Dynamic Real World, Removal, Performance and False positives.

    On Demand: Raw detection capabilities with latest definitions (signatures only)
    Retrospective: Capabilities of heuristics and generic signatures against new unknown malware.
    Dynamic: Real world protection capabilities using all components of the software / protection against 0 day threats.
    Removal: Effectiveness at cleaning a system from malware, the higher the score the better the product is at disinfection and removal of malware trace elements without damaging the system in the process.
    Performance score (higher is better): All performance results are normalised to use the same AV-Comparatives scale (and takes scanning speed into account)
    False Positives: Mean false positives across all tests with such information available. The results help to show which products are more prone to false positives.
     
    Last edited: Nov 14, 2010
  2. trjam

    trjam Registered Member

    Joined:
    Aug 18, 2006
    Posts:
    9,057
    Location:
    North Carolina
    I am getting real ~ Snipped as per TOS ~ with Avasts ability on retrospective detection. Eset still is in the house with me.;)


    kudos to GData and Norton. Thank you for posting this.
     
    Last edited by a moderator: Nov 10, 2010
  3. J_L

    J_L Registered Member

    Joined:
    Nov 6, 2009
    Posts:
    8,516
    Thanks for creating these spreadsheets, the results looks quite interesting.
     
  4. ExtremeGamerBR

    ExtremeGamerBR Registered Member

    Joined:
    Aug 3, 2010
    Posts:
    1,115
    Very good summary. :thumb:

    It seems that Symantec is doing very well in the current tests, also liked the performance of McAfee, Avast! and GDATA.
     
  5. Noob

    Noob Registered Member

    Joined:
    Nov 6, 2009
    Posts:
    6,468
    Thumbs Up for the top performers!
     
  6. RejZoR

    RejZoR Registered Member

    Joined:
    May 31, 2004
    Posts:
    6,426
    McAfee is spelled wrong. Performance chart looks weird with avast! down below. Looks weird. Others are pretty much as expected.
     
  7. Montecristo

    Montecristo Registered Member

    Joined:
    Dec 23, 2008
    Posts:
    72
    Thank you for the summary
     
  8. dr pan k

    dr pan k Registered Member

    Joined:
    Nov 22, 2007
    Posts:
    204
    same here.

    nice post
     
  9. Sherlock_Holmes

    Sherlock_Holmes Registered Member

    Joined:
    Mar 21, 2010
    Posts:
    1,447
    Location:
    Mumbai
    Avira top performer in free ones :thumb:
     
  10. Saraceno

    Saraceno Registered Member

    Joined:
    Mar 24, 2008
    Posts:
    2,404
  11. InfinityAz

    InfinityAz Registered Member

    Joined:
    Jul 23, 2005
    Posts:
    828
    Location:
    Arizona
    SM_Unlimited,

    Nice job compiling that!
     
  12. century

    century Registered Member

    Joined:
    Oct 13, 2007
    Posts:
    92
    You have done a commendable job. Please keep it up.
    BTW, is it possible to give the charts in two rows so that fonts become larger?
    Thank you.
     
  13. Dundertaker

    Dundertaker Registered Member

    Joined:
    Oct 17, 2009
    Posts:
    385
    Location:
    Land of the Mer Lion
    Very nice job there!
     
  14. Nevis

    Nevis Registered Member

    Joined:
    Aug 28, 2010
    Posts:
    786
    Location:
    255.255.255.255
    good job and nice summary

    happy with norton :)
     
  15. SM_Unlimited

    SM_Unlimited Registered Member

    Joined:
    Jun 8, 2010
    Posts:
    31
    At least you didn't notice my spelling of Heuristics' :ouch:

    Avasts performance is not actually that low as it may appear at first glance. A score in the 170's is akin to very fast performance, so all products above 170 should in theory be very light on the system.

    Thanks for the links, I will have a look at these :D

    I will try to remember to improve readability whenever I next update the results.
     
  16. Sherlock_Holmes

    Sherlock_Holmes Registered Member

    Joined:
    Mar 21, 2010
    Posts:
    1,447
    Location:
    Mumbai
    Exellent job :thumb:
     
  17. toxinon12345

    toxinon12345 Registered Member

    Joined:
    Sep 8, 2010
    Posts:
    1,200
    Location:
    Managua, Nicaragua
    Hello Friend,

    Kaspersky --> 51 false positives in AV-Comparatives 2010
    February 2010 - 5 FP
    August 2010 - 46 FP

    Please correct / update your report.

    Regards.
     
  18. SM_Unlimited

    SM_Unlimited Registered Member

    Joined:
    Jun 8, 2010
    Posts:
    31
    @toxinon12345:

    If I wanted to see just the results of just AV-Comparatives then yes I would be wrong.

    The results are the mean average of false positives across all the tests with false positive information available.
     
  19. SIR****TMG

    SIR****TMG Registered Member

    Joined:
    May 31, 2004
    Posts:
    757
    Exellent job and Thank You. :thumb:
     
  20. Sjoeii

    Sjoeii Registered Member

    Joined:
    Aug 26, 2006
    Posts:
    1,240
    Location:
    52?18'51.59"N + 4?56'32.13"O
    What is it you want to tell?
     
  21. shadek

    shadek Registered Member

    Joined:
    Feb 26, 2008
    Posts:
    2,363
    Location:
    Sweden
    I think Norton '11-edition is one of the best Anti-Malware applications ever created. With its Sonar and Insight it's freaking awesome. I can't believe how light it is. Hell, even my netbook with an Atom CPU is fast with NAV 2011 installed on it. Only reason I don't use it is that there are even lighter alternatives which I prefer in front of even better detection rates.
     
  22. toxinon12345

    toxinon12345 Registered Member

    Joined:
    Sep 8, 2010
    Posts:
    1,200
    Location:
    Managua, Nicaragua
    Thanks for your reply SM_Unlimited :p
     
  23. Nevis

    Nevis Registered Member

    Joined:
    Aug 28, 2010
    Posts:
    786
    Location:
    255.255.255.255
    what alternatives are u talking abt ?
     
  24. shadek

    shadek Registered Member

    Joined:
    Feb 26, 2008
    Posts:
    2,363
    Location:
    Sweden
    Prevx - there is no lighter product on the market with the great protection it provides. However, NAV 2011 with its Insight & Sonar is a bit better when it comes to detection for malware. I do think Prevx is better at cleanup though.
     
  25. bellgamin

    bellgamin Very Frequent Poster

    Joined:
    Aug 1, 2002
    Posts:
    5,648
    Location:
    Hawaii
    Couple of questions:

    1- Does Prevx provide protection when the user is offline?

    2- How do you define "light"? Cpu? I/O? RAM use? Page file use? Or.....?
     
Loading...
Thread Status:
Not open for further replies.