PC Mag test ; unexpected result for BD and PCAV

Discussion in 'other anti-virus software' started by clayieee, Jul 8, 2011.

Thread Status:
Not open for further replies.
  1. Baserk

    Baserk Registered Member

    Joined:
    Apr 14, 2008
    Posts:
    1,321
    Location:
    AmstelodamUM
    Does the second part of the malware removal chart show cumulative scores or something else?
    At the bottom it shows; PCAV 1.5 Free Edition compared with other recent and relevant products.

    However, the malware removal scores seem odd.
    Comparing 'PCAV 1.5 Free Edition' and 'ZoneAlarm AntiVirus + Firewall 2012';
    All malware; 91% - 5.9 / Rootkits; 100% - 4.1 / Scareware; 100% - 9.5 (PCAV)
    All malware; 79% - 6.0 / Rootkits; 100% - 6.7 / Scareware; 100% - 7.5 (ZA)

    How in the world can 100% rootkit removal, lead to such different scores? o_O
     
  2. Brandonn2010

    Brandonn2010 Registered Member

    Joined:
    Jan 10, 2011
    Posts:
    1,854
    The only reason Comodo and Outpost did so well is probably because of their HIPS. However, the people testing probably know what to choose for the alerts, while the average user would probably allow everything, leading to lower scores. As far as AdAware, IDK. Even the free version is supposedly better than all the other AVs? Unlikely.

    I don't think I trust their tests much. I mean it says Norman did better than BitDefender lol.

    Also, does the free AdAware have GData's engine? If so I might switch Prevx for it and use it alonside Avast! if that's okay. My teacher uses AVG and AdAware together with no problems.
     
  3. SweX

    SweX Registered Member

    Joined:
    Apr 21, 2007
    Posts:
    6,429
    I would choose Prevx before Ad-aware anyday :thumb:
     
  4. Brandonn2010

    Brandonn2010 Registered Member

    Joined:
    Jan 10, 2011
    Posts:
    1,854
    I would too but I have the free version so it only detects.
     
  5. dschrader

    dschrader AV Expert

    Joined:
    Mar 10, 2009
    Posts:
    54
  6. LODBROK

    LODBROK Guest

    It's (whatever it is) so heavy it made my desktop fold into itself and now all my cables disappear into an infinite negative time singularity.
     
  7. pbust

    pbust AV Expert

    Joined:
    Apr 29, 2009
    Posts:
    1,176
    Location:
    Spain
    While I respect Neil quite a bit and know for a fact he has more experience in malware analysis and AV testing than most "independent labs" out there, the main problem I see with these tests is that the "malware testbed samples" are recycled only once per year. So obviously a product which is tested in month-0 after renewing the testbed is at a serious disadvantage over a product tested at month-10 for example, as the second product will have a 10 month advantage over the first product to come across the sample and add it to its signature database.
     
  8. J_L

    J_L Registered Member

    Joined:
    Nov 6, 2009
    Posts:
    8,738
    It uses Vipre. Your teacher is lucky for now.

    These test are always interesting for me, so thanks.

    Is there one page where all the results and updates are located?
     
  9. Dark Lord

    Dark Lord Registered Member

    Joined:
    Jun 30, 2011
    Posts:
    120

    +1 :thumb: "Pbust" totally agree with you.
    PC Mag test are always like this :mad:
     
  10. clocks

    clocks Registered Member

    Joined:
    Aug 25, 2007
    Posts:
    2,789

    If this is true, these tests are worthless.
     
  11. xandros

    xandros Registered Member

    Joined:
    Oct 30, 2006
    Posts:
    411
    thank you
    but i dont trust this test i dont know why my feeling

    and
    where is norton internet security ?

    where is avira ?

    what about maleware bytes ? why its poor ?
     
  12. m0use0ver

    m0use0ver Registered Member

    Joined:
    Jun 30, 2011
    Posts:
    81
    Sorry to hear you respect a tester that uses a test model which is so fundementally flawed.As posted above how can any results be trusted ?

    He will know that and yet still publishs data into the public realm.

    Sorry this guy might be employed to do a job but he blatently is negligent as a tester:thumbd:
     
  13. J_L

    J_L Registered Member

    Joined:
    Nov 6, 2009
    Posts:
    8,738
    Malwarebytes isn't good against old and infrequent malware.
     
  14. pbust

    pbust AV Expert

    Joined:
    Apr 29, 2009
    Posts:
    1,176
    Location:
    Spain
    Neil has been employing real-world test (aka whole-product test) methodology for many years before AV-Test and AV-Comparatives started doing that. Not only that but he was doing real-world tests as a one-man shop as opposed to AVT or AVC who have 20 to 40 man orgs. I see it more of a limitation of resources than a trust issue. Blame PCMag.com corporate for not providing Neil with more resources. I'm certain if Neil had the same resources as a AVC or AVT his tests would rock.
     
  15. Noob

    Noob Registered Member

    Joined:
    Nov 6, 2009
    Posts:
    6,491
    I always though this :rolleyes:
     
  16. nosirrah

    nosirrah Malware Fighter

    Joined:
    Aug 25, 2006
    Posts:
    561
    Location:
    Cummington MA USA
    If this is true it actually brings up a bigger problem. If I were to take 100 samples today that I can confirm very poor AV detection on and then retest them even 1 week later every big name AV is going to nail them. If there are many AVs in this test not detecting after half a year then these samples are confirmed FPs/legit adware/damaged samples and wont ever be detected for the correct reasons.
     
  17. JoeBlack40

    JoeBlack40 Registered Member

    Joined:
    Apr 1, 2009
    Posts:
    1,584
    Location:
    Romania
    I don't know about Outpost,but don't they tested just Comodo AV and not the whole suite?
     
  18. guest

    guest Guest

    yes you right; Comodo AV is mentioned not the IS, unless they made a typo mistake. anyway Comodo AV is not as bad as before, it is not perfect but becomes more and more efficient.
     
  19. m0use0ver

    m0use0ver Registered Member

    Joined:
    Jun 30, 2011
    Posts:
    81
    I guess but the fact of the matter is Neil is presenting data to the public that has been gathered from a fundamentally flawed test model.

    Please tell me as an industry expert(from Panda AV) whether you consider this an acceptable practice ?

    Just my 2cents but lack of resources does not in anyway justify the presentation of flawed data.If Neil does not have the time/resources or expertise for accurate and unbiased testing he should stick to product reviews and leave testing to the experts.
     
  20. pbust

    pbust AV Expert

    Joined:
    Apr 29, 2009
    Posts:
    1,176
    Location:
    Spain
    I didn't say that, did I?
     
  21. bloggingpig

    bloggingpig Registered Member

    Joined:
    Jun 8, 2010
    Posts:
    7
  22. J_L

    J_L Registered Member

    Joined:
    Nov 6, 2009
    Posts:
    8,738
    Comodo AV still comes with Defense+ unless you disable that.
     
  23. guest

    guest Guest

    yes i know, i thought they disable it if not rather test CIS
     
Thread Status:
Not open for further replies.
  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.