AV-Comparatives Real-World Protection Test March 2014

Discussion in 'other anti-virus software' started by FleischmannTV, Apr 16, 2014.

Thread Status:
Not open for further replies.
  1. RejZoR

    RejZoR Lurker

    Joined:
    May 31, 2004
    Posts:
    6,426
    It's also smart to switch charts to 0-100% mode, otherwise even 3% differences look enormous.
     
  2. marcuskng

    marcuskng AV Expert

    Joined:
    Feb 19, 2010
    Posts:
    74
    We've sent them a mail about fixing the sorting order of the charts. If you look at the products more on the right side of the charts you can see that the "user dependent detection" is not having any influence on the sorting order there.
    You can compare that for example to the december chart from last year.

    As such we believe it is just problem in the displaying of the chart which, unfortunately for us, gets misinterpreted by websites and press such as the one quoted in this thread.
     
  3. IBK

    IBK AV Expert

    Joined:
    Dec 22, 2003
    Posts:
    1,886
    Location:
    Innsbruck (Austria)
    Hi, it has been fixed, the ranking is correct, it was just again the rounding which contructed the chart with a lower bar.
     
  4. marcuskng

    marcuskng AV Expert

    Joined:
    Feb 19, 2010
    Posts:
    74
    IBK: just wanted to post the clarification myself after getting your mail, you were a wee bit faster ;)
     
  5. Minimalist

    Minimalist Registered Member

    Joined:
    Jan 6, 2014
    Posts:
    14,883
    Location:
    Slovenia, EU
    Yes, that gives correct view on detection rate comparison. Otherwise differences are blown out of proportion.

    hqsec
     
  6. Blackcat

    Blackcat Registered Member

    Joined:
    Nov 22, 2002
    Posts:
    4,024
    Location:
    Christchurch, UK
    But since 88.4% is the out-of-box protection level it could be argued that 80-100% is the best comparison zoom mode!
     
  7. smage

    smage Registered Member

    Joined:
    Sep 13, 2008
    Posts:
    378
    Hmm quite some false positives for Trend Micro but overall results are ok.
     
  8. RejZoR

    RejZoR Lurker

    Joined:
    May 31, 2004
    Posts:
    6,426
    It's about perception of charts. with 80-100% scaling, 2% difference looks like one product beats the other by one quarter... but in the end, it's still just 2%.
     
  9. Antimalware18

    Antimalware18 Registered Member

    Joined:
    Dec 12, 2008
    Posts:
    417
    Great job panda :thumb:
     
  10. mattdocs12345

    mattdocs12345 Registered Member

    Joined:
    Mar 23, 2013
    Posts:
    1,892
    Location:
    US
    I was actually surprised how well panda did. I was considering replacing Forti with Panda but I found both to be equally slow ;)

    That's why for me features such as false positives and IP/Web/HTTP blocking is more important. Forti does the latter very very well.
     
  11. Blackcat

    Blackcat Registered Member

    Joined:
    Nov 22, 2002
    Posts:
    4,024
    Location:
    Christchurch, UK
    Surprised how poorly Lavasoft's Ad-Aware did compared to the other AVs with the BitDefender engine such as Qihoo and BullGuard.

    So you need more than signatures for this test.
     
  12. RejZoR

    RejZoR Lurker

    Joined:
    May 31, 2004
    Posts:
    6,426
    Qihoo has proactive defense and quite sensitive QVM heuristics engine. Ad-aware has nothing of this.
     
  13. FleischmannTV

    FleischmannTV Registered Member

    Joined:
    Apr 7, 2013
    Posts:
    1,093
    Location:
    Germany
    You have to consider that at this test a product can achieve a blocked result merely because it blocks access to the website from where the malware originates (IIRC). The very same malware might not be detected if it simply came from another website, a USB stick or via e-mail. In these cases Bitdefender could very well have the same lesser results as its competitors with the same engine.
     
  14. ance

    ance formerly: fmon

    Joined:
    May 5, 2013
    Posts:
    1,359
    Ad-Aware is only number one in their own inhouse tests. :D ;)
     
  15. KaptainBug

    KaptainBug Registered Member

    Joined:
    Dec 26, 2013
    Posts:
    480
  16. Blackcat

    Blackcat Registered Member

    Joined:
    Nov 22, 2002
    Posts:
    4,024
    Location:
    Christchurch, UK
    Maybe best to start a new thread with this test? Lots of false positives for Avast and Baidu.
     
  17. Charyb

    Charyb Registered Member

    Joined:
    Jan 16, 2013
    Posts:
    679
    Last edited: Apr 18, 2014
  18. Minimalist

    Minimalist Registered Member

    Joined:
    Jan 6, 2014
    Posts:
    14,883
    Location:
    Slovenia, EU
    Wow that's a lot of FPs. With so many wrong detections those AVs can do more harm to my system than malware. :doubt:

    hqsec
     
  19. FOXP2

    FOXP2 Guest

  20. Brandonn2010

    Brandonn2010 Registered Member

    Joined:
    Jan 10, 2011
    Posts:
    1,854
    Darnit Avast! First the disappointing AV-Test results, then the disappointing AV-Comparatives Real World results, now third-to-last in File Detection, with a very high number of FPs. Avast! needs to get it's "stuff" together!
     
  21. FOXP2

    FOXP2 Guest

    If AVC skipped the Lavasoft Security Toolbar during the install (And how would we know?), then Ad-Aware Free would be without malicious URL filtering which would undoubtedly impact these results. (The Lavasoft paid versions don't need the toolbar and use Bitdefender's Web protection.) As such, A-AFree's poor showing vs, for example, BD Internet Security's full blown security suite is most likely due to the fact BDIS is a... um, well, full blown security suite.

    Ad-Aware Free's 2.3% Blocked differential in comparison to BullGuard's full-blown Internet Security suite is largely determined by BGIS's 4.8% user dependent "blocking."

    Not excuses, just observations. A free app could have done better.

    Somewhere in the 1843+ postings here on Qihoo, wasn't it reported BD is off by default? AV-C tests with defaults. So...??

    Free did superbly in VB100's December test...
    http://lavasoft.com/products/compare.php
    and it will be interesting to see if a repeat performance shows up in the upcoming April Comparative.

    Cheers.
     
  22. RejZoR

    RejZoR Lurker

    Joined:
    May 31, 2004
    Posts:
    6,426
    Despite avast! having so many FP's, i haven't had many in all the time of Evo-gen existence. In fact it was only one and i shuffle a lot of apps through my PC. So, it's not even nearly as bad as it might look in the test.
     
  23. IBK

    IBK AV Expert

    Joined:
    Dec 22, 2003
    Posts:
    1,886
    Location:
    Innsbruck (Austria)
    The toolbar of Lavasoft is installed and used.
    If you want to look at the detection engine only (like in the VirusBulletin tests), you can refer to the File Detection test; in that, all products relying on the Bitdefender engine score similar.
     
  24. anon

    anon Registered Member

    Joined:
    Dec 27, 2012
    Posts:
    8,008
  25. FOXP2

    FOXP2 Guest

    Thank you! Would it be that fate had decreed that Ad-Aware Personal (at the least) or Personal Security had been tested. :(
     
Thread Status:
Not open for further replies.
  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.