AV-Comparatives Real-World Protection Test of September 2015

Discussion in 'other anti-virus software' started by garrett76, Oct 15, 2015.

  1. garrett76

    garrett76 Registered Member

    Joined:
    Mar 18, 2014
    Posts:
    221
  2. anon

    anon Registered Member

    Joined:
    Dec 27, 2012
    Posts:
    7,983
  3. Nightwalker

    Nightwalker Registered Member

    Joined:
    Nov 7, 2008
    Posts:
    1,387
    Interesting, Windows 10 out-of-box should be even higher (3 ~4 points).
     
  4. Macstorm

    Macstorm Registered Member

    Joined:
    Mar 7, 2005
    Posts:
    2,642
    Location:
    Sneffels volcano
  5. anon

    anon Registered Member

    Joined:
    Dec 27, 2012
    Posts:
    7,983
  6. Krusty

    Krusty Registered Member

    Joined:
    Feb 3, 2012
    Posts:
    10,210
    Location:
    Among the gum trees
  7. anon

    anon Registered Member

    Joined:
    Dec 27, 2012
    Posts:
    7,983
    Last edited: Oct 16, 2015
  8. Krusty

    Krusty Registered Member

    Joined:
    Feb 3, 2012
    Posts:
    10,210
    Location:
    Among the gum trees
    Last edited: Oct 16, 2015
  9. anon

    anon Registered Member

    Joined:
    Dec 27, 2012
    Posts:
    7,983
    AFAIK, the Smart Screen Filter in the browser reacts earlier than Avira (checked with EICAR test file), so I suppose that reacts earlier than WD too.
     
  10. Krusty

    Krusty Registered Member

    Joined:
    Feb 3, 2012
    Posts:
    10,210
    Location:
    Among the gum trees
    ... And in Win 8 and higher WD covers the Desktop / system too, not just IE.
     
  11. Krusty

    Krusty Registered Member

    Joined:
    Feb 3, 2012
    Posts:
    10,210
    Location:
    Among the gum trees
  12. Martin_C

    Martin_C Registered Member

    Joined:
    Dec 4, 2014
    Posts:
    525

    The other report you are referring to in that link, are a static file detection test.

    It's not really showing any of the tested products in a realistic situation.

    Many of the tested products will perform better in a test with samples being executed instead of just scanned, so I don't think the static test is of much value.

    It's just confusing, no matter what vendor a end user might be interested in.

    EDIT : Edited the quoted post, since I accidentally quoted the wrong post the first time. This post now contains the post I was actually replying to.
     
    Last edited: Oct 17, 2015
  13. Martin_C

    Martin_C Registered Member

    Joined:
    Dec 4, 2014
    Posts:
    525
    Krusty13, you are absolutely correct.

    Once again, they test with SmartScreen turned off.

    Ridiculous.

    MSE did good, 93,1%

    But it is without SmartScreen.

    So actually a end user would see a even higher block rate.

    As pointed out before - if the tests are to provide ANY meaningful conclusions, then ALL tested products needs to be tested equally.

    This means either turn the webfilter/reputation database OFF in ALL tested products.

    OR - test MSE/Windows Defender with SmartScreen turned ON.

    -

    It should not be difficult to produce a test that actually provides end users with meaningful results :

    - Test with verified malicious links. (as they did in this test)
    - Execute local samples (instead of just scanning like in the other report)
    - Do test on Windows 10 x64.
    - When Windows Defender are tested, then remember to have SmartScreen ENABLED.
    - Rank according to prevalence.

    And of course with everything, BOTH native and third-party, fully updated and with internet access available, like they did in this test.

    There are not much "real world" about tests that are disabling features that would be enabled in every end users setup in the real world.
     
  14. Minimalist

    Minimalist Registered Member

    Joined:
    Jan 6, 2014
    Posts:
    14,881
    Location:
    Slovenia, EU
  15. garrett76

    garrett76 Registered Member

    Joined:
    Mar 18, 2014
    Posts:
    221
    Wow! Panda blocked 100% from April to September!
     
  16. IBK

    IBK AV Expert

    Joined:
    Dec 22, 2003
    Posts:
    1,886
    Location:
    Innsbruck (Austria)
    never forget to look also at FP rates.
     
  17. RejZoR

    RejZoR Lurker

    Joined:
    May 31, 2004
    Posts:
    6,426
    Unless FP's are on boot system files, they are irrelevant and just a minor inconvenience. I rather have a false positive here and there and no missed malware than zero false positives and bunch of stuff missed all the time.
     
  18. Krusty

    Krusty Registered Member

    Joined:
    Feb 3, 2012
    Posts:
    10,210
    Location:
    Among the gum trees
    This post looks a little out of context because the post I replied to has been removed. It basically said that Smart Screen Filter only protected the browser. That's why I started my post with "Nope".

    Anyway, my point is still valid.
     
  19. 93036

    93036 Registered Member

    Joined:
    Sep 22, 2011
    Posts:
    110
    Are you still using Avast? Wondering if you are still maintaining a optimized configuration file.
     
  20. RejZoR

    RejZoR Lurker

    Joined:
    May 31, 2004
    Posts:
    6,426
    I am. Waiting for avast! 2016 to go final. I'll release a new one for that version.
     
  21. Macstorm

    Macstorm Registered Member

    Joined:
    Mar 7, 2005
    Posts:
    2,642
    Location:
    Sneffels volcano
    Please double check the link I've posted, it's the same real-world test we are discussing in this thread, just the whole 0-100% zoom view for better understanding of the Windows Defender improvements :thumb:
     
  22. Martin_C

    Martin_C Registered Member

    Joined:
    Dec 4, 2014
    Posts:
    525
    Sorry, Macstorm !!

    I hit "reply" on the wrong post yesterday.
    My reply in that post was not a reply to your post of course.
    It was a reply to the post after yours.
    I must have been low on coffee yesterday.

    I have edited the post so it now quotes the correct post.

    Again, sorry about the mistake Macstorm.
     
  23. Lagavulin16

    Lagavulin16 Registered Member

    Joined:
    Nov 26, 2014
    Posts:
    195
    Location:
    Emerald City
    Avira has definitely gotten their game on for some time now. Wish I knew how well the freebie antivirus would fare in these tests compared to the Pro version. Thinking of switching from BD free to Avira since I have serious reservations that BD free is still being updated as a product.
     
  24. anon

    anon Registered Member

    Joined:
    Dec 27, 2012
    Posts:
    7,983
    Both versions use the same engine, xVDF and APC
    https://www.wilderssecurity.com/threads/avira.345492/page-153#post-2533938
     
    Last edited: Oct 17, 2015
  25. pb1

    pb1 Registered Member

    Joined:
    Apr 4, 2014
    Posts:
    1,271
    Location:
    sweden
    There is also a difference in definition update frequency.
     
  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.