AV-Comparatives detection test 2012

Discussion in 'Prevx Releases' started by darts, Apr 16, 2012.

Thread Status:
Not open for further replies.
  1. darts
    Offline

    darts Registered Member

    Ok i hope also because i got a 1 year license so i hope that soon it will be solved and all the test will be positive with a good result.
    But it is strange that in 1 test Webroot scores 98.2% but with lots of false positives and in the monthly result from the same test it scores at about 90% :doubt: .

    Greats,

    darts
  2. STV0726
    Offline

    STV0726 Registered Member

    So without the false positives, they would have scored Advanced+?

    I would normally say "Tough. You scored what you scored. Fix it." Except for the fact that I use Maximized heuristics across the board on all my machines and could count the number of FPs I've had probably on one hand for the last 2.5 years.

    This is why AV-C makes that statement that if you are an advanced user you can ignore the FP considerations.

    Still, I'm not thrilled...

    We're rapidly approaching mid-2012 and if by then the scores aren't flying colors, then that cute, energetic lady named Cat (who I'll admit is very attractive...who knew...security companies have women!) who says Webroot is "revolutionizing the security world" is going to seem a bit like a joke.
  3. kdcdq
    Offline

    kdcdq Registered Member

    Great question. I have been running WSA Essentials on three systems for about a month now, and I have had ONE FP: from MBAM Pro. NO FPs from WSA; zero. There; I said it....:)
  4. TonyW
    Offline

    TonyW Registered Member

    This can be said for the other vendors where FPs were reported. I've hardly heard of many of the packages mentioned let alone have them installed. And all the vendors will have those FPs fixed already anyway.
    Last edited: Apr 16, 2012
  5. TonyW
    Offline

    TonyW Registered Member

    It'd be good to know IBK's answer to this.
  6. Triple Helix
    Offline

    Triple Helix Webroot Product Advisor

    He said yes in post #20!

    TH
  7. TonyW
    Offline

    TonyW Registered Member

    I didn't read that as yes to the elevation question; I read it as an affirmation IBK expects the FPs rate to be fewer next time.
  8. Triple Helix
    Offline

    Triple Helix Webroot Product Advisor

    I didn't say it was clear ;) maybe IBK can expand on that?

    TH
  9. IBK
    Offline

    IBK AV Expert

    not elevated.
    @PrevxHelp: if you have further questions, please ask your colleagues at Webroot, as it was already all communicated/discussed weeks ago.
  10. Legendkiller
    Offline

    Legendkiller Registered Member

    See my POV is pretty clear:
    1.WSA is revolutionary approach to a Security Suite and many may follow suite.
    2.As official prevx support guy has said not all FP maybe of good reputed companies and not everyone gets affected.

    But, bottom line is that ir-respective of build version , this was a officially released product and stability/maturity of a product could be used only if it depends on its impact on system w.r.t cpu usage/compaitibilty with other programs, not with detection of FP's.
  11. Techfox1976
    Offline

    Techfox1976 Registered Member

    (Just as one of those *cough cough* moments... The "support guy" here (PrevxHelp) just happens to be a Vice President at Webroot... if his colleagues didn't forward what was apparently discussed weeks ago, somebody's probably gonna be in trouble. ;) )
  12. TonyW
    Offline

    TonyW Registered Member

    Might be wrong here, but I don't think he is a Vice President at the company; he is, however, most certainly the Senior Software Engineer for the product.
  13. PrevxHelp
    Offline

    PrevxHelp Former Prevx Moderator

    Yes I am - VP Endpoint Solutions Engineering :)
  14. TonyW
    Offline

    TonyW Registered Member

    I do apologise. Couldn't see that listed on the website, but knew you were lead software engineer though. :)
  15. justenough
    Offline

    justenough Registered Member

    I'm more an average user than knowledgeable like a computer tech, so I look at false positive rates first and then detection rates second in order to avoid sorting out problems in other programs caused by fps. Maybe this AV-C test is unfair somehow, but I'm removing WSA-E for now. I like the program and will keep track of this thread and other tests, and will reinstall WSA-E when results look better.

    edit: After doing some reading and thinking, changed my mind about removing WSA-E, see post #51.
    Last edited: Apr 22, 2012
  16. Triple Helix
    Offline

    Triple Helix Webroot Product Advisor

    Congratulations Joe! :thumb:

    Daniel ;)
  17. Triple Helix
    Offline

    Triple Helix Webroot Product Advisor

  18. STV0726
    Offline

    STV0726 Registered Member

    At least Webroot treats a less than favorable test score as an opportunity to improve...

    Some companies *cough* MSE take it as...well not sure why they even participate in tests when they have MCCs on their forums making claims that AV-Comparatives and AV-TEST are not effective ways to review AVs and that MSE is inevitably the best. Give me a break.
  19. TonyW
    Offline

    TonyW Registered Member

    If the FP rate is an issue for you, I suggest what you really should be asking is "has this product produced FPs for me?". If you've experienced a copious number of FPs as apparently seen in this test, then I agree, there is a problem which needs looking at, but if you've only seen few FPs or none at all then it's no reason to ditch WSA-E just because of one apparent poor FP test result. Remember that test was done with build 8.0.1.95 and we're told the issues have long since been corrected. We're now at v8.0.1.165 and the product continues to evolve. :)
  20. Techfox1976
    Offline

    Techfox1976 Registered Member

    I saw a weird set of FPs around the time that test was run. Support indicated it was a hiccup in the system that was corrected really fast. Sure enough, in the time it took me to reach support and be told to restore everything that was detected that day (nothing was removed, since I knew they were FPs), then rescan, the issue was fixed. No waiting for the next day or even a dozen hours for a definition fix. I haven't seen any similar problems since.
  21. Thankful
    Offline

    Thankful Registered Member

    A problem for Webroot is the coming Retrospective Test will use the March 2012 False Positive Test results and will again be penalized for the high number of FPs.
  22. Technical
    Offline

    Technical Registered Member

  23. justenough
    Offline

    justenough Registered Member

    TonyW, your question might be 'Has this product produced FPs for me?', but my question is 'How does this product compare to others as to the likelihood of getting a FP?'

    edit: TonyW, you made a good point, sorry if my reply seemed curt. WSA-E is back on my computer.
    Last edited: Apr 22, 2012
  24. IBK
    Offline

    IBK AV Expert

    @Thankful: Webroot will not be included in that test, as we offered an opt-out at begin of the year. It would anyway not make sense to test a pure-cloud product like Webroot in that test, as it would not detect any of the samples (and also zero FPs) if there is no connection to the cloud. This year that test includes also a behavioral part where remaining samples are executed (to evaluate e.g. the behavior-blocker etc.).
  25. STV0726
    Offline

    STV0726 Registered Member

    WSA isn't really a pure cloud product, not at least by my understanding.

    It is also an advanced behavior blocker, especially in offline mode.

    As long as samples are executed and we're not just talking about right-click scanning a folder full of dormant malware, WSA should catch it fine.
Thread Status:
Not open for further replies.