Bluepoint 70 Threat Challenge - any comments?

Discussion in 'other anti-virus software' started by Heimdall, Jul 8, 2010.

Thread Status:
Not open for further replies.
  1. Heimdall

    Heimdall Registered Member

    Joined:
    Jul 29, 2009
    Posts:
    176
  2. raven211

    raven211 Registered Member

    Joined:
    May 4, 2005
    Posts:
    2,567
    Interesting and... IMHO expected to see CIS blocking every tested threat till now, BUT it's too bad a lot of malware has not yet been tested against it so far.


    EDIT: Even more interesting, or more like ironic is how for the BPS-machine, there are no pop-ups whatsoever, which IT IS when you actually run BPS yourself. Also, I bet they count every tested malware as successful for the simple reason that if you run into an unknown file, you've the choice to either block or allow, hence they can just choose to block and it's "succeeded" - while in reality it's (quite) obvious that the success rate is dependent on the user's choice, which is solely based on common sense in the actual cases of unknown files.


    My two cents, thanks
     
    Last edited: Jul 8, 2010
  3. Heimdall

    Heimdall Registered Member

    Joined:
    Jul 29, 2009
    Posts:
    176
    There's a description of the event How Does This Site Work?

    I can't understand why Emsisoft Anti-Malware and Panda are doing so poorly. if BPS do have it 'rigged' then surely all other products would be doing equally as bad...
     
  4. IBK

    IBK AV Expert

    Joined:
    Dec 22, 2003
    Posts:
    1,819
    Location:
    Innsbruck (Austria)
    http://www.eset.com/blog/2010/05/27/test-toot-suite-antivirus-vendors-blowing-own-horn
     
  5. trjam

    trjam Registered Member

    Joined:
    Aug 18, 2006
    Posts:
    9,057
    Location:
    North Carolina

    Maybe you just answered half the question.:cautious:
     
  6. Heimdall

    Heimdall Registered Member

    Joined:
    Jul 29, 2009
    Posts:
    176
    So, BPS are totally in cahoots with Comodo and partially in bed with Prevx, but they didn't get off with panda or emsisoft: wacko: :gack: ...so far :cautious:
     
  7. andyman35

    andyman35 Registered Member

    Joined:
    Nov 2, 2007
    Posts:
    2,336
    If anyone is so naive as to believe that Bluepoint won't come out of this test extremely well could they please PM me I'd like to sell them London Bridge.:p
     
  8. Heimdall

    Heimdall Registered Member

    Joined:
    Jul 29, 2009
    Posts:
    176
    I don't think it has anything to do with nativity, I personally think it's a given that BPS will 'win', but that still doesn't explain the behaviour, so far.

    As a mod on the comodo forums andyman35, I would have though you'd be quite pleased with the results, so far.

    I only started the topic to hear peoples thoughts about these 'tests' So, if you think they're completely worthless and biased, say so, if you believe they have any validity at all, say so...

    If enough people believe it's a sham, the tests will stop. Otherwise, observer the results and make useful comments.
     
  9. andyman35

    andyman35 Registered Member

    Joined:
    Nov 2, 2007
    Posts:
    2,336
    Some of the results are bizarre to say the least (Emsi with what 5% detection).It's difficult to have faith in any vendor sponsored tests,maybe everything is completely above board and all the results are quantifiable,if so I'm happy for this old cynic to be proven wrong.:)

    Also there seem to be a lot of technical issues with these tests with some of the products tested,they don't seem to be running at all?
     
  10. Heimdall

    Heimdall Registered Member

    Joined:
    Jul 29, 2009
    Posts:
    176
    The reason for that is give in the link I posted above, here it is again How Does This Site Work?
     
  11. andyman35

    andyman35 Registered Member

    Joined:
    Nov 2, 2007
    Posts:
    2,336
    I've read the information but I'm wondering why Gdata for example doesn't seem to have even started,even accounting for the resetting methodology mentioned.o_O
     
  12. Heimdall

    Heimdall Registered Member

    Joined:
    Jul 29, 2009
    Posts:
    176
    One interesting stat is Prevx has the highest score for 'unique' preventions. Not totally sure what that means. Is it simple better at detecting '0day' threats?
     
  13. Triple Helix

    Triple Helix Webroot Product Advisor

    Joined:
    Nov 20, 2004
    Posts:
    12,011
    Location:
    Ontario, Canada
    WoW there is actually a security product that is 100% effective I'm on the band wagon o_O

    TH
     
  14. andyman35

    andyman35 Registered Member

    Joined:
    Nov 2, 2007
    Posts:
    2,336
    That's how I'd interpret the meaning.That,at least would be no surprise to me given PrevX's huge community database.
    I can't understand the abysmal detection of Panda and Emsi,if those were reflective of real-world performance those companies would be out of business:blink:
     
  15. dr pan k

    dr pan k Registered Member

    Joined:
    Nov 22, 2007
    Posts:
    204
    emsi has the ikarus detection engine which is known to be among the best, as seen on shadow server http://www.shadowserver.org/wiki/pmwiki.php/Stats/VirusYearlyStats

    as for bluepoint, not allowing executables to run probably wont let many infections get through but will give a huge amount of fp. this is not concidered in their test at all but makes the difference between good and bad av products.

    as for selecting what virus they will "use" theres huge space for speculations since they can simply run it first on their software and if blocked then check it with the other vendors. obviously if not blocked by bluepoint chances are they ll never test it anyway....

    i see many reasons why this "test" is biased
     
  16. Heimdall

    Heimdall Registered Member

    Joined:
    Jul 29, 2009
    Posts:
    176
    Not a terribly productive comment really. No security product is 100% effective and that was the whole point of the thread.
     
  17. Triple Helix

    Triple Helix Webroot Product Advisor

    Joined:
    Nov 20, 2004
    Posts:
    12,011
    Location:
    Ontario, Canada
    It's a test by Bluepoint and they so far have 100% or are you seeing something that I'm not? And that is my point no security software will detect 100%!

    TH
     
  18. burebista

    burebista Registered Member

    Joined:
    Mar 4, 2010
    Posts:
    208
    Location:
    Romania
    Any security software could detect 100%. If those samples are carefully chosen. :D
     
  19. Triple Helix

    Triple Helix Webroot Product Advisor

    Joined:
    Nov 20, 2004
    Posts:
    12,011
    Location:
    Ontario, Canada
    Always that's why these type of test are useless, you have to leave it up to the Creditable Security Software Testing Organizations IMO! ;)

    TH
     
    Last edited: Jul 8, 2010
  20. TonyW

    TonyW Registered Member

    Joined:
    Oct 12, 2005
    Posts:
    2,634
    Location:
    UK
    I wouldn't say it's 100% effective given the fact that when I tested it, BPS marked known good files as unknown and, therefore, requested user interaction as to allow or deny. An example is MS Works word processor.

    I understand the reasoning and the options available to the user, but unless I misinterpreted the way it works, I thought some of these known good files would have been whitelisted already as many were.
     
  21. Triple Helix

    Triple Helix Webroot Product Advisor

    Joined:
    Nov 20, 2004
    Posts:
    12,011
    Location:
    Ontario, Canada
    I realize that Tony that why I cleared up comment with 2 more posts above yours! ;)

    TH
     
  22. Heimdall

    Heimdall Registered Member

    Joined:
    Jul 29, 2009
    Posts:
    176
    So do Comodo. Also, as I mentioned in an earlier post, until they reset the VMs and made the test 'live' Prevx, the company for which you are 'Forum Helper' had the highest score for 'unique' preventions...

    As noted in my earlier post, I don't believe any product is capable of providing 100% detection rate and this test is being run by a company with an axe to grind and they will undoubtedly show their product to the wider world with a rose tint.
     
  23. trjam

    trjam Registered Member

    Joined:
    Aug 18, 2006
    Posts:
    9,057
    Location:
    North Carolina
    Looks like Prevx has regained the lead in 'unique' preventions
     
  24. Triple Helix

    Triple Helix Webroot Product Advisor

    Joined:
    Nov 20, 2004
    Posts:
    12,011
    Location:
    Ontario, Canada
    I'm not speaking as a Prevx Forum Helper! I'm speaking for myself as part of the greater security community, I just don't agree with test like these and that's it! I will Quote myself!
    Regards,

    TH
     
    Last edited: Jul 8, 2010
  25. trjam

    trjam Registered Member

    Joined:
    Aug 18, 2006
    Posts:
    9,057
    Location:
    North Carolina
    Comodo had showned an infection and now their score is perfect again.:cautious:
     
Loading...
Thread Status:
Not open for further replies.