MRG "latest variant" tests.

Discussion in 'other anti-malware software' started by LODBROK, Sep 5, 2010.

Thread Status:
Not open for further replies.
  1. LODBROK

    LODBROK Guest

    MRG "latest variant" Flash Tests.

    Very interesting...
    -http://malwareresearchgroup.com/category/malwareproducttesting/-

    So far:
    •Emsisoft AM is the lone app in passing them all. Future test results will be intriguing if MRG continues.
    •Nothing new revealed IMHO... zero day detection is hit or miss but it's reassuring most apps catch up quickly.
    •That Panda Cloud and Immunet aren't tested is unexpected considering The Cloud is the tech that's supposed to bridge the gap between zero day and traditional AV/AM/AS detections.
    •And a keylogger test excluding Zemana and SpyShelter??

    Anyhow, plaudits to MRG for a first rate effort, critiques aside. :thumb:
     
    Last edited by a moderator: Sep 6, 2010
  2. Rampastein

    Rampastein Registered Member

    Joined:
    Oct 16, 2009
    Posts:
    290
    Doesn't really tell anything new at the moment, just that basic AV products detect some zero-day malware samples and miss others. Especially with 4 samples, where the possible behaviour blockers don't really tell their effectiveness.
     
  3. slider916

    slider916 Registered Member

    Joined:
    Aug 4, 2010
    Posts:
    58
    BluePoint did very well too.
     
  4. LODBROK

    LODBROK Guest

    @slider916: You're right. I failed to note BluePoint Security. As of today both BPS and ESAM are five for five.

    That's a brilliant observation!! No one else could possibly ever conclude that. Oh wait. I did: "Nothing new revealed IMHO... zero day detection is hit or miss" :cautious:

    The tests target the most malicious and morphic zero day threats. One at a time. When they show up. The number of samples is irrelevant. This info you didn't read at MRG explains their model: In these tests we will be using samples taken directly from our honeypots. In these tests we will only use the most prolific and relevant malware samples. Hope that helps. But you should read the whole thing over there if you still don't get it.
     
    Last edited by a moderator: Sep 7, 2010
  5. Mongol

    Mongol Registered Member

    Joined:
    Jul 24, 2004
    Posts:
    1,581
    Location:
    Houston, TX
    Avira is holding up very well passing 5 of 6 tests since Sept 1st...:D
     
  6. LODBROK

    LODBROK Guest

    Actually Avira Premium passed 3 of the 5 zero day tests. I'm not counting the 24-hour-later results. For that only the failures matter. :)
     
  7. cruelsister

    cruelsister Registered Member

    Joined:
    Nov 6, 2007
    Posts:
    973
    Location:
    Paris
    They've added 2 more- the Neeris worm and Vlogger trojan. I'm really becoming quickly fond of these flash tests. It seems that results are creating 2 separate groups of "the Usual Suspects": one group getting it consistently right and another sadly being consistently wrong. No matter what criticisms may arise of the methodology, I'd rather use a product from the former group than the latter.
     
  8. shadek

    shadek Registered Member

    Joined:
    Feb 26, 2008
    Posts:
    2,363
    Location:
    Sweden
    Emsisoft is acing all the tests. AV-C tests are ranking it really, really high as well as VB100.
     
  9. tobacco

    tobacco Frequent Poster

    Joined:
    Nov 7, 2005
    Posts:
    1,497
    Location:
    British Columbia
    Man, does ESET ever suck on these tests :ouch:
     
  10. clocks

    clocks Registered Member

    Joined:
    Aug 25, 2007
    Posts:
    2,559
    Maybe I missed it, but is there one table that summarizes the results?
     
  11. markusg

    markusg Registered Member

    Joined:
    Jun 10, 2009
    Posts:
    248
    no drweb in the last test?
    conrats to emsi, good results so far.
     
  12. cruelsister

    cruelsister Registered Member

    Joined:
    Nov 6, 2007
    Posts:
    973
    Location:
    Paris
    I'm getting happier and happier with the recent Emsisoft license giveaway at CoU!
     
  13. Sveta MRG

    Sveta MRG Registered Member

    Joined:
    Aug 16, 2009
    Posts:
    207
    Just to let everybody know, the list of participants is final as of today. This project will continue as we have a great demand for it by both users and vendors.

    Each month we will publish a PDF report with all the statistics, results ect.

    Regards,
    Sveta
     
  14. begemot64

    begemot64 Registered Member

    Joined:
    Jul 28, 2010
    Posts:
    71
    And perhaps complete methodology, inluding on the tests you have been carrying out in recent days? If you claim to be a serious testing organisation, you should have done this - simply publishing some "results" is not good enough.
     
  15. Sveta MRG

    Sveta MRG Registered Member

    Joined:
    Aug 16, 2009
    Posts:
    207
    Everything was published, you have the methodology on our website and forums.

    Regards,
    Sveta
     
  16. LODBROK

    LODBROK Guest

    Until MRG posts up the monthly PDF, there's a user at their forum who's keeping a spread sheet in google docs.
    The link is in the 2nd posting in the thread:
    -http://forums.malwareresearchgroup.com/viewtopic.php?f=32&t=451-
    He claims he'll keep it up to date.
     
Loading...
Thread Status:
Not open for further replies.