AV-Comparatives June (May 2007) Results (Retrospective / Proactive Tests)

Discussion in 'other anti-virus software' started by AshG, May 29, 2007.

Thread Status:
Not open for further replies.
Page 6 of 12
  1. Tweakie

    Tweakie Registered Member

    Joined:
    Feb 28, 2004
    Posts:
    90
    Location:
    E.U.
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    That is an interesting information by itself :) It may mean that f-secure is using the same virtual machine than Norman (or a VM derived from Norman's sandbox) but its own set of heuristic criteria.

    Percentages are small, but you should remember that nowadays most computers
    are exposed to a vast amount of executable files/word documents/scripts/etc, and that most users have to rely on their AV decision. And these computers are exposed to much more legit files than to malwares.

    Most users will not encounter more than 10 different malwares per year. But they may use more than 200 different programs/documents/scripts in the same period.

    If an AV has an overall detection rate of 99%, and considering that the malware they face are taken at random from the pool of existing malwares (that assumption is clearly wrong), the probability they get infected is lower than 10%.

    Now, if the same AV has a false positive rate of 0.1%. Under the same assumption of "perfect sampling", the probability that they will hit at least one false positive is higher than 18%.

    Since most users tend to panic when they think they are infected by a virus (think to jdbmgr.exe), it is very important to minimize their occurence.

    That's why I fully support the decision of IBK to consider it as an important parameter for evaluating the proactive detection of antiviruses.
     
    Tweakie, May 31, 2007
    #126
  2. MalwareDie

    MalwareDie Registered Member

    Joined:
    Dec 8, 2006
    Posts:
    500
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    IBk, will you continue testing EScan if it gets the exact saem score as Kaspersky in everything?
     
    MalwareDie, May 31, 2007
    #127
  3. IBK

    IBK AV Expert

    Joined:
    Dec 22, 2003
    Posts:
    1,886
    Location:
    Innsbruck (Austria)
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    i am not sure yet.
     
    IBK, May 31, 2007
    #128
  4. C.S.J

    C.S.J Massive Poster

    Joined:
    Oct 16, 2006
    Posts:
    5,029
    Location:
    this forum is biased!
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    i was wrong with my FP post, i deleted it and corrected it.

    IBK cleared up the matter
     
    C.S.J, May 31, 2007
    #129
  5. MalwareDie

    MalwareDie Registered Member

    Joined:
    Dec 8, 2006
    Posts:
    500
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)


    yeah me too. I dont even think most users know that their AV can do something wrong and wrongly detect something.
     
    MalwareDie, May 31, 2007
    #130
  6. lucas1985

    lucas1985 Retired Moderator

    Joined:
    Nov 9, 2006
    Posts:
    4,047
    Location:
    France, May 1968
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    IBK,
    Could you answer this question?
    Thanks.
     
    lucas1985, May 31, 2007
    #131
  7. IBK

    IBK AV Expert

    Joined:
    Dec 22, 2003
    Posts:
    1,886
    Location:
    Innsbruck (Austria)
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    someone from fprot may better answer your question. i only know that it was an error of the engine which did not gave a name to the detections and that it has been corrected now.
     
    IBK, May 31, 2007
    #132
  8. MalwareDie

    MalwareDie Registered Member

    Joined:
    Dec 8, 2006
    Posts:
    500
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    IBK how many times does an AV have to detect a polymorphic virus to pass the polymorphic test
     
    MalwareDie, May 31, 2007
    #133
  9. IBK

    IBK AV Expert

    Joined:
    Dec 22, 2003
    Posts:
    1,886
    Location:
    Innsbruck (Austria)
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    it has to detect 100%. usually 2000 replicants are used for each polymorphic sample.
     
    IBK, May 31, 2007
    #134
  10. Tweakie

    Tweakie Registered Member

    Joined:
    Feb 28, 2004
    Posts:
    90
    Location:
    E.U.
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    ...and it has to detect it by signature (exact name). That's the only point that I find debatable... ;)
     
    Tweakie, May 31, 2007
    #135
  11. The Hammer

    The Hammer Registered Member

    Joined:
    May 12, 2005
    Posts:
    5,752
    Location:
    Toronto Canada
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    You don't get a Virus Bulletin award if you have false positives. So why so much consternation about FP's here?
     
    The Hammer, May 31, 2007
    #136
  12. Mele20

    Mele20 Former Poster

    Joined:
    Apr 29, 2002
    Posts:
    2,495
    Location:
    Hilo, Hawaii
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    I'm not surprised at Avira but I'm disappointed. I no longer run Avira in real time partly because I hate FP's. I had to deal with them way too frequently with Avira. I also don't run full scans with Avira for the same reason. I only have hueristics set at medium. I can't imagine anyone enduring all the FP's you would get with it set to high. I just use Avira as a command line scanner. I still could encounter FP's that way but not as likely. Maybe I should get Norton again. They almost never have FP's. High FP's does jade the user and that, I think, is the most dangerous thing about FP's.
     
    Mele20, May 31, 2007
    #137
  13. TonyW

    TonyW Registered Member

    Joined:
    Oct 12, 2005
    Posts:
    2,741
    Location:
    UK
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    IBK has said he's already done the test for Kaspersky v7, and the report is ready. The decision of when it gets published rests with KL.
     
    TonyW, May 31, 2007
    #138
  14. WSFuser

    WSFuser Registered Member

    Joined:
    Oct 7, 2004
    Posts:
    10,639
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    Seeing teh results, Im very impressed with NOD32. As usual, great detection and few false positives :thumb:

    Meanwhile I eagerly await the results for KAV 7.
     
    WSFuser, May 31, 2007
    #139
  15. EASTER.2010

    EASTER.2010 Guest

    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    Always speculation, likely for fanfare anticipation. Who knows.

    But let's read some real up-to-date results of Kaspersky's latest review. If surpasses even KIS6's then we can expect a high honor in them yet again.

    KIS6 is done for my machines what NO single AV ever has before, and they weren't even Suites like the recent KIS; that is run reliably and perfectly stable emphasizing with the greatest of degree, STABLE, without always fudging something up or slowing down matters to a slow crawl like so many before it has.

    Well? What's the verdict?
     
    EASTER.2010, Jun 1, 2007
    #140
  16. The_Duality

    The_Duality Registered Member

    Joined:
    Apr 3, 2007
    Posts:
    276
    Location:
    Liverpool, UK
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    I think the results are quite good. NOD32 has done well again, and it looks like it wont be long until it is flavor of the week again... :p

    Now all i need to do is fight the urge to change AV based on test results... again... ;)

    I too shall look forward to KAV 7's heuristics test. It should be interesting to see how it performs. Maybe those low proactive detection scores will be a thing of the past. We shall wait and see :)
     
    The_Duality, Jun 1, 2007
    #141
  17. FRug

    FRug Registered Member

    Joined:
    Feb 7, 2006
    Posts:
    309
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    The Hammer: AFAIK VB doesn't count suspicious detections (heuristics are 'suspicious") as false positives. They only count non-suspicious (exact) detections as detections as well, so having good heuristics has no effect on VB results.


    I'm quoting the VB site here:
     
    FRug, Jun 1, 2007
    #142
  18. The Hammer

    The Hammer Registered Member

    Joined:
    May 12, 2005
    Posts:
    5,752
    Location:
    Toronto Canada
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    Thank you.
     
    The Hammer, Jun 1, 2007
    #143
  19. IBK

    IBK AV Expert

    Joined:
    Dec 22, 2003
    Posts:
    1,886
    Location:
    Innsbruck (Austria)
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    KAV 7 report is released.
     
    IBK, Jun 1, 2007
    #144
  20. fax

    fax Registered Member

    Joined:
    May 30, 2005
    Posts:
    3,898
    Location:
    localhost
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    Thank you!

    Not revolutionary but an improvement as compared to KAV 6.
    Probably it will need some tuning up before showing maximum strength...

    Fax
     
    fax, Jun 1, 2007
    #145
  21. trjam

    trjam Registered Member

    Joined:
    Aug 18, 2006
    Posts:
    9,102
    Location:
    North Carolina USA
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    well actually it did better then I thought it would. So with some time it may make things very interesting.
     
    trjam, Jun 1, 2007
    #146
  22. trjam

    trjam Registered Member

    Joined:
    Aug 18, 2006
    Posts:
    9,102
    Location:
    North Carolina USA
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    Wow, I just saw the results and Eset did it again. Great work guys and keep it up. Glad to be part of such a great team.:)
     
    trjam, Jun 1, 2007
    #147
  23. C.S.J

    C.S.J Massive Poster

    Joined:
    Oct 16, 2006
    Posts:
    5,029
    Location:
    this forum is biased!
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    im dissappointed with k7 heuristics, all the hype and glamour of these heuristics and its just 35% ?

    i was expecting 50+, i really was.
     
    C.S.J, Jun 1, 2007
    #148
  24. aigle

    aigle Registered Member

    Joined:
    Dec 14, 2005
    Posts:
    11,164
    Location:
    UK / Pakistan
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    BTW IBK said that he is going to test more AVS with proactive detection. What are other AVs having proactive detection in addition to KAV?
     
    aigle, Jun 1, 2007
    #149
  25. The Hammer

    The Hammer Registered Member

    Joined:
    May 12, 2005
    Posts:
    5,752
    Location:
    Toronto Canada
    Re: AV-Comparatives June Results (Retrospective / Proactive Tests)

    It was still better than a lot of others.
     
    The Hammer, Jun 1, 2007
    #150
Page 6 of 12
Thread Status:
Not open for further replies.
  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Accept Learn More...