How reliable is the VB100% certification, really?

Discussion in 'other anti-virus software' started by solcroft, Feb 2, 2007.

Thread Status:
Not open for further replies.
  1. solcroft

    solcroft Registered Member

    Joined:
    Jun 1, 2006
    Posts:
    1,639
    As far as I'm aware, the latest Wildlist contains only 775 of the hundreds of thousands of viruses in existence today, and the Wildlist itself is updated monthly. In my previous experiences, I have run across multiple instances of malware that were not listed in the Wildlist. I don't know if anyone has thought of this, but why do so many people hold faith in a testing procedure that employs such a limited (and apparently, for me, incorrect) list of viruses, a list that also holds to such an archaic updating philosophy?
     
  2. dah145

    dah145 Registered Member

    Joined:
    Jul 3, 2006
    Posts:
    262
    Location:
    n/a
    Well, my point of view regarding this VB tests is if an AV can´t pass that test is having serious trouble about detection rates... :rolleyes:
     
  3. solcroft

    solcroft Registered Member

    Joined:
    Jun 1, 2006
    Posts:
    1,639
    I was under the assumption that the VB100% certification was an indication of an antivirus package's ability to protect users in practise. It seems that you're implying it's the minimum level of performance a package should achieve before users consider using it?
     
  4. btman

    btman Registered Member

    Joined:
    Feb 11, 2006
    Posts:
    576
    Who doesn't have one of them now adays?
     
  5. solcroft

    solcroft Registered Member

    Joined:
    Jun 1, 2006
    Posts:
    1,639
    So, in other words, a VB100% certification shouldn't be seriously taken as a sign of a product's real-world performance?
     
  6. dah145

    dah145 Registered Member

    Joined:
    Jul 3, 2006
    Posts:
    262
    Location:
    n/a
    That is what I am talking about... too basic
     
  7. EliteKiller

    EliteKiller Registered Member

    Joined:
    Jan 18, 2007
    Posts:
    1,138
    Location:
    TX
    To the non-savvy individual the VB100% award suggests that the tested products are capable of detecting 100% of all viruses. This is simply not true since no product is able to detect all viruses. These vendors have come to realize the marketing significance of these tests, and the effort they put into their products to pass the VB100 tests may not reflect the effort they put into detecting viruses outside of those included in the VB100 test set. It's possible for an AV product to pass all the VB100 tests but still have mediocre virus detection.

    Those that fail to receive a VB100% should be ashamed.....cough.....MS OneCare. :p
     
  8. Blackcat

    Blackcat Registered Member

    Joined:
    Nov 22, 2002
    Posts:
    4,010
    Location:
    Christchurch, UK
    I would look at a variety of test sites before making any decisions about an AV. Checking the results particularly over the last 12 months or so.

    Overall results over on Virus Bulletin and av-comparatives and Andreas Marx's tests would give a good indication of detection rates.
     
  9. bigc73542

    bigc73542 Retired Moderator

    Joined:
    Sep 21, 2003
    Posts:
    23,873
    Location:
    SW. Oklahoma

    Attached Files:

    Last edited: Feb 2, 2007
  10. MalwareDie

    MalwareDie Registered Member

    Joined:
    Dec 8, 2006
    Posts:
    500
    I think VB100% awards are useless. They miss one sample and they fail while you on other tests they miss far mroe than 1 sample and don't fail. One fp results in a fail. You don't see other tests do that. They can have infected files in their supposed clean sets once in a while and when a specific antivirus picks up the clean file, I think all others that did not detect it should fail, since they missed a sample even if it was in a clean set. VB100% is just for marketing, especially for NOD32, no offense to NOD32, it is an excellent product.
     
  11. C.S.J

    C.S.J Massive Poster

    Joined:
    Oct 16, 2006
    Posts:
    5,029
    Location:
    this forum is biased!
    i like the vb certification,

    i know its not a massive test but it allows no fps and detection of all is needed i think, this test keeps av's on their toes as it is wildly known around the world.
     
  12. rayoflight

    rayoflight Registered Member

    Joined:
    Jun 8, 2006
    Posts:
    180
    I agree.
    And guess who is the main sponsor of VB100% all the time?:)
     
  13. tobacco

    tobacco Frequent Poster

    Joined:
    Nov 7, 2005
    Posts:
    1,497
    Location:
    British Columbia

    Your joking right!

    Correct me if i'm wrong but it's my understanding that AV's that fail that test are given the results of their failures and are then allowed to 'Pay' for retesting and continue 'Paying' for retesting until they pass. If i'm wrong, then i withdraw these statements and apologize. If i'm correct, then this test is completely 'Invalid'!.
     
  14. tobacco

    tobacco Frequent Poster

    Joined:
    Nov 7, 2005
    Posts:
    1,497
    Location:
    British Columbia

    If i understand it correctly, the companies know ahead of time what is on the test list. Man, i wish it was like that back in high school. Would of been no excuse for not acing every exam knowing all the questions ahead of time. Again, another 'Invalid' test:thumbd:
     
  15. solcroft

    solcroft Registered Member

    Joined:
    Jun 1, 2006
    Posts:
    1,639
    Your rumor may not be off the mark by too much. There are products on the WCL Checkmark list that are truly so awful that I simply cannot imagine how they managed a 100% ItW detection - you may just have explained it, maybe.
     
  16. bigc73542

    bigc73542 Retired Moderator

    Joined:
    Sep 21, 2003
    Posts:
    23,873
    Location:
    SW. Oklahoma

    well it would seem that if they use the wild list they would know what is on the test, but there are still av companys that don't pass. And when you were back in school if you would have paid attention to the teacher and done the lessons you would have known what was on the tests.
     
  17. C.S.J

    C.S.J Massive Poster

    Joined:
    Oct 16, 2006
    Posts:
    5,029
    Location:
    this forum is biased!
    yep, i think even f-prot failed the XP one for june06 aswell as trustport and virusbuster.

    its not a guarenteed pass.
     
  18. tobacco

    tobacco Frequent Poster

    Joined:
    Nov 7, 2005
    Posts:
    1,497
    Location:
    British Columbia
    In high school, there was a big difference between knowing what topics the exam covered and the actual exam questions. It is my understanding and again, please correct me if i'm wrong, pertaining to the VB Wildlist, the AV Companies aren't just told the test is on the wildlist, but which malware on the wildlist will be tested. There's a huge difference here.
     
  19. C.S.J

    C.S.J Massive Poster

    Joined:
    Oct 16, 2006
    Posts:
    5,029
    Location:
    this forum is biased!
    hi, so how did f-prot, virusbuster and trustport (norman + bitdefender) fail the last XP test.

    its also good to read how they failed, or... how one passed the test.

    just as its also good to read the reports from av-comparatives too. :D
     
  20. pipester

    pipester Guest

    I have always thought of Virus Bulletin as a well respected and credible publication.
     
  21. solcroft

    solcroft Registered Member

    Joined:
    Jun 1, 2006
    Posts:
    1,639
    I'm not disputing that. But I'm certainly wondering if my interpretation of the VB100% award has been flawed all this while. VB100% pass = excellent antivirus software? Or just simply passable?
     
  22. Blackcat

    Blackcat Registered Member

    Joined:
    Nov 22, 2002
    Posts:
    4,010
    Location:
    Christchurch, UK
    Definitely not. 2 examples. Cat QuickHeal and VirusBuster both have 17 passes on VB but are not thought of as First Class AVs!
     
  23. MalwareDie

    MalwareDie Registered Member

    Joined:
    Dec 8, 2006
    Posts:
    500
    I agree. VB100% awards are junk I would never consider looking at them ever.
     
  24. C.S.J

    C.S.J Massive Poster

    Joined:
    Oct 16, 2006
    Posts:
    5,029
    Location:
    this forum is biased!
    but virusbuster failed the last XP one, as did f-prot and trustport.

    i dont see how f-prot and trustport can fail such an easy test, if it really is that easy?
     
Loading...
Thread Status:
Not open for further replies.