New Virusinfo test

Discussion in 'other anti-virus software' started by Sjoeii, Dec 6, 2007.

Thread Status:
Not open for further replies.
  1. trjam

    trjam Registered Member

    Joined:
    Aug 18, 2006
    Posts:
    9,102
    Location:
    North Carolina USA
    nice graph chris, whee did you get the software.:rolleyes: :)
     
  2. AaLF

    AaLF Registered Member

    Joined:
    Feb 20, 2005
    Posts:
    986
    Location:
    Sydney
    No comments on Ikarus?

    And who's the Russian dude way over on the right - or is that a virus total?
     
  3. C.S.J

    C.S.J Massive Poster

    Joined:
    Oct 16, 2006
    Posts:
    5,029
    Location:
    this forum is biased!
    so, did you like my test? :)

    same methodology to the Virusinfo test. :rolleyes:
     
  4. Sjoeii

    Sjoeii Registered Member

    Joined:
    Aug 26, 2006
    Posts:
    1,240
    Location:
    52?18'51.59"N + 4?56'32.13"O
    Nice test Chris.
     
  5. dawgg

    dawgg Registered Member

    Joined:
    Jun 18, 2006
    Posts:
    818
    I'm not surprised Fortinet and Panda got so high in your test chris!... seeing as they detect most things anyway (Suspicious!)
    Suprised they didnt do better in VirusInfo... unless they didn't count "suspicious" detections which would make more sense for these 2
     
  6. C.S.J

    C.S.J Massive Poster

    Joined:
    Oct 16, 2006
    Posts:
    5,029
    Location:
    this forum is biased!
    yeah dawgg, in my test i suspected that a few have paranoid detections.

    i expected avira to catch all of them without being paranoid, but not really panda.

    also, symantec's poor results also surprised me.

    drweb had 7 missed samples, but it should have been 6 as one file does get detected by drweb on my computer.

    either way, i sent the remaining 6 to drweb for analysis.
     
  7. dawgg

    dawgg Registered Member

    Joined:
    Jun 18, 2006
    Posts:
    818
    Maybe DrWeb's engine in VT wasn't updated yet (recently added detection). Could be the case for other AVs as well though... (I'm not sure about the frequency of updates for VT in relation to users)
     
  8. NickGolovko

    NickGolovko Registered Member

    Joined:
    Dec 10, 2007
    Posts:
    2
    Hello everybody,

    let me join your friendly discussion. ;)

    It is quite natural to say that a test is wrong, is bought, is sponsored by an AV company etc. I often see that regarding most of the tests: any test presupposes participants who have low results, and it provokes a sort of disapproval.

    Please be sure that our test is neither for nor against any concrete product. We do that for our own interest.

    Now about the test from the message I am quoting:

    dear C.S.J, are you certainly sure you've reproduced the methodology completely? The samples should meet the following restrictions:

    They should be taken from infected machines that you have healed yourself (condition 1)

    They should not be detected by the antivirus software of the infected machine (condition 2)

    They should not be taken from some collection of malware that are commonly available in the Internet (condition 3)

    I suppose your samples were not that fresh. ;)

    In conclusion: I say in the article describing the graph that we never pretend to be the ultimate truth in testing. No test can determine an antivirus as a whole: they all deal with some side of it (proactive defense, signature detection, self-defense etc). Our test reflects only one facet of antivirus software, so it should not be understood as the only one showing all the capabilities of the software.

    Why Kaspersky and Dr.Web are not brilliant in our test? Well, that is very much obvious: they are the most widespread antiviral solutions in Russia, and our specialists are usually called to remove an infection that the antivirus software of a computer fails to detect and/or remove. Respectively the malware which corresponds to the conditions of our testing (especially the second one) often comes to be not detected by Kaspersky and Dr.Web.

    If you want to help us making the tests more international, you are welcome: even guests can send us the results of VirusTotal scannings to be processed. ;)
     
  9. C.S.J

    C.S.J Massive Poster

    Joined:
    Oct 16, 2006
    Posts:
    5,029
    Location:
    this forum is biased!
    hi nick, my little test was for samples available today, this does not include virus collections.

    was just for fun, don't take it too seriously ;)
     
  10. dawgg

    dawgg Registered Member

    Joined:
    Jun 18, 2006
    Posts:
    818
    very true!.. didn't think of that :)
     
  11. NickGolovko

    NickGolovko Registered Member

    Joined:
    Dec 10, 2007
    Posts:
    2
    I wanted to make sure that our methodology was understood correctly. :)

    But of course data received on viruses that are widely spread in Russian Internet may differ from that received on viruses from other sectors of the Net. :)
     
  12. C.S.J

    C.S.J Massive Poster

    Joined:
    Oct 16, 2006
    Posts:
    5,029
    Location:
    this forum is biased!
    I ain't no Russian, British bulldog here ;)

    But yeah I understand you and what you mean :)
     
  13. noway

    noway Registered Member

    Joined:
    Apr 24, 2005
    Posts:
    461
    If they don't disclose the AV version numbers, what else aren't they disclosing? These test results are not very useful in my opinion.
     
  14. Jadda

    Jadda Registered Member

    Joined:
    Jun 5, 2007
    Posts:
    429
    What is the program that is listed to the right? Which is written in Russian or something. :)
     
  15. Joe_Jones

    Joe_Jones Registered Member

    Joined:
    Aug 31, 2007
    Posts:
    41
    Does anyone know why TrustPort Workstation,
    (which contains 4 antivirus engines) and more ... was not tested?

    Strange, because it received already the best test results once this year at av-comparatives.org.

    But was not allowed to be tested ?

    :'(
     
  16. Macstorm

    Macstorm Registered Member

    Joined:
    Mar 7, 2005
    Posts:
    2,642
    Location:
    Sneffels volcano
    I don't think it's an av product itself, it seems rather the 'total detection' rating or something like this.
    Who's russian here? :)
     
  17. Sjoeii

    Sjoeii Registered Member

    Joined:
    Aug 26, 2006
    Posts:
    1,240
    Location:
    52?18'51.59"N + 4?56'32.13"O
    Did not know that one. Sounds very logical though
     
  18. trjam

    trjam Registered Member

    Joined:
    Aug 18, 2006
    Posts:
    9,102
    Location:
    North Carolina USA
    well I still dont understand it. It sounds like you are saying that Kaspersky and Dr Web are the most used in Russia, that makes sense. But are the ones you find the most malware on. To me it sounds like you are saying they are not any good. Or is it because of the high volume of machines using the 2, the better chance of finding malware, which is good for them. Not being sarcastic, just trying to understand.o_O
     
  19. C.S.J

    C.S.J Massive Poster

    Joined:
    Oct 16, 2006
    Posts:
    5,029
    Location:
    this forum is biased!
    so basically its a test against kaspersky and drweb?

    admitting that VT results used were ones not detected by kaspersky/drweb, seems like a nice statement to make the test in-valid.

    i actually thought drweb did well on this test, however... after reading this, i will have to read-on.

    the latest test to arrive that i believe is very well respected is the anti-malware.ru one, and im pleased that drweb had great result.

    good work.
     
  20. AndreyKa

    AndreyKa Registered Member

    Joined:
    Feb 25, 2005
    Posts:
    93
    Location:
    Russia
    Yes, it means "total files".
     
  21. the insider

    the insider Registered Member

    Joined:
    May 25, 2005
    Posts:
    151
    what strikes me is the difference for AVG ... it doesn't perform better than the rest in the newest test ...
    BTW the AVG free : does it have heuristic scanning included or ... not ?
     
  22. dawgg

    dawgg Registered Member

    Joined:
    Jun 18, 2006
    Posts:
    818
    nope, it does not mean they're not good... the methodology states that any malware detected on a computer which is detected by the computer's AV (Kaspersky or DrWeb most commonly in Russia) will not be used in the test sample... so there may be many malware detected by these, but they wont be included in the tests due to the AV on the computer allrady detecting it
     
  23. C.S.J

    C.S.J Massive Poster

    Joined:
    Oct 16, 2006
    Posts:
    5,029
    Location:
    this forum is biased!
    Exactly,which equates to a false test

    I don't like how the samples are checked with vt either
     
  24. dawgg

    dawgg Registered Member

    Joined:
    Jun 18, 2006
    Posts:
    818
    IMO... yes, especially for Kaspersky and DrWeb
     
  25. C.S.J

    C.S.J Massive Poster

    Joined:
    Oct 16, 2006
    Posts:
    5,029
    Location:
    this forum is biased!
    it'd weird though cos drweb does quite well in the test.
     
Thread Status:
Not open for further replies.
  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.