PCSL Test -- And the Winner is..... 腾讯电脑管家

Discussion in 'other anti-virus software' started by Frank the Perv, Mar 8, 2015.

  1. Frank the Perv

    Frank the Perv Banned

    Joined:
    Dec 16, 2005
    Posts:
    882
    Location:
    Virginia, USA
    腾讯电脑管家 99.946
    360 99.903
    Bitdefender Internet Security 99.903
    FortiClient 99.903
    Norton Security 99.769
    Avira Free Antivirus 99.728
    百度杀毒 99.518
    IKARUS anti.virus 99.513
    F-Secure Internet Security 99.430
    卡巴斯基安全软件 99.397
    Avast Free Antivirus 99.338
    NANO Antivirus 99.224
    ZoneAlarm Free Antivirus + Firewall 99.027
    ESET Smart Security 98.604
    Windows Defender 98.604
    K7 Ultimate Security 98.542
    Dr.Web Security Space 98.336
    新毒霸 97.472
    Trend Micro Maximum Security 95.095
    Webroot SecureAnywhere 88.332
    Malwarebytes Anti-Malware Premium 65.502


    Among the interesting test results, 360, Bit, and Norton did well.

    Everything scored above 95, except for Webroot & MBAM.

    Strange how low Trend & MBAM scored.

    新毒霸 didn't do so well either.

    Congrat's to 腾讯电脑管家 as the winner.

    I've asked Yuki to stop by and tell us about this product, 腾讯电脑管家.

    http://pcsl.r.worldssl.net/report/malware_detection_desktop/pcsl_pc_malware_detection_201412_cn.pdf


    -Frank
     
  2. Mayahana

    Mayahana Banned

    Joined:
    Sep 13, 2014
    Posts:
    2,220
    Looks like everyone did OK except Kool Aid and FailBam.

    Note they tested an ancient version of Trend, not 2015, and from the looks of it, possibly Trend 2013.

    百度杀毒 did better than expected. Forticlient way up, I wonder if they actually tested it with a Fortigate installed to leverage the IPS+Firewall? You know, the proper way to test Forticlient.
     
  3. Nightwalker

    Nightwalker Registered Member

    Joined:
    Nov 7, 2008
    Posts:
    786
  4. coolcfan

    coolcfan Registered Member

    Joined:
    Nov 1, 2008
    Posts:
    123
    From my replies in the Norton thread:

    So at least Tencent PC manager is dual engine: their own engine (or Kingsoft engine, not sure) and Avira engine.

    Translations:


    BTW Malwarebytes is blocked in many areas in China because of the CDN services they use.
     
    Last edited: Mar 9, 2015
  5. Krusty

    Krusty Registered Member

    Joined:
    Feb 3, 2012
    Posts:
    2,898
    Location:
    Australia
    The Norton version they tested - 22.0.0.110 - was the first v22 version released, which by the way was the same version number as the last beta released, not that means anything of course. :isay:
     
  6. Frank the Perv

    Frank the Perv Banned

    Joined:
    Dec 16, 2005
    Posts:
    882
    Location:
    Virginia, USA

    Thank you coolcfan.
     
  7. zapjb

    zapjb Registered Member

    Joined:
    Nov 15, 2005
    Posts:
    3,523
    Location:
    USA - Back in a real State in time for a real Pres
    Cool that BDIS did so well. Where's Kaspersky?
     
  8. anon

    anon Registered Member

    Joined:
    Dec 27, 2012
    Posts:
    4,098
    =
    also here=
    https://www.wilderssecurity.com/threads/tencent-pc-manager.372603/
     
  9. roger_m

    roger_m Registered Member

    Joined:
    Jan 25, 2009
    Posts:
    5,250
    Kasperksy is in 10th place. 卡巴斯基安全软件 == Kaspersky.
     
  10. zapjb

    zapjb Registered Member

    Joined:
    Nov 15, 2005
    Posts:
    3,523
    Location:
    USA - Back in a real State in time for a real Pres
    Of course how could I've missed it. :)
     
  11. coolcfan

    coolcfan Registered Member

    Joined:
    Nov 1, 2008
    Posts:
    123
  12. itman

    itman Registered Member

    Joined:
    Jun 22, 2010
    Posts:
    2,969
    Location:
    U.S.A.
    They have an English version of the report?
     
  13. Alexhousek

    Alexhousek Registered Member

    Joined:
    Jul 25, 2009
    Posts:
    410
    Location:
    USA--Colorado
    Is there an English translation for these?
     
  14. yongsua

    yongsua Registered Member

    Joined:
    Feb 9, 2011
    Posts:
    474
    Location:
    Malaysia
    A very bias test result for me....
     
  15. Frank the Perv

    Frank the Perv Banned

    Joined:
    Dec 16, 2005
    Posts:
    882
    Location:
    Virginia, USA

    As far as I know, the only translation capability we have for this is Yuki & coolcfan.
     
  16. coolcfan

    coolcfan Registered Member

    Joined:
    Nov 1, 2008
    Posts:
    123
    Yuki's also from China?

    I'm not very good at translating, but I can try to pick up some points from the report.

    ____EDIT____

    I read the report file again... and there aren't a lot to translate. So I will just give some guides for those who are interested in this:

    Section 1 (Page 1): Background

    Brief introduction about what computer virus is and the importance of low false positive rate.

    Section 2 (Page 2): Test Procedure
    1. Install Windows 8 x64 on the testing computer and run update;
    2. Make a system image;
    3. Repeat for each AV software being tested:
      1. Install AV software and update;
      2. Keep internet connection on to ensure cloud features working;
      3. Copy virus samples together with lots of clean files to the testing computer;
      4. Run scan with default or recommended settings;
      5. Record detection and false positive statistics;
      6. Restore from the system image.
    Section 3 (Page 3): AV Softwares Being Tested

    The table has 3 columns:
    • 软件厂商: Software vendor;
    • 软件名称: Software name;
    • 版本号: Version.
    The Chinese names in the table:
    • 百度杀毒: Baidu AntiVirus
    • 卡巴斯基安全软件: Kaspersky Internet Security
    • 新毒霸: Kingsoft AntiVirus
    • 360杀毒: 360 AntiVirus
    • 腾讯电脑管家: Tencent PC Manager
    Section 4 (Page 4): Results

    Columns of the table:
    • 软件名称: Software name
    • 样本总数: Total number of samples
    • 未检测数: Number of samples not detected
    • 检测率: Detection percentage
    • 误报数: Number of false positives
    • 综合得分: Final score
    and: [Final Score] = [detection%] x 100 - 0.1 x [false positive number]

    Section 5 is the introduction of the company who conducts this test;
    Section 6 is about copyright of the report;
    Section 7 is the disclaimer.
     
    Last edited: Mar 9, 2015
  17. itman

    itman Registered Member

    Joined:
    Jun 22, 2010
    Posts:
    2,969
    Location:
    U.S.A.
    At least there is one thing they are doing right! :thumb:
     
  18. Frank the Perv

    Frank the Perv Banned

    Joined:
    Dec 16, 2005
    Posts:
    882
    Location:
    Virginia, USA
    Maybe you guys are beer drinking buddies and both don't know that the other is also posting here.

    Maybe you are neighbors..

    Anyway, thank you for translating the info.

    Very helpful.


    -Frank
     
  19. Frank the Perv

    Frank the Perv Banned

    Joined:
    Dec 16, 2005
    Posts:
    882
    Location:
    Virginia, USA
    Yeah, Kool-Aid did terrible. Strange with Kool-Aid... they get some really good, but also really bad results.

    And yes, 'FailBam' did not do well. Strange. MBAM has topped tests for many years. They routinely outperform full AVs in testing. Not sure why they are not testing so well in a couple of different tests lately.
     
  20. coolcfan

    coolcfan Registered Member

    Joined:
    Nov 1, 2008
    Posts:
    123
    Haha they use Edgecast, which is DNS polluted...
     
  21. roger_m

    roger_m Registered Member

    Joined:
    Jan 25, 2009
    Posts:
    5,250
    I know there's a translation below. But, all you need to do is copy and paste the Chinese character's into Google to see what product's being referred to. Also, the whole PDF can be translated via Google Translate, and here is the link to the translated PDF.
     
  22. Yuki2718

    Yuki2718 Registered Member

    Joined:
    Aug 15, 2014
    Posts:
    1,257
    Actually I'm not Chinese, tho surely I can tell rough meaning even w/out translation it's no use when we have coolcfan, real Chinese speaker.

    Only 2 Chinese AV I'm relatively intimate with are Kingsoft (金山) and Baidu (百度) which I don't recommend for some reason, but have no idea about Tencent as a security vendor/product. However, I can comment on some things not yet discussed here.

    See 4 PCSL exploit tests done Apr.2014 - Jul.2014 (different from one MBAE included), AV-TEST exploit test Apr.2014, and AVC's 2 tests done in Sep.2014 & Dec.2014.
    You'll find they got poor results in begininng of the year but significantly improved after that. It can mean:
    1) they employed behavior based anti-exploit
    2) they added significant amount of exploit sig
    But note all those tests are done on XP. We know anti-exploit is significantly limited on XP due to lack of ASLR. Even Kaspersky keep socring worse on XP than Vista+. So the answer should be 2).

    As to static detection test, remember Chinese malware environment is quite unique and different from all other area, maybe have sth to do with great FW. Back in several years when Trend's detection was terrible in world wide they were still good at detecting Chinese malware. Having 2+ engines mean it should be good in both world.

    Also see AV-TEST's self protection test. Tencent is the best in all Chinese AVs.

    So I think Tencent has potential considering big money and high stock prices they have, but at least currently it would be better to keep away from it in productive environment and see how it goes.
     
  23. coolcfan

    coolcfan Registered Member

    Joined:
    Nov 1, 2008
    Posts:
    123
    Good to know someone understanding Chinese here haha.

    Personally I don't have good impression on Tencent, Qihoo and Baidu and other major AV software vendors in China. It's not about technology, but records of doing something rogue (like reporting competitor's installer as a virus, or silently removing competitor's product, or silently coming into your computer).

    However, their "global" versions are much cleaner than Chinese versions. I'd recommend anyone who wants to try any of the products made by vendors I mentioned to try their global edition. If they don't provide one, just wait.
     
  24. Behold Eck

    Behold Eck Registered Member

    Joined:
    Aug 23, 2013
    Posts:
    441
    Location:
    The Outer Limits
    Forticlient did really well and that`ll be down to the excellent web-filter,no doubt.

    Regards Eck[​IMG][​IMG][​IMG][​IMG][​IMG]:)
     
    Last edited: Mar 10, 2015
  25. Yuki2718

    Yuki2718 Registered Member

    Joined:
    Aug 15, 2014
    Posts:
    1,257
    Yup, the reason I don't recommend Kingsoft and Baidu is just that, they had some dirty things in the past. But as to Tencent I don't know anything so I just described what I know and what I can reason.
    It's great we have you who knows those product better.:)
     
Loading...