New Matousec firewall test, we got new leader...

Discussion in 'other firewalls' started by czullo, Apr 7, 2009.

Thread Status:
Not open for further replies.
  1. czullo

    czullo Registered Member

    Joined:
    Mar 6, 2008
    Posts:
    22
  2. Peter2150

    Peter2150 Global Moderator

    Joined:
    Sep 20, 2003
    Posts:
    17,059
    Removed a post that was an unsubstantiated allegation. Please no posts of that nature.

    Pete
     
  3. Rain_Train

    Rain_Train Registered Member

    Joined:
    Aug 27, 2008
    Posts:
    139
    Ah, and they continue to test Mamutu... :thumbd: Maybe ClamAV will be next :cautious: .

    In any case, thanks for sharing the link.
     
  4. BrendanK.

    BrendanK. Registered Member

    Joined:
    Jun 23, 2008
    Posts:
    520
    Location:
    Australia
    They didn't make a new test, they just retested Comodo :ouch:
     
  5. raven211

    raven211 Registered Member

    Joined:
    May 4, 2005
    Posts:
    2,567
    ... OR you could configure your hardware Firewall correctly and don't give a crap of either these leak-tests or the hassle of software FWs - then concentrate on the malware which is the real issue left. Simply run a free setup or buy products which are worth their price - AntiVir Professional or Premium to name two examples with Premium going for 19 euros. Compare that to Symantec's NAV offering which I normally prefer for many reasons at 39$. That made me atleast make a temporary switch...
     
    Last edited: Apr 8, 2009
  6. Iam_me

    Iam_me Registered Member

    Joined:
    Feb 6, 2009
    Posts:
    89
    No news really. Comodo technically has been #1 there "almost" since the lunch of the 84 set of tests.. :rolleyes: :)

    Anyway now it says so on the paper also. :thumb:
    Comodo - keeps users protected. :argh:
     
  7. raven211

    raven211 Registered Member

    Joined:
    May 4, 2005
    Posts:
    2,567
    HIPS and Sandboxing techniques, most often hands-down, but I'm personally more than happy using behaviour blocking and strong heuristics together with (generic) signatures.
     
  8. Peter2150

    Peter2150 Global Moderator

    Joined:
    Sep 20, 2003
    Posts:
    17,059
    Not only "No news really", but nothing really significant, other than fodder for the fan boy's on either side. No. 1 will switch back and forth based on version, testing time, and maybe even the phase of the moon.

    In terms of the protection offered to 99% of the users, all the top products will do the job equally well.

    Pete
     
  9. Tunerz

    Tunerz Registered Member

    Joined:
    Jun 12, 2007
    Posts:
    96
    Location:
    Philippines
    I think the software leading the tests are only as good as the users behind it. No matter how it passes PoC tests, it would all fail if the user doesn't know much about what they are using at all.
     
  10. twl845

    twl845 Registered Member

    Joined:
    Apr 12, 2005
    Posts:
    4,186
    Location:
    USA
    Wait until OA launches their new version which is now an RC version. The test results may be different. :isay:
     
  11. Rednose!

    Rednose! Registered Member

    Joined:
    Apr 7, 2008
    Posts:
    80
    Location:
    Netherlands
    Does it matter o_O

    You are perfectly right here :)

    Greetz, Red. ( A Comodo fan MAN ;) )
     
  12. twl845

    twl845 Registered Member

    Joined:
    Apr 12, 2005
    Posts:
    4,186
    Location:
    USA
    It only matters to the folks who follow this stuff. I have used Comodo, and now OA, and they're both great. The difference for me is the complexity (for a dummy like me) of Comodo, and the simplicity of OA which I can handle. :D What I was saying was that OA's last version, compared to Comodo might put Comodo in 1st place, but OA has been developing the next version for a few months and has released the RC version to try. If the RC version is a good indication, the 1st place (not that it matters) may shift when OA releases their final copy.
     
    Last edited: Apr 8, 2009
  13. Iam_me

    Iam_me Registered Member

    Joined:
    Feb 6, 2009
    Posts:
    89

    It might..

    Comodo has decided to not pass all tests since it sees some tests as irrelevant.
    https://forums.comodo.com/empty-t30896.0.html;msg222603#msg222603

    OA and Outpost just pass tests to look good on paper.. They don't care if the tests are unnecessary to pass. :doubt: :doubt:
    You can always intercept stuff. But as long as it can't be used to do something reasonable by a hacker then its unnecessary interception.

    Also that CIS was #1 is no news really since it has done so for months. Just not on paper, but technically since some bugs was fixed.
    (A fixed version that dealt with the tests was released days after 3.5 was originally tested. And CIS was since then technically #1...)
     
  14. Rednose!

    Rednose! Registered Member

    Joined:
    Apr 7, 2008
    Posts:
    80
    Location:
    Netherlands
    Boys, boys, boys ...

    It is only a leak test ;)

    Greetz, Red.
     
  15. yashau

    yashau Registered Member

    Joined:
    Oct 13, 2008
    Posts:
    151
    Bah I wish the guys over at the Comodo forums were as nice as their software.
     
  16. m00nbl00d

    m00nbl00d Registered Member

    Joined:
    Jan 4, 2009
    Posts:
    6,623
    So, only COMODO was retested? Why?

    I never really understood why this test is called "Firewall Challenge". No firewall is being, practically, tested.

    What they are testing is a functionality that began to be part of firewalls. Sure, every firewall should have a nice outbound traffic control. But, that's it.

    And, what is being tested is not the capability of a firewall to block unsolicited inbound and outbound traffic. All Matousec tests is a capability to block "leaks", and mostly to what happens within the system, and not what goes out or comes in.

    I'd like to see a test performed to show the most efficient firewall preventing, in first place, inbound traffic. But, then I guess everyone would realize Windows own firewall is more than fine for that task.

    Heck, can't Matousec just test the capability of a firewall to prevent hackers from getting into a system?

    Then, I'd like to see a test done for outbound traffic control, which, Windows own firewall is not that easy to work with (The Windows advanced firewall.).
     
  17. Iam_me

    Iam_me Registered Member

    Joined:
    Feb 6, 2009
    Posts:
    89
    Not true.. The following was retested:

    * BitDefender Internet Security 2009 12.0.12.0
    * Comodo Internet Security 3.8.65951.477
    * ESET Smart Security 4.0.417.0
    * ZoneAlarm Free Firewall 8.0.298.000

    However Many others has already been retested.. Among them Outpost..
    And If CIS was retested earlier wouldn't have mattered.. Since it has passed those tests for months..o_O :thumb:

    Not that it matter but it was a free retesting. (all get the right to that each 3 month I think..)
     
    Last edited: Apr 8, 2009
  18. czullo

    czullo Registered Member

    Joined:
    Mar 6, 2008
    Posts:
    22
    Eset smart security gets +1% from 3 to 4 ;)
     
  19. sded

    sded Registered Member

    Joined:
    Jun 4, 2004
    Posts:
    512
    Location:
    San Diego CA
    I think it's great that there are so many products out there now with good antileak properties. And no one seems to be targeting the firewall test specifically, since the tests are all available for anyone to run, and if you want to distort your product just to pass the tests you certainly can get 100% . Congratulations to all, and to Matousec for bringing it all out into the open. :)
     
  20. andyman35

    andyman35 Registered Member

    Joined:
    Nov 2, 2007
    Posts:
    2,336
    What do you mean? I'm the nicest person I know :p
     
  21. Peter2150

    Peter2150 Global Moderator

    Joined:
    Sep 20, 2003
    Posts:
    17,059
    And of course you have documented evidence to support this allegation.
     
  22. alex_s

    alex_s Registered Member

    Joined:
    Aug 13, 2007
    Posts:
    1,251
    This is nonsense. They perform not on the paper, but on the real tests. Every test demonstraits some security hole, they just do not think that security hole may be unnesesary to be handled.

    Hm.

    Kill3f - failed.

    "Comodo Internet Security failed Kill3f test because process “cssurf.exe” that is installed with the product could be
    terminated under rare circumstances by this test even if the user denies all queries of the product that alert about the attack against this process."

    Which does mean Comodo process protection is flawed.

    SSS - failed.

    "Unwanted user logout was not prevented."

    SockSniff - failed.

    Which does mean Comodo cannot control Raw Sockets. This test is from "keyloggers" type, but instead of keyboard it invisibly sniffs your network traffic (including sensitive information).

    Crash7 - failed.

    Which does mean Comodo can be terminated by any usermode program that uses this technique.

    I do not think these tests are unnesesary to pass, especially crash tests.
     
    Last edited: Apr 8, 2009
  23. Rednose!

    Rednose! Registered Member

    Joined:
    Apr 7, 2008
    Posts:
    80
    Location:
    Netherlands
  24. Leolas

    Leolas Registered Member

    Joined:
    Jun 18, 2008
    Posts:
    58
    Location:
    Modena, Italy
    if this statement was true, OA would annoy the user with thousands of popup regarding unnecessary stuffs, while Comodo would have less popup and would be much easier to use.. But a lot of people say that OA is easier to use. :ninja: There must be something wrong.

    Plus, OA doesn't pass the tests just to look good on the paper. May I remind you that OA was originally an HIPS, and Comodo a firewall?

    As Pete, I believe you need more documentation..
     
    Last edited: Apr 8, 2009
  25. alex_s

    alex_s Registered Member

    Joined:
    Aug 13, 2007
    Posts:
    1,251
    Yep, it was answered in a traditional Comodo way "everything Comodo fails is irrelevant and intentional". I just never found this approach convincing.
    They never accept their fails, they blame everybody, but themselves. I trust the vendors who accept fails and go with "yes, we failed here, but we will do our best to fix it".
     
Loading...
Thread Status:
Not open for further replies.