Matousec's new Firewall Challenge "wrinkle"

Discussion in 'other anti-malware software' started by wat0114, Apr 20, 2008.

Thread Status:
Not open for further replies.
  1. wat0114

    wat0114 Guest

    From his homepage:

    www.matousec.com

    Btw, Credit for pointing this out goes to Outpost Firewall Support Forum member/moderator, minoka :)
     
    Last edited by a moderator: Apr 20, 2008
  2. Smokey

    Smokey Registered Member

    Joined:
    Apr 1, 2002
    Posts:
    1,513
    Location:
    Annie's Pub
    Good to know, over and out for Matousec and his credentials.
     
    Last edited: Apr 20, 2008
  3. dawgg

    dawgg Registered Member

    Joined:
    Jun 18, 2006
    Posts:
    817
  4. Smokey

    Smokey Registered Member

    Joined:
    Apr 1, 2002
    Posts:
    1,513
    Location:
    Annie's Pub
    Somebody gave me his opinion about the issue:
    I can't say it better.
     
  5. Tommy

    Tommy Registered Member

    Joined:
    Dec 24, 2002
    Posts:
    1,169
    Location:
    Buenos Aires - Munic
    Admins of well known and seriuos security boards are beginning to ban Matousec reports :thumb:
    Wilders should follow this example.
     
  6. faenil

    faenil Registered Member

    Joined:
    Oct 25, 2006
    Posts:
    88
    ....Online Armor Free in their tests passes Kill 1 ...mine doesn't and I have a newer version...

    VERY STRANGE...
     
    Last edited: Apr 20, 2008
  7. Hugger

    Hugger Registered Member

    Joined:
    Oct 27, 2007
    Posts:
    1,003
    Location:
    Hackensack, USA
    This is either a poorly thought out idea or a poorly written statement on Matousec's part.
    Or possibly just poor judgement.
    I know that this now makes me a little hesitant to follow his test results/recommendations.
    Hugger
     
  8. EASTER

    EASTER Registered Member

    Joined:
    Jul 28, 2007
    Posts:
    5,633
    Location:
    U.S.A. (South)
    In all honesty i found the toughest scrutiny on security apps originate right here at Wilder's and are taken to task, sometimes heated but with the intent to get right to the core of the truth of matters like this.

    kareldjag (sorry if a mispell) is been one of those fierce scrutinizers in his own right and he puts security apps thru some pretty thorough paces himself with results and commentary.
     
  9. ggf31416

    ggf31416 Registered Member

    Joined:
    Aug 20, 2006
    Posts:
    314
    Location:
    Uruguay
    I guess most wilders' members live in communist countries.:rolleyes: :doubt:
    Matousec is just trying to get some money from his work.
    You can start your own firewall testing site if you don't like it.;)
     
  10. Peter2150

    Peter2150 Global Moderator

    Joined:
    Sep 20, 2003
    Posts:
    17,048
    I don't think it has a thing to do with where we live. When one takes money from the sale of the products you are testing, it certainly calls into question the objectivity of the testing.
     
  11. Perman

    Perman Registered Member

    Joined:
    Nov 23, 2005
    Posts:
    2,160
    Hi,

    That wrinkle gives me an excellent idea to embark on a new venture...

    to solicit many vendors ( I would get a directory) as possible to offer a guaranteed positive review and an affiliation. ===> scam ? or spam ?

    I could become an instant rich man, eh? Not a bad idea !

    I would say that Matousec guy has finally shown his true colour--green--.
    Money beggar.

    US's sub prime loan disaster must have hurt a lot people, including our (ex)honorable friend.
     
  12. LoneWolf

    LoneWolf Registered Member

    Joined:
    Jan 2, 2006
    Posts:
    3,408
    Doesn't change my opinion of Matousec or his leak tests. :rolleyes:
    Never took his testing or his opinion's very seriously anyways. :thumbd:
     
  13. alex_s

    alex_s Registered Member

    Joined:
    Aug 13, 2007
    Posts:
    1,251
    TestMyPC does it for free. Still, I'm very hesitant about its objectivity. And comparing these two services I definitely in favour of Matousec. Because .. he uses the same clean system and runs everything with the same criteria. He uses opensource tests. While comletely free testmypc tests every product by _volunteers_ on their PC with unpredictable configuration and unpredictabe criterias.
     
    Last edited: Apr 21, 2008
  14. alex_s

    alex_s Registered Member

    Joined:
    Aug 13, 2007
    Posts:
    1,251
    I think it is enough that vendors took it seriously and improved their products. What I see definitely positive. He published BsodHook utility (ShadowHook now), for example. It revealed a lot of bugs in the drivers. Then this was fixed by some vendos -- positive.

    There hardly can be something perfect in the World, though.
     
    Last edited: Apr 21, 2008
  15. Hugger

    Hugger Registered Member

    Joined:
    Oct 27, 2007
    Posts:
    1,003
    Location:
    Hackensack, USA
    Question.
    Reading all of our posts I now wonder if there are any reputable firewall testing companies that will give away the results to interested parties? Meaning us.
    As an aside, in the past Matousec and I communicated a few times.
    I was impressed with his willingness to share his knowledge.
    This is an unfortunate decision on his part.
    Hugger
     
  16. alex_s

    alex_s Registered Member

    Joined:
    Aug 13, 2007
    Posts:
    1,251
    I don't dare to judge him. I just wonder, is this really possible that somebody did such hard work for free ? May be somebody crazy who won a lot of money in a lottery and who now dies of boredom ? This is not me, definitely :)
     
  17. 19monty64

    19monty64 Registered Member

    Joined:
    Apr 10, 2006
    Posts:
    1,302
    Location:
    Nunya, BZ
    What's wrong with accepting sponsorship from the companies you're testingo_O I'm sure all the AV-comparatives are sponsored by the AV-companies too. I'm sure they get pay-for retesting if they do poorly and a copy of the samples that are going to be used. (sarcasm) :rolleyes:
     
  18. Einsturzende

    Einsturzende Registered Member

    Joined:
    Apr 14, 2008
    Posts:
    390
    Location:
    neubauten
    It seems that Matoušec sells product (build) which doesn't exist.
    (See Outposts build number on his page and on official one)
    Matoušek tested an internal build which is not released yet (and i doubt it will be)...
     
  19. Smokey

    Smokey Registered Member

    Joined:
    Apr 1, 2002
    Posts:
    1,513
    Location:
    Annie's Pub
    Sponsorship can compromise test(results). You can call it a conflict of interests too.
     
  20. Pedro

    Pedro Registered Member

    Joined:
    Nov 2, 2006
    Posts:
    3,502
    It's not even the top 2.
    And certainly recommending products with a minimum 80% score doesn't seem bad.
    If you think these tests are useful or not, it's up to you, but i don't think there's anything wrong here, so far anyway.
     
  21. 19monty64

    19monty64 Registered Member

    Joined:
    Apr 10, 2006
    Posts:
    1,302
    Location:
    Nunya, BZ
    That was the reason for the
     
  22. 19monty64

    19monty64 Registered Member

    Joined:
    Apr 10, 2006
    Posts:
    1,302
    Location:
    Nunya, BZ
    I'd hope to score better than 80% on a test that I had all the Q&A for...
     
  23. Pedro

    Pedro Registered Member

    Joined:
    Nov 2, 2006
    Posts:
    3,502
    If i understand you correctly:
    Exactly. They don't score 100. The ones that do aren't recommended (no sponsor).

    I just think we should not jump to conclusions.
     
  24. 19monty64

    19monty64 Registered Member

    Joined:
    Apr 10, 2006
    Posts:
    1,302
    Location:
    Nunya, BZ
    If I had all the Q&A for a test AND the option for a re-test, anything short of 100% is a BIG disappointment!!! Just imagine a MD about to operate on you, and you find out that he had all the Q&A, paid re-test, and paid the person marking his test, and he scored anything short of 100%.....
    But seriously, he's sponsored, so that makes his site a "paid-advertisement" doesn't ito_O
     
  25. Tommy

    Tommy Registered Member

    Joined:
    Dec 24, 2002
    Posts:
    1,169
    Location:
    Buenos Aires - Munic
    Folks, look closer at the test:
    1. He is testing applications which are not inteded to be a firewall, like SSM.
    2. Matousec does not seam to know about some special features regarding self protection like in Jetico. Even if Jetico is killed (Server and GUI), the rules will still be acomplished or traffic completly blocked. So that does not give a clear result for users who are not aware of those features. Irritating.
    3. You can't compare suites from Eset, AVG, etc. with pure firewalls like Oupost, Jetico, etc. Thats like apples and oranges.
    4. etc.

    So even without the here discussed matter (selling products), which of course makes the results doutable, those test are not professional and correct.
     
Loading...
Thread Status:
Not open for further replies.