5 Popular Firewalls - Efficiency Test

Discussion in 'other firewalls' started by Creer, Apr 25, 2010.

Thread Status:
Not open for further replies.
Page 1 of 3
  1. Creer

    Creer Registered Member

    Joined:
    Jun 29, 2008
    Posts:
    1,345
    Below you will find results and methodology of my tests:

    Tested: 5 popular firewalls:
    Online Armor v4.0.0.44 (Firewall with HIPS) (link to test #1)
    DefenseWall Personal Firewall v3.00 (Firewall with HIPS) (link to test #2)
    Comodo (CIS) v4.0.141842.828 (without AV module) (Firewall with HIPS) (link to test #3)
    PC Tools Firewall Plus v6.0.0.88 (Firewall with HIPS) (link to test #4)
    Look 'n' Stop v2.07 (Pure Firewall) (link to test #5)

    Additional tests:
    Outpost Firewall Pro v7.0 (bulid: 3330.505.1221 - beta) (Firewall with HIPS) (link to test #24)
    ZoneAlarm v9.1.007 (Pure Firewall) - unable to test, BSOD after installation.


    Test machine: Windows 7 HP x32 (2GB RAM, CPU: 2x2.6 GHz) with updates from image backup as a baseline for the next tests.

    ~~~~~~~~~~~~~~~~~~~~~~
    1. Online Armor v4.0.0.44 (Firewall with HIPS)

    1) Test no.1: resource usage during web browsing (Opera as a main browser and open simultaneously ~15 tabs with different content - two sites with flash animation) Results below:

    Online Armor (Web Shield enabled):
    waiting for re-test

    Online Armor (Web Shield disabled):
    waiting for re-test


    2) Test no.2: resource usage during CNN TV-streaming in Windows Media Player 12:
    waiting for re-test


    3) Test no.3: resource usage during uTorrent activity - downloaded one of the Linux distro (Ubuntu) for test purposes:
    waiting for re-test


    4) Resource usage in Windows Task Manager - CPU Time, during all these tests:
    waiting for re-test
     
    Last edited: Apr 27, 2010
    Creer, Apr 25, 2010
    #1
  2. Creer

    Creer Registered Member

    Joined:
    Jun 29, 2008
    Posts:
    1,345
    2. DefenseWall Personal Firewall v3.00 (Firewall with HIPS)

    1) Test no.1: resource usage during web browsing (Opera as a main browser and open simultaneously ~15 tabs with different content - two sites with flash animation) Results below:
    waiting for re-test


    2) Test no.2: resource usage during CNN TV-streaming in Windows Media Player 12:
    waiting for re-test


    3) Test no.3: resource usage during uTorrent activity - downloaded one of the Linux distro (Ubuntu) for test purposes:
    waiting for re-test


    4) Resource usage in Windows Task Manager - CPU Time, during all these tests:
    waiting for re-test
     
    Last edited: Apr 27, 2010
    Creer, Apr 25, 2010
    #2
  3. Creer

    Creer Registered Member

    Joined:
    Jun 29, 2008
    Posts:
    1,345
    3. Comodo (CIS) v4.0.141842.828 (without AV module) (Firewall with HIPS)

    1) Test no.1: resource usage during web browsing (Opera as a main browser and open simultaneously ~15 tabs with different content - two sites with flash animation) Results below:
    comodo_webbrowsing.png


    2) Test no.2: resource usage during CNN TV-streaming in Windows Media Player 12:
    comodo_streaming.png


    3) Test no.3: resource usage during uTorrent activity - downloaded one of the Linux distro (Ubuntu) for test purposes:
    comodo_torrent.png


    4) Resource usage in Windows Task Manager - CPU Time, during all these tests:
    comodo_wtm.png
     
    Last edited: Apr 25, 2010
    Creer, Apr 25, 2010
    #3
  4. Creer

    Creer Registered Member

    Joined:
    Jun 29, 2008
    Posts:
    1,345
    4. PC Tools Firewall Plus v6.0.0.88 (Firewall with HIPS)

    1) Test no.1: resource usage during web browsing (Opera as a main browser and open simultaneously ~15 tabs with different content - two sites with flash animation) Results below:
    pctools_browsing.png


    2) Test no.2: resource usage during CNN TV-streaming in Windows Media Player 12:
    pctools_streaming.png


    3) Test no.3: resource usage during uTorrent activity - downloaded one of the Linux distro (Ubuntu) for test purposes:
    pctools_torrent.png


    4) Resource usage in Windows Task Manager - CPU Time, during all these tests:
    wtm_pctools.png
     
    Last edited: Apr 25, 2010
    Creer, Apr 25, 2010
    #4
  5. Creer

    Creer Registered Member

    Joined:
    Jun 29, 2008
    Posts:
    1,345
    5. Look 'n' Stop v2.07 (pure firewall, No HIPS)

    1) Test no.1: resource usage during web browsing (Opera as a main browser and open simultaneously ~15 tabs with different content - two sites with flash animation) Results below:
    lns_browsing.png
    Note: SPI was enabled in L'n'S options (by default this feature is disabled)


    2) Test no.2: resource usage during CNN TV-streaming in Windows Media Player 12:
    lns_streaming.png


    3) Test no.3: resource usage during uTorrent activity - downloaded one of the Linux distro (Ubuntu) for test purposes:
    lns_torrent.png


    4) Resource usage in Windows Task Manager - CPU Time, during all these tests:
    wtm_lns.png
     
    Last edited: Apr 25, 2010
    Creer, Apr 25, 2010
    #5
  6. Creer

    Creer Registered Member

    Joined:
    Jun 29, 2008
    Posts:
    1,345
    Ok that's all I hope you like it ;)

    As you can see almost every firewall is different for system resources, I hope that my tests will be helpful for those who are looking for a strong&light software firewall at the same time.


    Creer.
     
    Creer, Apr 25, 2010
    #6
  7. Cudni

    Cudni Global Moderator

    Joined:
    May 24, 2009
    Posts:
    6,963
    Location:
    Somethingshire
    Nice one! Thanks. A good job.
    An obvious question, to me at least, would you consider doing similar for other FWs out there?
     
    Cudni, Apr 25, 2010
    #7
  8. backfolder

    backfolder Registered Member

    Joined:
    May 25, 2004
    Posts:
    72
    Location:
    Spain
    Very interesting report, I´m gonna try DefenseWall.
    Thanks so much!
     
    backfolder, Apr 25, 2010
    #8
  9. Yakuman

    Yakuman Registered Member

    Joined:
    Aug 5, 2008
    Posts:
    75
    I wonder how much of a difference it would be if logging was disabled.
     
    Yakuman, Apr 25, 2010
    #9
  10. hayc59

    hayc59 Updates Team

    Joined:
    Feb 9, 2002
    Posts:
    2,841
    Location:
    KEEP USA GREAT
    hayc59, Apr 25, 2010
    #10
  11. bellgamin

    bellgamin Registered Member

    Joined:
    Aug 1, 2002
    Posts:
    8,102
    Location:
    Hawaii
    Grrreat tests Creer. Thanks!!!
    ~~~~~~~~~~~~~~~~~~~~~~~
    In making comparisons, bear in mind that OA & Comodo & DW are firewalls + HIPS whereas...

    1- LnS is a firewall only (no HIPs)

    2- PCTools is a firewall that has been patched so as to score well on Matousec's silly tests. It does not, by any means, have a full-fledged HIPS.
    ~~~~~~~~~~~~~~~~~

    +1 to hayc59's request to test Outpost.
    ~~~~~~~~~~~~~~~~~~~

    To make OA similar to other FW+HIPS you tested,. I suggest you disable (uncheck) its Mail Shield & Web Shield options. You can access those options by right-clicking OA's system tray icon.
     
    Last edited: Apr 25, 2010
    bellgamin, Apr 25, 2010
    #11
  12. acuariano

    acuariano Registered Member

    Joined:
    Nov 4, 2005
    Posts:
    786
    i was surprised that free OA is light,despite sys requirements says it needs 512 ram.
    i tested 3 days ago.
     
    acuariano, Apr 25, 2010
    #12
  13. falkor

    falkor Registered Member

    Joined:
    Sep 26, 2009
    Posts:
    205
    Good to see someone spend their time on this . Apparently meaningful to most . Useless to me . Not bashing because it is great someone would take the time to do this . I however ; do not see the point trying to be made . And these so called tests ( of what I do not know ) have not made me even think about a change in my arsenal . Sorry guys . Just someone here in the minority stating an opinion . As bad as that opinion may be perceived .:rolleyes: PLEASE do not think I am being argumentative . I am not . It just does nothing for me .
     
    falkor, Apr 25, 2010
    #13
  14. Noob

    Noob Registered Member

    Joined:
    Nov 6, 2009
    Posts:
    6,491
    Nice test, all seems to be light for a modern computer actually :D
    With this i mean computers with 2gb+ ram and a avg. CPU
     
    Noob, Apr 26, 2010
    #14
  15. Kees1958

    Kees1958 Registered Member

    Joined:
    Jul 8, 2006
    Posts:
    5,857
    Overview graphs/tables please :D
     
    Kees1958, Apr 26, 2010
    #15
  16. fax

    fax Registered Member

    Joined:
    May 30, 2005
    Posts:
    3,898
    Location:
    localhost
    fax, Apr 26, 2010
    #16
  17. whitedragon551

    whitedragon551 Registered Member

    Joined:
    Sep 30, 2008
    Posts:
    3,264
    Location:
    USA
    LnS looks like a keeper.
     
    whitedragon551, Apr 26, 2010
    #17
  18. rdsu

    rdsu Registered Member

    Joined:
    Jun 28, 2003
    Posts:
    4,537
    What about Windows 7 Firewall?

    Thanks
     
    rdsu, Apr 26, 2010
    #18
  19. whitedragon551

    whitedragon551 Registered Member

    Joined:
    Sep 30, 2008
    Posts:
    3,264
    Location:
    USA
    It would be hard to measure Windows FW simply because its built into the OS. You wont know whats causing the spike in resources.
     
    whitedragon551, Apr 26, 2010
    #19
  20. Sariel Fallen

    Sariel Fallen Registered Member

    Joined:
    Apr 2, 2010
    Posts:
    17
    Location:
    Wuppertal/Germany
    Hi All
    @ Creer :thumb:
    _____
    I'm using the Filseclab, it's easy to handle with the ability to adjust the filter in many ways and the RAM-usage is not to high.
    For me it's great :D - any other experiences ?
    Regards
     
    Sariel Fallen, Apr 26, 2010
    #20
  21. rdsu

    rdsu Registered Member

    Joined:
    Jun 28, 2003
    Posts:
    4,537
    You are right... :)
     
    rdsu, Apr 26, 2010
    #21
  22. Creer

    Creer Registered Member

    Joined:
    Jun 29, 2008
    Posts:
    1,345
    Indeed I did test for OA with Web Shield enabled and disabled. I forgot mention that in both cases Mail Shield was disabled.
     
    Creer, Apr 26, 2010
    #22
  23. Creer

    Creer Registered Member

    Joined:
    Jun 29, 2008
    Posts:
    1,345
    I tried to install ZA Free v9.1.007, but no success - after installation I got BSOD on my machine, also I was unable to install beta since there is needed registration to access to beta-zone :rolleyes:
     
    Last edited: Apr 26, 2010
    Creer, Apr 26, 2010
    #23
  24. Creer

    Creer Registered Member

    Joined:
    Jun 29, 2008
    Posts:
    1,345
    6. Outpost Firewall Pro v7.0 (bulid: 3330.505.1221 - beta) (Firewall with HIPS)

    1) Test no.1: resource usage during web browsing (Opera as a main browser and open simultaneously ~15 tabs with different content - two sites with flash animation) Results below:
    outpost_browsing.png


    2) Test no.2: resource usage during CNN TV-streaming in Windows Media Player 12:
    outpost_streaming.png


    3) Test no.3: resource usage during uTorrent activity - downloaded one of the Linux distro (Ubuntu) for test purposes:
    outpost_torrent.png


    4) Resource usage in Windows Task Manager - CPU Time, during all these tests:
    wtm_outpost.png
     
    Creer, Apr 26, 2010
    #24
  25. Peter2150

    Peter2150 Global Moderator

    Joined:
    Sep 20, 2003
    Posts:
    20,590
    Hi All

    First, Creer, please don't take this personally.

    People here at Wilders seem to have fallen in love with testing. I have no doubt his tests may be valid, for his machine, with his OS, his router, and his ISP. Also might well be a function his whether it's cable, DSL or whatever. So for him it's very valid.

    BUT for anyone else to use the tests as a way judging the Efficiency of a particular firewall, I would have to say I have some huge doubts.

    I think the only way one can judge any software is to test it on there setup.

    Pete
     
    Peter2150, Apr 26, 2010
    #25
Page 1 of 3
Thread Status:
Not open for further replies.
  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Accept Learn More...