My VPN Testing Site is Finally Up

Discussion in 'privacy technology' started by mirimir, Jun 16, 2016.

  1. mirimir

    mirimir Registered Member

    Joined:
    Oct 1, 2011
    Posts:
    6,029
    https://vpntesting.info/

    I tested 29 Windows VPN clients for DNS, IPv4 and IPv6 Leaks. Six (AirVPN, FrootVPN, IVPN, Mullvad, Perfect Privacy and SlickVPN) performed perfectly. Three others (CyberGhost, oVPN.to and SecureVPN.to) hit VPN-specified nameservers directly while reconnecting after uplink interruption. But that's not a huge issue, in that they didn't hit other nameservers. The other 20 Windows VPN clients failed in various ways. Over half leaked IPv6 packets whenever the machine was connected to the Internet. After uplink interruption, some failed to reconnect automatically, and some leaked IPv4 packets.
     
    Last edited: Jun 16, 2016
  2. marzametal

    marzametal Registered Member

    Joined:
    Mar 19, 2014
    Posts:
    731
    Wow, very interesting reading. *applauds effort*
     
  3. quietman

    quietman Registered Member

    Joined:
    Dec 27, 2014
    Posts:
    491
    Location:
    Earth .... occasionally
    An excellent piece of work ..... many thanks , much appreciated !

    In the main , I thought the results were not that surprising ....
    The top performers were pretty much in line with anecdotal reports in various places , and the same ones that have
    been so frequently recommended here at Wilders over the years .

    What did surprise me was how many get leaky on reconnect ..... something to bear in mind when choosing / changing a
    VPN provider .
     
  4. trott3r

    trott3r Registered Member

    Joined:
    Jan 21, 2010
    Posts:
    830
    Location:
    UK
  5. mirimir

    mirimir Registered Member

    Joined:
    Oct 1, 2011
    Posts:
    6,029
    I've updated the site, and added results for OSX :)
    It's true that IVPN provided funding and technical support. Also, I knew that IVPN wouldn't leak, because I had written https://www.ivpn.net/privacy-guides/how-to-perform-a-vpn-leak-test for them. But I was hoping that more of the rest wouldn't leak.

    Please recommend others to test, or retest. Currently, I'm planning to test BolehVPN, Insorg, Windscribe and Witopia. I gather that AirVPN and NordVPN have updated clients, so I'm planning to retest them.
     
  6. summerheat

    summerheat Registered Member

    Joined:
    May 16, 2015
    Posts:
    722
    Thanks for this great site! I'm looking forward to the NordVPN retest as I'm using that one - I hope that they have improved.
     
  7. AJ79

    AJ79 Registered Member

    Joined:
    Apr 1, 2015
    Posts:
    10
    NordVPN have not yet support IPv6.
     
  8. Minimalist

    Minimalist Registered Member

    Joined:
    Jan 6, 2014
    Posts:
    5,061
    Since I'm using it, I would recommend testing F-Secure Freedmome VPN.
     
  9. driekus

    driekus Registered Member

    Joined:
    Nov 30, 2014
    Posts:
    489
    Fantastic work, very interested to see BolehVPN windows client.

    On a side note how does Linux inbuilt OpenVPN client compare to this list?
     
  10. mirimir

    mirimir Registered Member

    Joined:
    Oct 1, 2011
    Posts:
    6,029
    Do they block it? Or do you need to do that yourself?
     
  11. mirimir

    mirimir Registered Member

    Joined:
    Oct 1, 2011
    Posts:
    6,029
    If you disable IPv6, NordVPN is leak-free in both Windows and OSX.
     
  12. mirimir

    mirimir Registered Member

    Joined:
    Oct 1, 2011
    Posts:
    6,029
  13. mirimir

    mirimir Registered Member

    Joined:
    Oct 1, 2011
    Posts:
    6,029
    Me too :) It was a hard call not to include them in the first set. I did too many, as it was. And it took far too long :(
    It leaks IPv6, always. And it leaks IPv4 while reconnecting after uplink interruption. Worse, Network Manager may kill the openvpn process after uplink interruption, and not reconnect at all. So you need to use iptables rules. And if you don't need IPv6 when not using the VPN, just disable it entirely.
     
  14. AJ79

    AJ79 Registered Member

    Joined:
    Apr 1, 2015
    Posts:
    10
    Self disabled, was told by their support team two years ago since then I been checking their FAQ
     
  15. mirimir

    mirimir Registered Member

    Joined:
    Oct 1, 2011
    Posts:
    6,029
    Thanks :)
     
  16. summerheat

    summerheat Registered Member

    Joined:
    May 16, 2015
    Posts:
    722
    Thank you very much! Good to know. :thumb:
     
  17. AutoCascade

    AutoCascade Registered Member

    Joined:
    Feb 16, 2014
    Posts:
    626
    Location:
    United States
    Great work on this!

    Froot seems like a bargain at $36 a year. I couldn't find anything on their site about caps but that price is much lower than some others seem to be.

    I have to work on the ip tables solution for the reconnect issue.
     
  18. caspian

    caspian Registered Member

    Joined:
    Jun 17, 2007
    Posts:
    2,301
    Location:
    Oz
    Mirmir, this is fantastic. Thanks you so much for doing this and sharing. And for all that you have shared.
     
  19. mirimir

    mirimir Registered Member

    Joined:
    Oct 1, 2011
    Posts:
    6,029
    Thanks, caspian :)
     
  20. n8chavez

    n8chavez Registered Member

    Joined:
    Jul 19, 2003
    Posts:
    2,302
    Location:
    Location Unknown
    Any thoughts on cryptostorm vpn?
     
  21. mirimir

    mirimir Registered Member

    Joined:
    Oct 1, 2011
    Posts:
    6,029
    Their custom clients in Windows and OSX leaked IPv6 whenever the machine was connected to the Internet. And they leaked IPv4 while reconnecting after uplink interruption.
     
  22. n8chavez

    n8chavez Registered Member

    Joined:
    Jul 19, 2003
    Posts:
    2,302
    Location:
    Location Unknown
    That's interesting. From what I can tell by looking at the connection log, IPv6 is disabled via script before the connection process is initiated.
     
  23. mirimir

    mirimir Registered Member

    Joined:
    Oct 1, 2011
    Posts:
    6,029
    Have you looked at IPv6 traffic with WinDump, Wireshark, etc?
     
  24. Brosephine

    Brosephine Registered Member

    Joined:
    Dec 4, 2015
    Posts:
    143
    Location:
    lo·ca·tion (noun) "a particular place or position"

    Ahh now I see where your loyalty to IVPN stems from!..Impressive work though. Very valuable information.


    This confirms my fear that most VPN's do not provide any security or privacy to its members, just the illusion of it. (which may be enough for most, but not all customers)

    I wasn't surprised to see VPN.HT on the $h!t list. I was lured in by their incredibly low monthly rate ($1) and decent amount of servers. It was clearly lacking features, but for a dollar i wasn't going to complain as long as it did the job. As a fellow tester of vpn's & other privacy goodies it didn't take long to figure out that their service was very subpar, maybe even pointless. I corresponded with them several times in regards to their leaks but they just insisted it was my fault. I honestly think it's a one man show. I was slightly surprised and disappointed to see PROXY.SH on the same list though. I guess they are a good example of not to judge a book by its cover, bec they look great and offer evey feature imaginable.

    Thanks for giving us personally tested, and mostly unbiased infomation ;) ha just kidding, because it's you I believe IVPN truly earned that perfect grade. I did try them out very recently and was impresssed on many levels.
     
  25. mirimir

    mirimir Registered Member

    Joined:
    Oct 1, 2011
    Posts:
    6,029
    Well, five others (AirVPN, FrootVPN, Mullvad, Perfect Privacy and SlickVPN) performed perfectly in Windows. And three others (OVPN.se, Private Internet Access and VyprVPN) performed perfectly in OSX. So it's just that IVPN managed that in both Windows and OSX :)

    Also, I pushed very hard. I captured all traffic. I used scripts to ping 8.8.8.8 at 1 sec interval, and to wget http://google.com at 10 sec interval. Then I basically disconnected the Internet for a few minutes, and then reconnected.
     
Loading...