My VPN Testing Site is Finally Up

Discussion in 'privacy technology' started by mirimir, Jun 16, 2016.

  1. mirimir

    mirimir Registered Member

    https://vpntesting.info/

    I tested 29 Windows VPN clients for DNS, IPv4 and IPv6 Leaks. Six (AirVPN, FrootVPN, IVPN, Mullvad, Perfect Privacy and SlickVPN) performed perfectly. Three others (CyberGhost, oVPN.to and SecureVPN.to) hit VPN-specified nameservers directly while reconnecting after uplink interruption. But that's not a huge issue, in that they didn't hit other nameservers. The other 20 Windows VPN clients failed in various ways. Over half leaked IPv6 packets whenever the machine was connected to the Internet. After uplink interruption, some failed to reconnect automatically, and some leaked IPv4 packets.
     
    Last edited: Jun 16, 2016
  2. marzametal

    marzametal Registered Member

    Wow, very interesting reading. *applauds effort*
     
  3. quietman

    quietman Registered Member

    An excellent piece of work ..... many thanks , much appreciated !

    In the main , I thought the results were not that surprising ....
    The top performers were pretty much in line with anecdotal reports in various places , and the same ones that have
    been so frequently recommended here at Wilders over the years .

    What did surprise me was how many get leaky on reconnect ..... something to bear in mind when choosing / changing a
    VPN provider .
     
  4. trott3r

    trott3r Registered Member

  5. mirimir

    mirimir Registered Member

    I've updated the site, and added results for OSX :)
    It's true that IVPN provided funding and technical support. Also, I knew that IVPN wouldn't leak, because I had written https://www.ivpn.net/privacy-guides/how-to-perform-a-vpn-leak-test for them. But I was hoping that more of the rest wouldn't leak.

    Please recommend others to test, or retest. Currently, I'm planning to test BolehVPN, Insorg, Windscribe and Witopia. I gather that AirVPN and NordVPN have updated clients, so I'm planning to retest them.
     
  6. summerheat

    summerheat Registered Member

    Thanks for this great site! I'm looking forward to the NordVPN retest as I'm using that one - I hope that they have improved.
     
  7. AJ79

    AJ79 Registered Member

    NordVPN have not yet support IPv6.
     
  8. Minimalist

    Minimalist Registered Member

    Since I'm using it, I would recommend testing F-Secure Freedmome VPN.
     
  9. driekus

    driekus Registered Member

    Fantastic work, very interested to see BolehVPN windows client.

    On a side note how does Linux inbuilt OpenVPN client compare to this list?
     
  10. mirimir

    mirimir Registered Member

    Do they block it? Or do you need to do that yourself?
     
  11. mirimir

    mirimir Registered Member

    If you disable IPv6, NordVPN is leak-free in both Windows and OSX.
     
  12. mirimir

    mirimir Registered Member

  13. mirimir

    mirimir Registered Member

    Me too :) It was a hard call not to include them in the first set. I did too many, as it was. And it took far too long :(
    It leaks IPv6, always. And it leaks IPv4 while reconnecting after uplink interruption. Worse, Network Manager may kill the openvpn process after uplink interruption, and not reconnect at all. So you need to use iptables rules. And if you don't need IPv6 when not using the VPN, just disable it entirely.
     
  14. AJ79

    AJ79 Registered Member

    Self disabled, was told by their support team two years ago since then I been checking their FAQ
     
  15. mirimir

    mirimir Registered Member

    Thanks :)
     
  16. summerheat

    summerheat Registered Member

    Thank you very much! Good to know. :thumb:
     
  17. AutoCascade

    AutoCascade Registered Member

    Great work on this!

    Froot seems like a bargain at $36 a year. I couldn't find anything on their site about caps but that price is much lower than some others seem to be.

    I have to work on the ip tables solution for the reconnect issue.
     
  18. caspian

    caspian Registered Member

    Mirmir, this is fantastic. Thanks you so much for doing this and sharing. And for all that you have shared.
     
  19. mirimir

    mirimir Registered Member

    Thanks, caspian :)
     
  20. n8chavez

    n8chavez Registered Member

    Any thoughts on cryptostorm vpn?
     
  21. mirimir

    mirimir Registered Member

    Their custom clients in Windows and OSX leaked IPv6 whenever the machine was connected to the Internet. And they leaked IPv4 while reconnecting after uplink interruption.
     
  22. n8chavez

    n8chavez Registered Member

    That's interesting. From what I can tell by looking at the connection log, IPv6 is disabled via script before the connection process is initiated.
     
  23. mirimir

    mirimir Registered Member

    Have you looked at IPv6 traffic with WinDump, Wireshark, etc?
     
  24. Brosephine

    Brosephine Registered Member


    Ahh now I see where your loyalty to IVPN stems from!..Impressive work though. Very valuable information.


    This confirms my fear that most VPN's do not provide any security or privacy to its members, just the illusion of it. (which may be enough for most, but not all customers)

    I wasn't surprised to see VPN.HT on the $h!t list. I was lured in by their incredibly low monthly rate ($1) and decent amount of servers. It was clearly lacking features, but for a dollar i wasn't going to complain as long as it did the job. As a fellow tester of vpn's & other privacy goodies it didn't take long to figure out that their service was very subpar, maybe even pointless. I corresponded with them several times in regards to their leaks but they just insisted it was my fault. I honestly think it's a one man show. I was slightly surprised and disappointed to see PROXY.SH on the same list though. I guess they are a good example of not to judge a book by its cover, bec they look great and offer evey feature imaginable.

    Thanks for giving us personally tested, and mostly unbiased infomation ;) ha just kidding, because it's you I believe IVPN truly earned that perfect grade. I did try them out very recently and was impresssed on many levels.
     
  25. mirimir

    mirimir Registered Member

    Well, five others (AirVPN, FrootVPN, Mullvad, Perfect Privacy and SlickVPN) performed perfectly in Windows. And three others (OVPN.se, Private Internet Access and VyprVPN) performed perfectly in OSX. So it's just that IVPN managed that in both Windows and OSX :)

    Also, I pushed very hard. I captured all traffic. I used scripts to ping 8.8.8.8 at 1 sec interval, and to wget http://google.com at 10 sec interval. Then I basically disconnected the Internet for a few minutes, and then reconnected.
     
  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice