Steven Black's unified hosts file

Discussion in 'other software & services' started by summerheat, Aug 4, 2016.

  1. summerheat

    summerheat Registered Member

    Joined:
    May 16, 2015
    Posts:
    720
    I just came across https://github.com/StevenBlack/hosts which offers a unified hosts file comprised of several well-known hosts files (Adaway, MVPS, Dan Pollock, Malware Domain List, Peter Lowe).

    The big advantage is that duplicates are already removed. This is not only very convenient if you're using a system-wide hosts file but also for uMatrix and uBlock0 as the download size for the updates of the various included hosts files is significantly reduced.

    Very useful service, indeed!
     
  2. Overkill

    Overkill Registered Member

    Joined:
    Mar 16, 2012
    Posts:
    2,131
    Location:
    USA
    Nice! where is the link located that I can add to hostsman?
     
  3. Nutty Kutchie

    Nutty Kutchie Registered Member

    Joined:
    Apr 10, 2015
    Posts:
    68
  4. WildByDesign

    WildByDesign Registered Member

    Joined:
    Sep 24, 2013
    Posts:
    1,622
    Location:
    Toronto, Canada
    That's a great combination of reputable hosts files, for sure. Also great for the fact that the duplicates are removed.
     
  5. Overkill

    Overkill Registered Member

    Joined:
    Mar 16, 2012
    Posts:
    2,131
    Location:
    USA
  6. summerheat

    summerheat Registered Member

    Joined:
    May 16, 2015
    Posts:
    720
  7. summerheat

    summerheat Registered Member

    Joined:
    May 16, 2015
    Posts:
    720
    This must be a Hostsman problem. The format of the hosts file is as it should be. And I don't have any problems using it in uMatrix and in Adaway (on my Android phone).
     
  8. quietman

    quietman Registered Member

    Joined:
    Dec 27, 2014
    Posts:
    488
    Location:
    Earth .... occasionally
    @summerheat

    Thank you for posting ..... I've been wanting something like this !

    I used to use Hostsman but switched to Hosts Block some time ago , and I'm not seeing any compatibility issues there.

    The removal of duplicates is definitely a big bonus , especially for uBlock0
     
  9. mapletree

    mapletree Registered Member

    Joined:
    Oct 31, 2012
    Posts:
    11
    -- IE.11 / w7x64 / 16 gb RAM / 3rd gen i7 --


    History = AdBlock plus for IE for 2 months (EasyList only) -- a better experience than before,
    but didn't seem to auto-update as it should - full permissions granted in PFW, too

    *still got pre-video YouTube ads,

    *still got new tab pop-outs whilst entering Search terms or copy-clicking on a webpage,
    in various forums

    NOW !! - Using Mr. Black's file for 2 weeks - very, VERY happy - night/day difference!

    especially the IMMEDIATE lack of ads prefacing YouTube vids!!

    I just dL'd the desired file and manually installed it,
    but I am also experimenting with every Hosts file manager I could find over the past few days --

    [so far, the most robust & feature-rich seem to be the trusty HostsMan,
    HostsBlock by Brocke here @ Wilders, HostsXpert by funkytoad,
    Host Mechanic by HackerPunk1 (askVG), and Host File Editor by weebly (mvps) --

    a couple of others show up in search, but they simply won't load up for me,
    even w/ nothing else running - while those mentioned will fire up inside 10 seconds. ]

    Cheers

    (btw - a little trick I stumbled on whilst annoyed that ABP wasn't blocking these YouTube ads --

    the 'magic number' seemed to be to allow 5 seconds of ad play, then F5 Refresh,
    and then the desired video plays -- works about 80% of the time --
    occasionally had to do this little dance twice -- still worth it if the ad > 30 seconds or so)
     
  10. chrcol

    chrcol Registered Member

    Joined:
    Apr 19, 2006
    Posts:
    748
    Location:
    UK
    one needs to be very careful with these host lists, they dont get the same care as things like easylist.

    The 2 main problems are, is there is domains in some of these lists that are nothing to do with tracking or malware, but go against the author's belief's e.g. betting sites.

    Second is some domains need partial filtering but not an outright block otherwise websites break.
     
  11. summerheat

    summerheat Registered Member

    Joined:
    May 16, 2015
    Posts:
    720
    The hosts files used here are of good quality. But it's true that this doesn't apply to other lists. I've used hosts files in the past that produced many false positives.

    That's why there are several variants of that list. And that's why I prefer using those lists in uMatrix as it's much easier to whitelist specific sites.

    As a matter of fact most domains need a partial filtering as blocking the whole domain is usually effectless in hosts files. Examples:

    Code:
    0.0.0.0 doubleclick.net
    does not block, e.g.,
    Code:
    ad-g.doubleclick.net
    ad.doubleclick.net
    ad.mo.doubleclick.net
    googleads.g.doubleclick.net
    In other words, through a hosts file only the specific entries therein are blocked. However, if you're using, e.g., dnsmasq as an alternative and you add
    Code:
    address=/doubleclick.net/0.0.0.0
    to its configuration file all sub-domains of doubleclick.net are also blocked.
     
  12. chrcol

    chrcol Registered Member

    Joined:
    Apr 19, 2006
    Posts:
    748
    Location:
    UK
    by partial filtering I dont mean sub domains, I mean partial filtering of http data.

    Also yes mvps and pollocks will both break some sites.
     
Loading...