Surfing as Googlebot

Discussion in 'privacy general' started by lotuseclat79, Aug 15, 2007.

Thread Status:
Not open for further replies.
  1. lotuseclat79

    lotuseclat79 Registered Member

    Joined:
    Jun 16, 2005
    Posts:
    5,094
    I saw the following on digg.com (253:cool: this AM and thought I would post it here for comments:

    Surfing As GoogleBot - Their IP, Their User-Agent, Their Bot Characteristics.

    The interesting thing about the article is that it mentions 5 different types of cloaking and how to beat them:
    1. Beat IP Delivery: Use Google Translate as a Proxy, translating from spanish->english even though the site is already in English.
    2. Beat User-Agent Cloaking: Use the FirefoxUser-Agent Switcher to spoof as GoogleBot
    3. Beat Javascript Detection: Use the Firefox Web Developer Toolbar to turn off javascript.
    4. Beat Cookie Detection: Use the Firefox Web Developer Toolbar to turn off cookies.
    5. Beat Referer Detection: Use the Firefox RefControl Extension to prevent referer from being sent.

    Is this legal?

    -- Tom
     
  2. WSFuser

    WSFuser Registered Member

    Joined:
    Oct 7, 2004
    Posts:
    10,632
    Re: Surfing as Gogglebot

    I have to try this out.
     
  3. acknsyn

    acknsyn Registered Member

    Joined:
    Aug 10, 2007
    Posts:
    27
    Re: Surfing as Gogglebot

    What is the advantage of this? Everything you do will be cache by google and your using their IP but they have your IP.
     
  4. lotuseclat79

    lotuseclat79 Registered Member

    Joined:
    Jun 16, 2005
    Posts:
    5,094
    Re: Surfing as Gogglebot

    Hi acknsyn,

    Googlebot is a webcrawler that visits websites to cache them. In no way shape or form will Google cache a masqueraded use of Googlebots identity to hide your privacy be cached and the website you visit apparently won't know your IP when you use Google Translate as a proxy.

    -- Tom

    P.S. I just want to know if its legal or not - it does sound as though its sneaky.
     
  5. acknsyn

    acknsyn Registered Member

    Joined:
    Aug 10, 2007
    Posts:
    27
    Re: Surfing as Gogglebot

    That is true but Google knows your IP as your using it as a proxy. I dont see anything illegal about using it unless there is specific warning about such usage from Google, but I have no background in law.
     
  6. SteveTX

    SteveTX Registered Member

    Joined:
    Mar 27, 2007
    Posts:
    1,641
    Location:
    TX
    Re: Surfing as Gogglebot

    You will be able to surf as googlebot in xB Browser 2.0.0.6b

    All you have to do is select it from the dropdown box on the navigation bar and suddenly you are browsing the New York Times for free.
     
  7. The_1337

    The_1337 Registered Member

    Joined:
    Aug 10, 2007
    Posts:
    112
    Re: Surfing as Gogglebot

    do you have to set anything up?
     
  8. beethoven

    beethoven Registered Member

    Joined:
    Dec 27, 2004
    Posts:
    1,042
    Re: Surfing as Gogglebot

    Sounds to me like stealing - just imagine you go into a shop with a hood over your face and take the things you like just because you are not afraid of being caught.
    I can well imagine situations where using this procedure is legal and appropriate but to obtain services that otherwise cost money would not fall into this category.
     
  9. Paranoid2000

    Paranoid2000 Registered Member

    Joined:
    May 2, 2004
    Posts:
    2,839
    Location:
    North West, United Kingdom
    Re: Surfing as Gogglebot

    When you are gaining access to content online, "stealing" isn't really an accurate term - "unauthorised access" would be better. This certainly may be illegal in some juristictions, but if a website chooses to create such a security hole just to gain search engine ranking, it presumably considers this a price worth paying.
     
  10. AJohn

    AJohn Registered Member

    Joined:
    Sep 29, 2004
    Posts:
    935
    Re: Surfing as Gogglebot

    This may sound funny, but you finally earned my full trust :D
     
  11. iceni60

    iceni60 ( ^o^)

    Joined:
    Jun 29, 2004
    Posts:
    5,116
    Re: Surfing as Gogglebot

    what's a gogglebot lol
     
  12. AJohn

    AJohn Registered Member

    Joined:
    Sep 29, 2004
    Posts:
    935
    Re: Surfing as Gogglebot

    A computer set up by Google to constantly scan websites and submit the information back to Google.
     
  13. Meriadoc

    Meriadoc Registered Member

    Joined:
    Mar 28, 2006
    Posts:
    2,642
    Location:
    Cymru
    Re: Surfing as Gogglebot

    You can also choose it using Konq, under tools, configure...
     

    Attached Files:

  14. iceni60

    iceni60 ( ^o^)

    Joined:
    Jun 29, 2004
    Posts:
    5,116
    Re: Surfing as Gogglebot

    looooooool, that's a googlebot, not a gogglebot.

    you can do all that with proxomitron too, it's posted here if you search for googlebot and proxomitron.
     
  15. AJohn

    AJohn Registered Member

    Joined:
    Sep 29, 2004
    Posts:
    935
    Re: Surfing as Gogglebot

    Ohh, well the topic should read "Google" :D
     
  16. firefox2008

    firefox2008 Registered Member

    Joined:
    May 17, 2007
    Posts:
    125
  17. iceni60

    iceni60 ( ^o^)

    Joined:
    Jun 29, 2004
    Posts:
    5,116
    Re: Surfing as Gogglebot

    :p

    i decided to add the googlebot filter to proxomitron, but when i enable it and go to the wilders front page -
    https://www.wilderssecurity.com/index.php
    all the stuff at the bottom of the page disappears o_O

    here's what i mean -

    this is without the googlebot filter showing how the forum normally looks -

    without_googlebot_filter.jpg

    and this is how it looks when i enable the filter, stuff goes missing at the bottom of the forum :(

    with_googlebot_filter.jpg

    does that happen to any one else while using the googlebot User-Agent? or is it only me? is anyone else using the proxomitron googlebot filter? i was thinking maybe it's how the forum is setup, but i don't think that really sounds right, so maybe it's a problem with proxo :blink:
     
  18. LowWaterMark

    LowWaterMark Administrator

    Joined:
    Aug 10, 2002
    Posts:
    17,874
    Location:
    New England
    Re: Surfing as Gogglebot

    That is how the forum is setup. Googlebot doesn't need to see who's online at any particular moment, or the member birthdays and so on, so none of that displays for them. It's basically a simplified page for indexing purposes.
     
  19. caspian

    caspian Registered Member

    Joined:
    Jun 17, 2007
    Posts:
    2,301
    Location:
    Oz
    Re: Surfing as Gogglebot

    What's the benefit of using it? Do you have access to sites that you normally would not have access to
     
  20. iceni60

    iceni60 ( ^o^)

    Joined:
    Jun 29, 2004
    Posts:
    5,116
    Re: Surfing as Gogglebot

    thanks for the help.
    you might get more access to some sites, maybe forums, like using google cache in google search results.
     
  21. caspian

    caspian Registered Member

    Joined:
    Jun 17, 2007
    Posts:
    2,301
    Location:
    Oz
    Re: Surfing as Gogglebot

    I didn't see it in XB. What is it listed as?
     
Thread Status:
Not open for further replies.