blackpearl
The Devil
The Problem:
Sometimes you conduct some search on Google and the engine returns a number of results, but when you try to open the ones that looks the most promising you get a registration page. One thing that you can do is click on the cached content to view the page directly from Google's cache. But what if you want to view another page from the same site, not present in google's cache?
The Solution:
Its evident that there are some sites that allows Google but not you. So why not disguise yourself as Google? Thats exactly what we will do by changing the browser's user agent to Googlebot. Copy the following code into notepad and save it as a .reg file
Now double-click the file to merge it into registry. In order to change back to the default user agent use this:
Unfortunately, this only works with IE and not Opera. There is no way to add new user agent in Opera AFAIK. There is some way to do it in Firefox but you have to search that yourself on google. To check whether you have sucessfully changed the user agent, type the follwing into the address bar and hit enter.
Now for some practice. One good example is *www.governmentsecurity.org/forum/index.php. Anybody who has tried to visit this website will find that it requires you to register in order to view the forum. But registering is tricky. You need to submit your own article to the site afterwhich they will evaluate it and then decide whether to give you membership or not. Now visit this forum after spoofing your IE's user agent, aaha you are welcomed!!!
Note, that this method might not work with all websites.
Fun Exercise 1:
Use a different browser like Opera or Firefox to login to thinkdigit.com. Then click on Quick Links>Who's online (you will also find this near the bottom of the page). On the page that opens choose "Search Bots" and hit go. No matter what time of the day or night it is, you will find a couple of googlebots, msnbots and yahoobots crawling on the website. Now open IE and view thinkdigit.com, this time as a googlebot. Refresh the page you were viewing in your other browser. This time you will see another googlebot appearing which is actually you!!
Fun Exercise 2:
On the same "Who's online" page you can see what thread the other online members and guest are viewing at that particular time. Speaking of privacy, huh?
Sometimes you conduct some search on Google and the engine returns a number of results, but when you try to open the ones that looks the most promising you get a registration page. One thing that you can do is click on the cached content to view the page directly from Google's cache. But what if you want to view another page from the same site, not present in google's cache?
The Solution:
Its evident that there are some sites that allows Google but not you. So why not disguise yourself as Google? Thats exactly what we will do by changing the browser's user agent to Googlebot. Copy the following code into notepad and save it as a .reg file
Code:
Windows Registry Editor Version 5.00
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\Internet Settings\5.0\User Agent]
@="Googlebot/2.1"
"Compatible"="+*www.googlebot.com/bot.html"Now double-click the file to merge it into registry. In order to change back to the default user agent use this:
Code:
Windows Registry Editor Version 5.00
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\Internet Settings\5.0\User Agent]
@="Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)"Unfortunately, this only works with IE and not Opera. There is no way to add new user agent in Opera AFAIK. There is some way to do it in Firefox but you have to search that yourself on google. To check whether you have sucessfully changed the user agent, type the follwing into the address bar and hit enter.
Code:
javascript(BrowserDetect.browser)Now for some practice. One good example is *www.governmentsecurity.org/forum/index.php. Anybody who has tried to visit this website will find that it requires you to register in order to view the forum. But registering is tricky. You need to submit your own article to the site afterwhich they will evaluate it and then decide whether to give you membership or not. Now visit this forum after spoofing your IE's user agent, aaha you are welcomed!!!
Note, that this method might not work with all websites.
Fun Exercise 1:
Use a different browser like Opera or Firefox to login to thinkdigit.com. Then click on Quick Links>Who's online (you will also find this near the bottom of the page). On the page that opens choose "Search Bots" and hit go. No matter what time of the day or night it is, you will find a couple of googlebots, msnbots and yahoobots crawling on the website. Now open IE and view thinkdigit.com, this time as a googlebot. Refresh the page you were viewing in your other browser. This time you will see another googlebot appearing which is actually you!!
Fun Exercise 2:
On the same "Who's online" page you can see what thread the other online members and guest are viewing at that particular time. Speaking of privacy, huh?
