begood Posted March 28, 2010 Report Share Posted March 28, 2010 The User-Agent field is used by various websites to identify when web crawlers such as Google's Googlebot and Yahoo!'s Slurp, visits their website. Interestingly, many webmasters naively use this to open up protected pages on their website (otherwise not visible without e.g. logging into the website) to Google, so it may mine and list those pages in its web search. Unfortunately, as the User-Agent can be easily modified, this form of authenticating provides almost no protection against spoofing attacks! In this video we will see how one can trivially change the User-agent string in Firefox and emulate Googlebot or any other web crawler's User-Agent string. The websites used in the below video are listed in the Links section below.Changing your Firefox User Agent to Emulate Googlebot Tutorial Quote Link to comment Share on other sites More sharing options...
pyth0n3 Posted March 29, 2010 Report Share Posted March 29, 2010 The User-Agent field is used by various websites to identify when web crawlers such as Google's Googlebot and Yahoo!'s Slurp, visits their website. Interestingly, many webmasters naively use this to open up protected pages on their website (otherwise not visible without e.g. logging into the website) to Google, so it may mine and list those pages in its web search. Unfortunately, as the User-Agent can be easily modified, this form of authenticating provides almost no protection against spoofing attacks! In this video we will see how one can trivially change the User-agent string in Firefox and emulate Googlebot or any other web crawler's User-Agent string. The websites used in the below video are listed in the Links section below.Changing your Firefox User Agent to Emulate Googlebot TutorialVezi doar singura problema e ca pe multe forumuri nu te lasa sa te loghezi daca esti un google bot .Mi-am dat seama pt ca eu aveam setat un User Agent cu Google bot iar dupa login ma scoteau astia afara si nu reuseam sa intru pana nu am schimbat Userul Agent ,Problema e si cu ceilati boti Msn ,Yahoo Slurp .In rest merge perfect sa navighezi Atentie la login in diverse forumuri ,daca va scoate afara controlati ce User Agent aveti Quote Link to comment Share on other sites More sharing options...
