I noticed the following URL being spidered by google bot and was curious how this might happen:
Session ID:
Host: crawl-66-249-66-9.googlebot.com
User Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
/index.php?keyword=luddo&main_page=advanced_search_result&search_in_description=1
I have no link to this URL and dont understand how google can find it unless its got a whole lot cleverer and can perform advanced serches now ?




