2 May 2008, 11:17 AM
New Zenner
- Join Date:
- Mar 2007
- Location:
- Cheshire
- Posts:
- 73
- Plugin Contributions:
- 0
Weird Googlebot behaviour!
I noticed the following URL being spidered by google bot and was curious how this might happen:
Session ID:
Host: crawl-66-249-66-9.googlebot.com
User Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
/index.php?keyword=luddo&main_page=advanced_search_result&search_in_description=1
I have no link to this URL and dont understand how google can find it unless its got a whole lot cleverer and can perform advanced serches now ?
