Thread: Spider or not?

Results 1 to 5 of 5
  1. #1
    Join Date
    Aug 2008
    Posts
    115
    Plugin Contributions
    0

    Default Spider or not?

    Below are two recent entries in my Who's Online. The first declares as a guest and is being assigned a Session ID , while the latter is clearly a spider. However, the former's host name seems to imply (to me anyway) as though it is also a spider.

    Anyone able to confirm my interpretation for me?
    If not, then why would their "Host" contain "bot" and "search.msn"?


    ¥Guest 65.55.107.233
    Session ID: op2dpnrkvt7efdfgffgdebnrrr8i51
    Host: msnbot-65-55-107-233.search.msn.com
    User Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; SV1; .NET CLR 1.1.4322)



    ¥Spider 65.55.231.120
    Session ID:
    Host: 65.55.231.120
    User Agent: msnbot-media/1.1(+http://search.msn.com/msnbot.htm)

  2. #2
    Join Date
    Nov 2007
    Location
    Woodbine, Georgia, United States
    Posts
    4,252
    Plugin Contributions
    59

    Default Re: Spider or not?

    Those are genuinely MSN

    Check them out http://network-tools.com/

    ~Melanie
    PRO-Webs, Inc. since 2003 :: Zen Cart Hosting :: Zen Cart SEO – 12 Steps to Success
    **I answer questions in the forum, private messages are not conducive to a helpful community.

  3. #3
    Join Date
    Aug 2008
    Posts
    115
    Plugin Contributions
    0

    Default Re: Spider or not?

    Quote Originally Posted by mprough View Post
    Those are genuinely MSN
    Ummm...okay - MSN what? MSN Browser ...or MSN spider?

    I guess I'm also not comfortably sure I'm reading the results of Network Tools lookup correctly. It clearly tells me that it's from Microsoft Corp network ....but how do I know whether it wasn't simply an employee visitng my site?

  4. #4
    Join Date
    Nov 2007
    Location
    Woodbine, Georgia, United States
    Posts
    4,252
    Plugin Contributions
    59

    Default Re: Spider or not?

    PRO-Webs, Inc. since 2003 :: Zen Cart Hosting :: Zen Cart SEO – 12 Steps to Success
    **I answer questions in the forum, private messages are not conducive to a helpful community.

  5. #5
    Join Date
    Aug 2008
    Posts
    115
    Plugin Contributions
    0

    Default Re: Spider or not?

    Quote Originally Posted by mprough View Post
    msnbot = spider

    Okay, thanks!
    Now the question is: If the visitor question in IS a bot - then it should be recognized as such and not be assigned a Session ID.

    However, my "spiders.txt" already contains an entry "msnbot" and this entity was not recognized. It appears that Zencart examines the User Agent data and not the Host data for its determination.

    Since this entity is supposedly a Bot but its User Agent resembles a browser, then how does one get it to be recognized as a bot ??? There's nothing in the user agent line to designate it as a one.

    Host: msnbot-65-55-107-233.search.msn.com
    User Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; SV1; .NET CLR 1.1.4322)

    Any thoughts???

 

 

Similar Threads

  1. Replies: 3
    Last Post: 25 Nov 2010, 02:10 PM
  2. My IP - as spider?
    By ekele in forum General Questions
    Replies: 5
    Last Post: 24 Aug 2010, 11:56 PM
  3. Replies: 5
    Last Post: 15 Jan 2008, 07:27 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
disjunctive-egg