Thread: Odd Agent

Results 1 to 8 of 8
  1. #1
    Join Date
    Jun 2007
    Posts
    145
    Plugin Contributions
    0

    Default Odd Agent

    I've just taken a look at Who's Online and found a user agent 'Java/1.7.0' from IP address 38.99.186.40 working its way through my store at about 2 or 3 pages per second.

    I'm fairly confident it isn't a hack attempt.

    I'm assuming someone may be cloning my site.

    For now I've blocked the IP in my CPanel, but I'm wondering if there's anything else I should be doing?
    We're now settled in at our final home - http://www.swiftbooks.co.uk - where you'll find an eclectic collection of used books. Still a lot of work to do, though!

  2. #2
    Join Date
    Oct 2006
    Posts
    5,477
    Plugin Contributions
    11

    Default Re: Odd Agent

    Cloning? How? And Why?
    I no longer provide installation support on forum for all my modules. However, if there are real bugs with the modules please feel free to contact me

  3. #3
    Join Date
    Jun 2007
    Posts
    145
    Plugin Contributions
    0

    Default Re: Odd Agent

    To be honest I'm not sure exactly what it is doing, but I have found this: http://www.botsvsbrowsers.com/details/206520/index.html

    If you click on the 'Click here to test this user agent' link and put in a URL it returns the page. At 2 to 3 pages per second all I can assume is that someone is using the agent to crawl the site.

    I'm concerned mainly about cloning, but also about bandwidth and performance for real users.

    I haven't been able to find anything positive about the agent (it doesn't appear to be connected with any search engine crawlers, for example).
    We're now settled in at our final home - http://www.swiftbooks.co.uk - where you'll find an eclectic collection of used books. Still a lot of work to do, though!

  4. #4
    Join Date
    Oct 2006
    Posts
    5,477
    Plugin Contributions
    11

    Default Re: Odd Agent

    As far as I concern, cloning is inevitable, there is no way you can prevent people from doing that.

    Performance and bw issue are valid tho.
    I no longer provide installation support on forum for all my modules. However, if there are real bugs with the modules please feel free to contact me

  5. #5
    Join Date
    Nov 2007
    Location
    Woodbine, Georgia, United States
    Posts
    4,009
    Plugin Contributions
    61

    Default Re: Odd Agent

    The user agent may be associated with a sitemap generator or similar as well... Most are Java based and would crawl at about that rate if configured properly.

    ~Melanie
    PRO-Webs, Inc. :: Recent Zen Cart Projects :: Zen Cart SEO – 12 Steps to Success
    **I answer questions in the forum, private messages are NOT answered. You are welcome to contact us via our website for professional engagements.

  6. #6
    Join Date
    Jun 2007
    Posts
    145
    Plugin Contributions
    0

    Default Re: Odd Agent

    Well, if we catch 'em at it it's as well to slam the door in their face!

    Guess I'll leave it at that for the night then think about blocking the agent in my robots.txt file so they can't get access from a different IP.
    We're now settled in at our final home - http://www.swiftbooks.co.uk - where you'll find an eclectic collection of used books. Still a lot of work to do, though!

  7. #7
    Join Date
    Jun 2007
    Posts
    145
    Plugin Contributions
    0

    Default Re: Odd Agent

    Could be. I'll sleep on it before trawling through the log files to see if that IP has been around before. It seems to have odd whois details so I'm wary of it.
    We're now settled in at our final home - http://www.swiftbooks.co.uk - where you'll find an eclectic collection of used books. Still a lot of work to do, though!

  8. #8
    Join Date
    Nov 2007
    Location
    Woodbine, Georgia, United States
    Posts
    4,009
    Plugin Contributions
    61

    Default Re: Odd Agent

    Guess I'll leave it at that for the night then think about blocking the agent in my robots.txt file so they can't get access from a different IP.
    This will ONLY work if it is a well behaved bot

    ~Melanie
    PRO-Webs, Inc. :: Recent Zen Cart Projects :: Zen Cart SEO – 12 Steps to Success
    **I answer questions in the forum, private messages are NOT answered. You are welcome to contact us via our website for professional engagements.

 

 

Similar Threads

  1. User agent
    By dddmx3 in forum Templates, Stylesheets, Page Layout
    Replies: 0
    Last Post: 20 Feb 2011, 07:04 PM
  2. Odd error - well, I think it's odd
    By Ryk in forum Templates, Stylesheets, Page Layout
    Replies: 5
    Last Post: 22 Aug 2007, 01:20 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
disjunctive-egg
Zen-Cart, Internet Selling Services, Klamath Falls, OR