Cloning? How? And Why?
Thread: Odd Agent
Results 1 to 8 of 8
Hybrid View
-
16 Oct 2008, 10:16 PM #1
Totally Zenned
- Join Date
- Oct 2006
- Posts
- 5,477
- Plugin Contributions
- 11
Re: Odd Agent
I no longer provide installation support on forum for all my modules. However, if there are real bugs with the modules please feel free to contact me
-
16 Oct 2008, 10:25 PM #2
Zen Follower
- Join Date
- Jun 2007
- Posts
- 145
- Plugin Contributions
- 0
Re: Odd Agent
To be honest I'm not sure exactly what it is doing, but I have found this: http://www.botsvsbrowsers.com/details/206520/index.html
If you click on the 'Click here to test this user agent' link and put in a URL it returns the page. At 2 to 3 pages per second all I can assume is that someone is using the agent to crawl the site.
I'm concerned mainly about cloning, but also about bandwidth and performance for real users.
I haven't been able to find anything positive about the agent (it doesn't appear to be connected with any search engine crawlers, for example).We're now settled in at our final home - http://www.swiftbooks.co.uk - where you'll find an eclectic collection of used books. Still a lot of work to do, though!
-
16 Oct 2008, 10:34 PM #3
Totally Zenned
- Join Date
- Oct 2006
- Posts
- 5,477
- Plugin Contributions
- 11
Re: Odd Agent
As far as I concern, cloning is inevitable, there is no way you can prevent people from doing that.
Performance and bw issue are valid tho.I no longer provide installation support on forum for all my modules. However, if there are real bugs with the modules please feel free to contact me
-
16 Oct 2008, 10:40 PM #4
Totally Zenned
- Join Date
- Nov 2007
- Location
- Woodbine, Georgia, United States
- Posts
- 4,247
- Plugin Contributions
- 58
Re: Odd Agent
The user agent may be associated with a sitemap generator or similar as well... Most are Java based and would crawl at about that rate if configured properly.
~MelaniePRO-Webs, Inc. since 2003 :: Zen Cart Hosting :: Zen Cart SEO – 12 Steps to Success
**I answer questions in the forum, private messages are not conducive to a helpful community.
-
16 Oct 2008, 10:43 PM #5
Zen Follower
- Join Date
- Jun 2007
- Posts
- 145
- Plugin Contributions
- 0
Re: Odd Agent
Could be. I'll sleep on it before trawling through the log files to see if that IP has been around before. It seems to have odd whois details so I'm wary of it.
We're now settled in at our final home - http://www.swiftbooks.co.uk - where you'll find an eclectic collection of used books. Still a lot of work to do, though!
-
16 Oct 2008, 11:00 PM #6
Totally Zenned
- Join Date
- Nov 2007
- Location
- Woodbine, Georgia, United States
- Posts
- 4,247
- Plugin Contributions
- 58
Re: Odd Agent
This will ONLY work if it is a well behaved botGuess I'll leave it at that for the night then think about blocking the agent in my robots.txt file so they can't get access from a different IP.
~MelaniePRO-Webs, Inc. since 2003 :: Zen Cart Hosting :: Zen Cart SEO – 12 Steps to Success
**I answer questions in the forum, private messages are not conducive to a helpful community.
-
16 Oct 2008, 10:41 PM #7
Zen Follower
- Join Date
- Jun 2007
- Posts
- 145
- Plugin Contributions
- 0
Re: Odd Agent
Well, if we catch 'em at it it's as well to slam the door in their face!
Guess I'll leave it at that for the night then think about blocking the agent in my robots.txt file so they can't get access from a different IP.We're now settled in at our final home - http://www.swiftbooks.co.uk - where you'll find an eclectic collection of used books. Still a lot of work to do, though!
Similar Threads
-
User agent
By dddmx3 in forum Templates, Stylesheets, Page LayoutReplies: 0Last Post: 20 Feb 2011, 07:04 PM -
Odd error - well, I think it's odd
By Ryk in forum Templates, Stylesheets, Page LayoutReplies: 5Last Post: 22 Aug 2007, 01:20 PM
