Block Spider Bot - RPT-HTTPClient/0.3-3

[miles]

I found this bot keeps crawling my site.

IP:70.79.138.3
Host: S01060012f089f4dc.vc.shawcable.net
User Agent: RPT-HTTPClient/0.3-3
/search/?search_in_description=1&keyword=Drum+Cases+and+Gig+Bags&inc_subcat=0&sort=20a

I try to add this to my robots.txt file

User-agent: RPT-HTTPClient/0.3-3
Disallow: /

But it keeps crawling. How do I block it?

[mprough]

Thats not a robot..... likely a scraper.

Shaw cable is an ISP http://www.shaw.ca/en-ca

Block the IP in you htaccess

~Melanie

[tony_sar]

RPT-HTTPClient is a Java library: http://www.innovation.ch/java/HTTPClient/

It was one of the earliest implementations of HTTP 1.1, and is listed as such at http://www.w3.org/Protocols/HTTP/Forum/

Your visitor could be anything from a link-checking applet to a full-fledged browser.

Thats the information i found regarding that User agent.. so it is possible that's just a browser , not to mention the ip is coming from shawcable which is ISP based in U.S and Canada.