Results 1 to 8 of 8
  1. #1
    Join Date
    May 2016
    Posts
    188
    Plugin Contributions
    0

    Default Easiest Way To Block Spambots Crawling?

    Hey guys,

    Currently getting bombarded by Yannik, b a i d u and Poneytelecom.eu. I noticed an increased search for a particular manufacturer too. It seems to have been spammed. I tried blocking them through robots.txt, they ignore the robots.txt. I tried blocking them through .htaccess with
    Code:
    RewriteEngine On
    RewriteCond %blahblahblah
    RewriteRule .* - [F]
    But they just come back with a new IP within seconds.

    Any help would be appreciated,

    Cheers,

    Ash.
    http://www.youtube.com/c/csgodeimos - New Videos Wednesday & Saturday
    Gaming Content / Deimos

  2. #2
    Join Date
    Aug 2009
    Location
    North Idaho, USA
    Posts
    2,008
    Plugin Contributions
    1

    Default Re: Easiest Way To Block Spambots Crawling?


    https://www.zen-cart.com/downloads.php?do=file&id=1854

    Zencart Block Bad Bots plugin.
    We have nearly 100 variants of the file in use. Doesn't depend upon IP address.
    Rick
    RixStix (dot) com
    aka: ChainWeavers (dot) com

  3. #3
    Join Date
    May 2016
    Posts
    188
    Plugin Contributions
    0

    Default Re: Easiest Way To Block Spambots Crawling?

    Quote Originally Posted by RixStix View Post

    https://www.zen-cart.com/downloads.php?do=file&id=1854

    Zencart Block Bad Bots plugin.
    We have nearly 100 variants of the file in use. Doesn't depend upon IP address.

    I'll give this a try and see if it works, just added them in.
    How is this different to doing it via the .htaccess file though?
    http://www.youtube.com/c/csgodeimos - New Videos Wednesday & Saturday
    Gaming Content / Deimos

  4. #4
    Join Date
    May 2016
    Posts
    188
    Plugin Contributions
    0

    Default Re: Easiest Way To Block Spambots Crawling?

    Quote Originally Posted by RixStix View Post
    x
    This doesn't seem to be working for "rev.poneytelecom.eu"
    Which seems to be the one spamming the sites search with random queries.
    http://www.youtube.com/c/csgodeimos - New Videos Wednesday & Saturday
    Gaming Content / Deimos

  5. #5
    Join Date
    Aug 2009
    Location
    North Idaho, USA
    Posts
    2,008
    Plugin Contributions
    1

    Default Re: Easiest Way To Block Spambots Crawling?

    Quote Originally Posted by CSGODeimos View Post
    How is this different to doing it via the .htaccess file though?
    It blocks by matching a portion of the User-Agent string that you use/insert into the file.
    We create an additional file for each User-Agent that we choose to block.
    I never use the entire User-Agent, only a portion which I happen to consider unique to that User-Agent.
    Rick
    RixStix (dot) com
    aka: ChainWeavers (dot) com

  6. #6
    Join Date
    May 2016
    Posts
    188
    Plugin Contributions
    0

    Default Re: Easiest Way To Block Spambots Crawling?

    Quote Originally Posted by RixStix View Post
    It blocks by matching a portion of the User-Agent string that you use/insert into the file.
    We create an additional file for each User-Agent that we choose to block.
    I never use the entire User-Agent, only a portion which I happen to consider unique to that User-Agent.

    Okay, which would be Poneytelecom but that's still not working sadly. They're now spamming both websites with search queries.
    http://www.youtube.com/c/csgodeimos - New Videos Wednesday & Saturday
    Gaming Content / Deimos

  7. #7
    Join Date
    Aug 2009
    Location
    North Idaho, USA
    Posts
    2,008
    Plugin Contributions
    1

    Default Re: Easiest Way To Block Spambots Crawling?

    Is that part of the User-Agent string or part of the URL?

    Suggestions would be
    Did you drop the file(s) in the proper zencart folder?
    Did you properly edit the 'example' file and/or create you own copy of it?

    You will still see them in the cpanel with a 410 error but not in your zencart whosonline.
    You didn't say where you are seeing them.

    Not a coder here, it would take DrByte (who wrote the code snippet) to say why it is not functioning in v154
    Rick
    RixStix (dot) com
    aka: ChainWeavers (dot) com

  8. #8
    Join Date
    May 2016
    Posts
    188
    Plugin Contributions
    0

    Default Re: Easiest Way To Block Spambots Crawling?

    Quote Originally Posted by RixStix View Post
    Is that part of the User-Agent string or part of the URL?

    Suggestions would be
    Did you drop the file(s) in the proper zencart folder?
    Did you properly edit the 'example' file and/or create you own copy of it?

    You will still see them in the cpanel with a 410 error but not in your zencart whosonline.
    You didn't say where you are seeing them.

    Not a coder here, it would take DrByte (who wrote the code snippet) to say why it is not functioning in v154
    I copied the example file and edited it. Managed to get it to work I think. Did another Google search and the url + ip came up with a forum where people were talking about something called ahref, I copied the example file, edited it appropriately and I haven't had any hits + queries since. I'm watching my Whosonline to see if they come back.
    http://www.youtube.com/c/csgodeimos - New Videos Wednesday & Saturday
    Gaming Content / Deimos

 

 

Similar Threads

  1. Easiest Way To Do This?
    By NineDesign in forum Templates, Stylesheets, Page Layout
    Replies: 6
    Last Post: 18 Nov 2011, 11:34 PM
  2. Easiest way to go from 1.3.7 to 1.3.9?
    By inspiration100 in forum Upgrading from 1.3.x to 1.3.9
    Replies: 5
    Last Post: 23 Mar 2011, 04:27 PM
  3. Easiest way
    By DreamyUnicorn in forum General Questions
    Replies: 3
    Last Post: 11 Nov 2010, 12:14 AM
  4. Easiest way to do this?
    By kdgjevre in forum Setting Up Categories, Products, Attributes
    Replies: 8
    Last Post: 21 Feb 2007, 03:34 AM
  5. easiest way to change template
    By fats1964 in forum General Questions
    Replies: 2
    Last Post: 20 Jan 2007, 04:21 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
disjunctive-egg