Results 1 to 10 of 10
  1. #1
    Join Date
    Dec 2006
    Location
    Vermont
    Posts
    128
    Plugin Contributions
    0

    Default Removing crawlers, spyders, bots from Who's Online?

    Hi,

    Is it possible to filter OUT all the spyders, googlebots, crawlers, etc., from the "Who's Online" page?

    I don't really want or need to see these all the time, and I'd like to filter them out, so I only see the most likely customers online.

    is there any relatively easy code change to NOT show all the PINK items?

    Thanks.

  2. #2
    Join Date
    Feb 2005
    Location
    Lansing, Michigan USA
    Posts
    20,021
    Plugin Contributions
    3

    Default Re: Removing crawlers, spyders, bots from Who's Online?

    Don't know what 'the PINK items' are, but have you considered just turning off the sidebox? Visitors don't care who's online, and you can see who's visiting from Admin. It's just screen clutter to me.

  3. #3
    Join Date
    Jul 2005
    Location
    Upstate NY
    Posts
    22,010
    Plugin Contributions
    25

    Default Re: Removing crawlers, spyders, bots from Who's Online?

    I believe the OP is talking about the admin page.

  4. #4
    Join Date
    Aug 2004
    Location
    New York City
    Posts
    7,174
    Plugin Contributions
    0

    Default Re: Removing crawlers, spyders, bots from Who's Online?

    Quote Originally Posted by gjh42 View Post
    I believe the OP is talking about the admin page.
    I think so, too, and I don't know of any way to turn that off.
    Mary Ellen
    I came; I saw; I Zenned
    Taking over the world... one website at a time
    Make sure brain is engaged before putting mouth in gear... or fingers to keyboard.

    Holzheimer
    Fan Odyssey

  5. #5
    Join Date
    Dec 2007
    Posts
    126
    Plugin Contributions
    0

    Default Re: Removing crawlers, spyders, bots from Who's Online?

    I'd like to know how it decides who's a bot and who isn't.

    I'd like to know if I can manually add known bot ips to a bot list?

    I get a handful of bots that are given session ids because they are treated as a human user, and that bothers me.

    For example there are some MSN bots that don't get counted as bots even though the log shows them to be. Host: msnbot-65-55-109-97.search.msn.com.

  6. #6
    Join Date
    Jul 2006
    Location
    SF Bay Area
    Posts
    867
    Plugin Contributions
    1

    Default Re: Removing crawlers, spyders, bots from Who's Online?

    About line 251 in admin/whos_online.php find:

    <?php
    $ip_array = array();
    $d=0;
    while (!$whos_online->EOF) {
    $time_online = (time() - $whos_online->fields['time_entry']);

    And add two line like this:

    <?php
    $ip_array = array();
    $d=0;
    while (!$whos_online->EOF) {
    $bot=zen_check_bot($whos_online->fields['session_id']);
    if($bot){$whos_online->MoveNext();continue;}
    $time_online = (time() - $whos_online->fields['time_entry']);

    That will make the pinkies not show.

  7. #7
    Join Date
    Dec 2006
    Location
    Vermont
    Posts
    128
    Plugin Contributions
    0

    Default Re: Removing crawlers, spyders, bots from Who's Online?

    Thanks to all who responded.

    The response from Kiddo did the trick. I appreciate your input greatly.

  8. #8
    Join Date
    Sep 2003
    Location
    Ohio
    Posts
    69,402
    Plugin Contributions
    6

    Default Re: Removing crawlers, spyders, bots from Who's Online?

    Not showing the bots isn't making them not get sessions ...

    Adding bots to the /includes/spiders.txt is ... via their User Agent ...

    The problem is the bots that cheat and do not pass this information ... for those that you see, if you can, complain to the folks that send them and tell them to get with the program ... maybe, they will listen ...

    NOTE: To see the "pink" bots ... you do need to store your sessions to the database ...
    Linda McGrath
    If you have to think ... you haven't been zenned ...

    Did YOU buy the Zen Cart Team a cup of coffee and a donut today? Just click here to support the Zen Cart Team!!

    Are you using the latest? Perhaps you've a problem that's fixed in the latest version: [Upgrade today!]
    Officially PayPal-Certified! Just click here

    Try our Zen Cart Recommended Services - Hosting, Payment and more ...
    Signup for our Announcements Forums to stay up to date on important changes and updates!

  9. #9
    Join Date
    Dec 2006
    Location
    Vermont
    Posts
    128
    Plugin Contributions
    0

    Default Re: Removing crawlers, spyders, bots from Who's Online?

    All I wanted was to not "see" them in my "who's online" listing...
    But is it causing me some hidden problem(s) by doing this?

    I have not noticed anything bad since I implemented this code change to filter them out...

    When you add them to your spiders.txt file, do you use the entire domain name? If not, what part do you add?

    Thanks.

  10. #10
    Join Date
    Sep 2003
    Location
    Ohio
    Posts
    69,402
    Plugin Contributions
    6

    Default Re: Removing crawlers, spyders, bots from Who's Online?

    View the spiders.txt file and try looking for:
    msnbot
    yahoo
    google

    to give you an idea how the User Agent is utilized for this ...

    The whos_online will show the User Agent that identifies these ... when that code blocking spiders is not active ...

    You are not hurting anything by not "seeing" these ...

    Note: if you click to sort the whos_online by the Name, it will group Guests, Customers and Spiders for you ...
    Linda McGrath
    If you have to think ... you haven't been zenned ...

    Did YOU buy the Zen Cart Team a cup of coffee and a donut today? Just click here to support the Zen Cart Team!!

    Are you using the latest? Perhaps you've a problem that's fixed in the latest version: [Upgrade today!]
    Officially PayPal-Certified! Just click here

    Try our Zen Cart Recommended Services - Hosting, Payment and more ...
    Signup for our Announcements Forums to stay up to date on important changes and updates!

 

 

Similar Threads

  1. Replies: 0
    Last Post: 24 Oct 2013, 01:46 PM
  2. Spiders - Filtering from Who's Online?
    By wmarcy in forum General Questions
    Replies: 14
    Last Post: 7 Mar 2011, 05:23 PM
  3. Completely Removing Who's Online
    By keeno79 in forum Basic Configuration
    Replies: 1
    Last Post: 12 May 2009, 10:48 PM
  4. Weird results from Who's online
    By 5869 in forum General Questions
    Replies: 3
    Last Post: 5 Feb 2008, 09:24 AM
  5. Removing pages from Who's Online
    By Flipside in forum All Other Contributions/Addons
    Replies: 0
    Last Post: 26 Jan 2007, 02:25 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
disjunctive-egg