Server Issues.

[allhen]

Hi, I did hosted only 3 zencart sites in hostdime (VPS1 - 1GB RAM) and I was suspended because High CPU Usage 80% (cPanel, memory usage avg. 300-350 MB)

Next I did move to rackspace Debian 6.0 VirtualMin (1 GB ram)

when I did finish moving 3rd site all memory was consuming, so I did resize server to 2 GB ram (avg memory usage was 1.3 - 1.5 GB), this was working fine until some couple hours ago, when I did add a 4th site and submit sitemaps to Google, Bing, Yahoo, TheFind.com and Google Merchants.

Was running FCGI, was turned to CGI, this did solve for a couple of minutes consuming all 2 GB RAM. Next, high memory consuming did back.

Now I did resize server to 4GB RAM and all work fine, (but wil be 160 USD monthly)

CPU load averages    2.63 (1 min) 2.73 (5 mins) 1.87 (15 mins)
Real memory    3.92 GB total, 1.92 GB used 
Kernel and CPU    Linux 2.6.35.4-rscloud on x86_6
CPU type:    Quad-Core AMD Opteron(tm) Processor 2374 HE (2694674 MHz) , 4 cores 

Was disabled clamav, spamassasin, mailman 

Server OS: Linux 2.6.35.4-rscloud       Database: MySQL 5.1.49-3
Server Date: 10/15/2011 01:52:18      Database Date: 10/15/2011 05:52:18
Server Up Time: 05:52:18 up 20 min, 0 users, load average: 2.97, 2.95, 2.08    HTTP Server: Apache/2.2.16 (Debian)
PHP Version: 5.3.3-7+squeeze3 (Zend: 2.3.0)   PHP Memory Limit: 128M    PHP Safe Mode: Off
PHP File Uploads: On    Max Size: 2M    POST Max Size: 8M 

Installed for these 4 sites.

Version 1.3.9.h.
Ultimate Seo Url
Sitemaps XML
QueryCache
Images are medium, and are stored in folder for categories.
https://www.zen-cart.com/tutorials/index.php?article=21 (All this was done in all sites) 

site1
516 categories
37K products
35 visits (Analytics, avg. last 3 days)

site 2
205 categories
65k products
900 visits (Analytics, avg. last 3 days)

site 3
480 categories
31k products
380 visits (Analytics, avg. last 3 days)

site 4
16 categories
13k products
15 visits (Analytics, avg. last 3 days) 

Tasks: 112 total,   2 running, 110 sleeping,   0 stopped,   0 zombie
Cpu(s): 46.0%us, 14.0%sy,  0.0%ni, 37.9%id,  1.9%wa,  0.0%hi,  0.1%si,  0.1%st
Mem:   4108192k total,  3263064k used,   845128k free,   152808k buffers
Swap:  8388604k total,        0k used,  8388604k free,   861876k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
 1121 mysql     20   0  315m  81m 7104 S  119  2.0  27:17.02 mysqld
 1816 dealeurx  20   0  235m  91m 8084 S    0  2.3   4:04.04 php5-cgi
 1787 dealeurx  20   0  226m  82m 8100 S    0  2.0   3:58.40 php5-cgi
 1800 dealeurx  20   0  265m 112m 8060 R   43  2.8   3:23.48 php5-cgi
 1818 dealeurx  20   0  235m  91m 8032 S    0  2.3   2:52.60 php5-cgi
 2963 dealeurs  20   0  215m  70m 7748 S   43  1.8   2:46.89 php5-cgi
 1769 focusdea  20   0  252m  82m 7792 S    0  2.1   2:10.42 php5-cgi
 1792 focusdea  20   0  225m  64m 7748 S    0  1.6   2:04.23 php5-cgi
 1784 focusdea  20   0  254m  85m 7808 S    0  2.1   1:52.06 php5-cgi
 1789 focusdea  20   0  252m  82m 7748 S   18  2.1   1:44.41 php5-cgi
 3370 dealeurx  20   0  264m 118m 7808 S    0  3.0   1:10.35 php5-cgi
 3532 dealeurs  20   0  216m  71m 7724 S   25  1.8   0:41.37 php5-cgi
 2123 timelove  20   0  178m  34m 8008 S   20  0.9   0:31.83 php5-cgi
 3560 dealeurs  20   0  254m  89m 7700 S   19  2.2   0:27.14 php5-cgi
 3602 dealeurx  20   0  271m 118m 7732 S    0  3.0   0:19.67 php5-cgi
 3612 dealeurs  20   0  212m  67m 7704 S   19  1.7   0:17.24 php5-cgi
  935 bind      20   0  220m  28m 2440 S    0  0.7   0:06.83 named
 3599 dealeurx  20   0  271m 111m 7724 S    0  2.8   0:04.86 php5-cgi
 3483 timelove  20   0  180m  32m 7708 S    0  0.8   0:01.12 php5-cgi
 1534 root      20   0  259m  13m 7548 S    0  0.3   0:00.84 apache2
 1436 root      20   0 79752  16m 1748 S    0  0.4   0:00.71 miniserv.pl
  807 root      20   0     0    0    0 S    0  0.0   0:00.49 flush-202:1
 1606 root      20   0 39096  852  528 S    0  0.0   0:00.46 dovecot
   13 root      20   0     0    0    0 S    0  0.0   0:00.41 events/2
   12 root      20   0     0    0    0 S    0  0.0   0:00.29 events/1
 3618 root      20   0 19112 1228  900 R    0  0.0   0:00.26 top
   14 root      20   0     0    0    0 S    0  0.0   0:00.22 events/3
 3313 www-data  20   0  260m 9644 2336 S    0  0.2   0:00.18 apache2
    1 root      20   0  8400  752  624 S    0  0.0   0:00.14 init
 3347 www-data  20   0  261m 9860 2396 S    0  0.2   0:00.14 apache2
  858 root      20   0 54204 1440 1068 S    0  0.0   0:00.13 rsyslogd
 3400 www-data  20   0  261m 9864 2392 S    0  0.2   0:00.12 apache2
 1545 www-data  20   0  186m 4128  664 S    0  0.1   0:00.11 apache2
 3531 www-data  20   0  260m 9584 2276 S    0  0.2   0:00.11 apache2
   10 root      20   0     0    0    0 S    0  0.0   0:00.10 ksoftirqd/3
  318 root      20   0     0    0    0 S    0  0.0   0:00.09 kjournald
   11 root      20   0     0    0    0 S    0  0.0   0:00.07 events/0
 3572 timelove  20   0 61412 2984 2292 S    0  0.1   0:00.06 curl 

             total       used       free     shared    buffers     cached
Mem:          4011       3168        843          0        149        851
-/+ buffers/cache:       2167       1844
Swap:         8191          0       8191 

I need help for configure for not have high memory usage.

Thanks,

[Website Rob]

From the information provided it would seem your problem is due to processes not closing/ending.

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1816 dealeurx 20 0 235m 91m 8084 S 0 2.3 4:04.04 php5-cgi
1787 dealeurx 20 0 226m 82m 8100 S 0 2.0 3:58.40 php5-cgi
1800 dealeurx 20 0 265m 112m 8060 R 43 2.8 3:23.48 php5-cgi
1818 dealeurx 20 0 235m 91m 8032 S 0 2.3 2:52.60 php5-cgi
2963 dealeurs 20 0 215m 70m 7748 S 43 1.8 2:46.89 php5-cgi
1769 focusdea 20 0 252m 82m 7792 S 0 2.1 2:10.42 php5-cgi
1792 focusdea 20 0 225m 64m 7748 S 0 1.6 2:04.23 php5-cgi
1784 focusdea 20 0 254m 85m 7808 S 0 2.1 1:52.06 php5-cgi
1789 focusdea 20 0 252m 82m 7748 S 18 2.1 1:44.41 php5-cgi
3370 dealeurx 20 0 264m 118m 7808 S 0 3.0 1:10.35 php5-cgi
3532 dealeurs 20 0 216m 71m 7724 S 25 1.8 0:41.37 php5-cgi
2123 timelove 20 0 178m 34m 8008 S 20 0.9 0:31.83 php5-cgi
3560 dealeurs 20 0 254m 89m 7700 S 19 2.2 0:27.14 php5-cgi
3602 dealeurx 20 0 271m 118m 7732 S 0 3.0 0:19.67 php5-cgi
3612 dealeurs 20 0 212m 67m 7704 S 19 1.7 0:17.24 php5-cgi
3599 dealeurx 20 0 271m 111m 7724 S 0 2.8 0:04.86 php5-cgi
3483 timelove 20 0 180m 32m 7708 S 0 0.8 0:01.12 php5-cgi

You need to kill the above processes or reboot your Server. Then monitor for processes not closing and try to figure out why.

[allhen]

Looks like was many visits from B-A-I-D-U Spider.

About 2500 visits in 6 hours in each site only from this bot.

Now, I did blocked IP 180.76.5.* and I'm saving about 700 MB RAM !!

Cloud server downgraded to 2 GB RAM - avg. ram now is 1.4-1.6 GB RAM