Site producing heaps of 403 errors, using Simple SEO addon

**trinoz** · 14 Feb 2012, 10:41 PM

Hi,

I think there is something seriously wrong with the configuration of my site www.thechakrashop.com

I'm using version 1.3.9h. I have Simple SEO, Zen Lightbox, Sitemap XML and Easy Popuate installed.

When I run Xenu link checker on the site I get a riduculous amount of URLS (20,000). Some of them are obviously wrong such as (note this is one URL and in the post looks abbreviated):

http://www.thechakrashop.com/gv_faq/...eme486/PIE.php
error code: 403 (forbidden request), linked from page(s): http://www.thechakrashop.com/gv_faq/...eme486/PIE.php

I also see that Google isn't indexing my pages. I wonder why :)

I realised yesterday that the template I have (yes TM), didn't have the rel=canonical reference in the head section so I replaced that. This problem was happening before this however.

I have a .htaccess file with the following:

DirectoryIndex = index.php
#### BOF SSU
Options +FollowSymLinks -MultiViews
RewriteEngine On
# Make sure to change "zencart" to the subfolder you install ZC. If you use root folder, change to: RewriteBase /
RewriteBase /

# Deny access from .htaccess
RewriteRule ^\.htaccess$ - [F]

RewriteCond %{SCRIPT_FILENAME} !-f
RewriteCond %{SCRIPT_FILENAME} !-d
RewriteRule ^(.+) index.php/$1 [E=VAR1:$1,QSA,L,PT]
# alternative rewrite rule, seem to work on GoDaddy hosts http://codeigniter.com/wiki/Godaddy_Installaton_Tips/
# to use it, please make sure you comment out the rewrite rule above, then uncomment the line below
# RewriteRule ^(.*)$ /index.php?$1 [L]
#### EOF SSU
# BEGIN Compress text files
<ifModule mod_deflate.c>
<filesMatch "\.(css|js|x?html?|php)$">
SetOutputFilter DEFLATE
</filesMatch>
</ifModule>
# END Compress text files

# BEGIN Expire headers
<ifModule mod_expires.c>
ExpiresActive On
ExpiresDefault "access plus 1 seconds"
ExpiresByType image/x-icon "access plus 2592000 seconds"
ExpiresByType image/jpeg "access plus 2592000 seconds"
ExpiresByType image/png "access plus 2592000 seconds"
ExpiresByType image/gif "access plus 2592000 seconds"
ExpiresByType application/x-shockwave-flash "access plus 2592000 seconds"
ExpiresByType text/css "access plus 604800 seconds"
ExpiresByType text/javascript "access plus 216000 seconds"
ExpiresByType application/javascript "access plus 216000 seconds"
ExpiresByType application/x-javascript "access plus 216000 seconds"
ExpiresByType text/html "access plus 600 seconds"
ExpiresByType application/xhtml+xml "access plus 600 seconds"
</ifModule>
# END Expire headers

# BEGIN Cache-Control Headers
<ifModule mod_headers.c>
<filesMatch "\.(ico|jpe?g|png|gif|swf)$">
Header set Cache-Control "max-age=2592000, public"
</filesMatch>
<filesMatch "\.(css)$">
Header set Cache-Control "max-age=604800, public"
</filesMatch>
<filesMatch "\.(js)$">
Header set Cache-Control "max-age=216000, private"
</filesMatch>
<filesMatch "\.(x?html?|php)$">
Header set Cache-Control "max-age=600, private, must-revalidate"
</filesMatch>
</ifModule>
# END Cache-Control Headers

# BEGIN Turn ETags Off
<ifModule mod_headers.c>
Header unset ETag
</ifModule>
FileETag None
# END Turn ETags Off

# BEGIN Remove Last-Modified Header
<ifModule mod_headers.c>
Header unset Last-Modified
</ifModule>
# END Remove Last-Modified Header

RewriteEngine On
RewriteCond %{HTTPS} =on
RewriteCond %{HTTP_HOST} ^www\.
RewriteRule ^(.*)$ https://thechakrashop.com/$1 [R,QSA,L]

RewriteCond %{REQUEST_URI} ^/(stats/|missing\.html|failed_auth\.html|error/).* [NC]
RewriteRule .* - [L]

RewriteCond %{ENV:REDIRECT_STATUS} 200
RewriteRule .* - [L]

I had to remove the following as I found out that the create accounts page wasn't working so I tried removing elements unitl it worked again:

RewriteEngine on
RewriteCond %{HTTP_HOST} !^www\.thechakrashop\.com
RewriteRule (.*) http://www.thechakrashop.com/$1 [R=301,L]

RedirectMatch 301 ^/index\.html$ /index.php
RedirectMatch 301 ^/index\.shtml$ /index.php
RedirectMatch 301 ^/index\.asp$ /index.php
RedirectMatch 301 ^/default\.asp$ /index.php
RedirectMatch 301 ^/index\.aspx$ /index.php
RedirectMatch 301 ^/index\.cfm$ /index.php
RedirectMatch 301 ^/index\.pl$ /index.php
RedirectPermanent /default.htm /index.php

My configure.php has the following settings:

define('HTTP_SERVER', 'http://www.thechakrashop.com');
define('HTTPS_SERVER', 'https://thechakrashop.qnetau.com');

Not sure which aspect is causing these problems but clearly I have some sort of looping going on.

My objective with the .htaccess file was to direct everything to www. but because the https address is non.www I had a problem with the www. being added to the https url.I thought by specifying that in the configure.php file (in both locations) and doing the rewrite it would work. It looked like it did as all the redirects appeared correct and I no longer had canonical issues but the secure pages were not processing.

I searched for a .htacess code to exclude the https element but couldn't find a solution.

My robot txt has the following:

User-agent: *
Allow: /

Sitemap: http://thechakrashop.com/sitemapindex.xml

I notice also in my sitemap that I have urls such as:

http://www.thechakrashop.com/-c-0/sa...ite-wand-p-438

The actual URLs don't have the -c-0 in them, they have the category name.

So, a few issues that may be related:

ridiculous number of links and crazy long links.
How to redirect to www. when ssl is non.www
Simple SEO - the -c-0 in the link name
Google not indexing the site

Apologies for all this long explanation.

Appreciate any help..

My brain is looping now.

Trinoz

**RodG** · 15 Feb 2012, 04:57 AM