SitemapXML v.2

frank18:

.......

Compared files and can't find a clue

I am at wits end - can you give me some hints please?

Thanks / Frank

Had another go at this problem some 5 hours later and the problem mysteriously has fixed itself :huh: - strange indeed but it works now.

Cheers / Frank

Hi,

twi:

you mean my site url? https://www.birthdaysextreme.com
I see no problems with sitemap http://birthdaysextreme.com/sitemap/sitemapproducts.xml
I see tag </urlset> at the bottom.

Hi Frank,

frank18:

Had another go at this problem some 5 hours later and the problem mysteriously has fixed itself :huh: - strange indeed but it works now.
My congratulations! :)

a_berezin:

Hi Frank,

My congratulations! :)

Thanks Andrew - still have no idea what happened there. Never mind, it works a treat :cool:

Frank

a_berezin:

Hi,

I see no problems with sitemap http://birthdaysextreme.com/sitemap/sitemapproducts.xml
I see tag </urlset> at the bottom.

That is because I have added it manually according to instructions of one of the earlier post here. But the file generated by "sitemapxml" does not have that </urlset> at the bottom.

twi:

That is because I have added it manually according to instructions of one of the earlier post here. But the file generated by "sitemapxml" does not have that </urlset> at the bottom.
I see total 4253 products on your site - birthdaysextreme.com/products_all.html and only 4216 in http://birthdaysextreme.com/sitemap/sitemapproducts.xml

Conclusion: map of products simply was not formed until the end. There can be several reasons: memory limit, execution time limit.

a_berezin:

I see total 4253 products on your site - birthdaysextreme.com/products_all.html and only 4216 in http://birthdaysextreme.com/sitemap/sitemapproducts.xml

Conclusion: map of products simply was not formed until the end. There can be several reasons: memory limit, execution time limit.

SO how do I fix this problems?

twi:

SO how do I fix this problems?

Go to Admin > Tools > Server/Version info and look for PHP Memory Limit. Post that value here.

twi:

SO how do I fix this problems?

To know how to fix need to know what the problem is. Check server error logs.

If the problem is in the limit on memory, try this.

• Increase the memory limit.
• Go to Admin -> Configuration -> Sitemap XML -> Check Dublicates set to false or mysql.

If the problem is in the execution time limit try to use cli interface for cron job.

a_berezin:

To know how to fix need to know what the problem is. Check server error logs.

... if you have access to these logs

a_berezin:

If the problem is in the limit on memory, try this.

• Increase the memory limit.
• Go to Admin -> Configuration -> Sitemap XML -> Check Dublicates set to false or mysql.

If the problem is in the execution time limit try to use cli interface for cron job.

Andrew's suggestion is the logical way to proceed.

However, I feel that your problem is not with Andrew's sitemapxml mod but appears to be a memory or max execution time problem. After all you have a fair number of files to deal with when executing sitemapxml - a number your server may not be configured to deal with.

You can shortcircuit the lot by creating a file named php.ini and upload this file to the root of your (virtual?) server.

That php.ini file should look like this:

max_execution_time = 30 
max_input_time = 60 
memory_limit = 128M

set permissions to read only for everyone

Effectively that file overrides the stated values of the native php.ini file (the one that comes with your php server install)

You can see the changes by checking Admin > Tools > Server/Version Info before and after uploading this file.

Alternatively (and that is the safer method) you can add this to your root .htaccess file:

php_value max_execution_time = 30 
php_value max_input_time = 60 
php_value memory_limit = 128M

Let us know how this pans out.

Cheers / Frank

frank18:

Go to Admin > Tools > Server/Version info and look for PHP Memory Limit. Post that value here.

Its found at the top and states:

PHP Memory Limit: 32M

a_berezin:

To know how to fix need to know what the problem is. Check server error logs.

If the problem is in the limit on memory, try this.

• Increase the memory limit.
• Go to Admin -> Configuration -> Sitemap XML -> Check Dublicates set to false or mysql.

If the problem is in the execution time limit try to use cli interface for cron job.

Thank you. setting it to: Go to Admin -> Configuration -> Sitemap XML -> Check Dublicates set to "false"

fixed the problem.

frank18:

... if you have access to these logs

Andrew's suggestion is the logical way to proceed.

However, I feel that your problem is not with Andrew's sitemapxml mod but appears to be a memory or max execution time problem. After all you have a fair number of files to deal with when executing sitemapxml - a number your server may not be configured to deal with.

You can shortcircuit the lot by creating a file named php.ini and upload this file to the root of your (virtual?) server.

That php.ini file should look like this:

max_execution_time = 30
max_input_time = 60
memory_limit = 128M

> 
> set permissions to read only for everyone
> 
> Effectively that file overrides the stated values of the native php.ini file (the one that comes with your php server install)
> 
> You can see the changes by checking Admin > Tools > Server/Version Info before and after uploading this file.
> 
> Alternatively (and that is the safer method) you can add this to your root **.htaccess** file:
> 
> ```
php_value max_execution_time = 30 
php_value max_input_time = 60 
php_value memory_limit = 128M

Let us know how this pans out.

Cheers / Frank

Thank you as well. setting it to: Go to Admin -> Configuration -> Sitemap XML -> Check Dublicates set to "false"

fixed the problem. Hopefully the server was configured for it.

I have not set up any cron job yet for this mod since I have no clue how to do so. any suggestion is greatly appreaciated.

Hello Andrew - I use your very good plugin on several sites - I have one site using your latest version (v 3.2.6 17.06.2012 16:13) and it is not submitting images for indexing. Is there a reason for this or a fix for this? - I have already re-installed the plugin but made no difference.

thank you,
Mike

Hi there
I've been trawling through the thread trying to find the answer, but have been unsuccessful. The plugin is set up and working fine I think, but I'm trying to set up the cron. Having tried various things along the lines of the tips in the plugin and looking at the suggestions made by my hosting company for setting up Scheduled Tasks as they term them, I raised a support ticket and quoted the suggestions made by the plugin as to the different commands that could be used. The response I got is as follows:

*"The cron jobs you've listed are loop-back connections. Scripts cannot open a connection to the internet only for it to loop-back to the same server - scripts should be executed locally instead.

However, because of the parameters that need to be passed, there might not be an easy way to do this. The easiest method would be to set these cron jobs up on a different hosting package - a different webserver - as that wouldn't be subjected to the same loop-back limitation."*

I'm afraid this goes straight over the top of my head. Can anyone help me to understand what they're saying to me? Wouldn't the suggested command lines from the plugin be at least along the right lines?

Thanks for any light anyone can shed.

Regards
RoPey

Hi RoPey,

RoPey:

The response I got is as follows:

*"The cron jobs you've listed are loop-back connections. Scripts cannot open a connection to the internet only for it to loop-back to the same server - scripts should be executed locally instead.

However, because of the parameters that need to be passed, there might not be an easy way to do this. The easiest method would be to set these cron jobs up on a different hosting package - a different webserver - as that wouldn't be subjected to the same loop-back limitation."*
The first time I hear about such restrictions. I do not even understand what it means. :(

a_berezin:

Hi RoPey,

The first time I hear about such restrictions. I do not even understand what it means. :(
Oh I'm so glad I'm not alone Andrew.

I queried it with them and they've told me that I need to set it up on a different server (we're hosting resellers) that relates to any of the other hosting accounts that we run, or by creating a random domain reference to the account ie domain-reference.co.uk instead of domain.co.uk!

Is there a way of doing this without the scripts - cgi, perl etc?I've seen a few posts where users said they were using a simple url - something ending in domain.co.uk/public_html/cgi-bin/sitemapxml.php, but that isn't mentioned in the tips.

Thanks

Well I think I've answered my own question, I fiddled a bit more and found that this seems to work just fine. Just in case it's of any use to anyone else with the same problem.

/usr/bin/php /home/sites/domain.com/public_html/cgi-bin/sitemapxml.php

Regards
RoPey

Hi, just installed this plugin on a fresh 1.5.1 cart. Everything appears to be working.

However, after pinging google I see in whoisonline that google tried to access sitemap/sitemap.xml, which went to a page not found. Is this normal? I recall this issue in the past on a former 1.5.1 cart.

I also put the url to the sitemap in my robots.txt file, I guess an added thing to do. I hope it corrects the google/page not found issue above.

Thanks for any input.

Hi,

SPH:

after pinging google I see in whoisonline that google tried to access sitemap/sitemap.xml, which went to a page not found. Is this normal?
Strangely, this is old bug, which I've already fix. I upload the latest version, wait for moderators to approve.