So a box with links to the feeds for the current page, new products, specials, featured products etc.

-> If not already included, this add-on can be easily written. First you have to learn how to create a sidebox (very easy), second you have to dig into rss mod code and see how it creates a rss link(I think I did have a look at this, it's not so hard).