Okie, lets see if I understand the problem correctly

You want all your category links to be displayed as text only, not with the images like they are right now? Is this correct?

Zencart by default displays all category links (on sidebox) as text links only, so whoever coded this site must have made the changes. Did you code the template yourself or did you get it elsewhere?