RIght now it's not really a button (as in an image) - it's just rendered by the browser. You could change this but you'd have to change some code in the template.

./includes/templates/template_default/sideboxes/tpl_mailchimp_sidebox.php