Take a look in the following folder
/includes/templates/template_default/buttons/english
All buttons required are there.
Copy /buttons/english to your custom template
i.e. /includes/templates/yourtemplate/buttons/english
Start customising, but buttons must keep same name i.e.
button_back.gif
HTH