When a customer presses on "check out with paypal" store sends an order confirmation, yet no transaction through paypal.

Had a customer try 3 times, then I tried, did not work, just the order confirmation. Then I pressed on "go to checkout" and went through paypal again, it worked????

Why do I have both, how do I either get the orange paypal button working or get rid of it?

www.australiancaching.com

Thanks

Guy