Yes, I do understand exactly what you're saying.

And, there's nothing I can do about it. PayPal is taking the ship-to information (which is the only address they receive from your store) and filling in those fields with that information automatically. If you want them to do something different with that, you'll need to write to them and ask them to make a programming change to their payment systems used around the world. http://www.paypal.com/mts

A customer who has used PayPal before will automatically see a login screen to get to their PayPal account, and will never see the address info you are being irritated by.
A customer who has *not* used PayPal before is going to see that address screen, and PayPal is apparently operating on the premise that most people ship to themselves and therefore is assuming that it's logical to put the shipping information into those address fields to speed the process of getting to payment. Naturally, the person making the payment must put their own address in their or else their credit card is going to be declined due to invalid address match, so most will simply delete the pre-filled address and type their own in, taking and extra few seconds in the payment process.

I understand how a few customers might find it confusing. But there's nothing I can do about it for you. If you want it, you'll have to talk to Paypal and get them to add that functionality to the services they offer.