These files can be customized - are you changing the right one?

If you create

includes/languages/english/modules/shipping/<your template>/perweightunit.php

but then modify

includes/languages/english/modules/shipping/perweightunit.php

then you won't see the change.