How to make seo friendly

if my site is http://xxxxxxx.com/index.php?

i want to change to http://xxxxxxxx.com/

and i want change in every page ( in product page too ) to seo friendly

If my site is www.xxxxx.com/index.php?/xxxxx/xxxxxx?/ipod.php

i want to change to www.xxxxx.com/ipod.php

( not only ipod but every product in my site )

Thank you