Do I download them from the server, edit them in notepad and then put the changed file back up on the server?
Yes but as permissions are most likely unwriteable, you will have to reset them in your host provided file manager first
and reset after you upload edited version