Sounds like two classic problems:

a) your browser cookies and/or cache are remembering old things, and need to be cleared
b) your SSL certificate is incorrectly installed, which your hosting company would need to fix.

c) while RARE, the dot-prefix configuration setting might need changing for your specific server's configuration. Should be a last resort, because messing with that can *cause* problems.