Good point. Remember that encrypting to SSL will add another layer of slowdown, so if the internet connections between your webserver and the database server are slow in any way ... then your website will be too.