If you are going to customize a website, you need to know something about CSS (www.w3schools.com is a good resource). Also look at the tutorials for template customizing advice.
You "activate" the box by adding a rule in /includes/templates/your_template/css/stylesheet.css. Search for #productAttributes. If it is not there, just add a new rule like the one I posted, probably at the bottom of the file to keep things organized. If it is there, add a border declaration like the one in red above.