You would need an expanded categories mod. There are several in Free Addons, but most of them have coding flaws or show the products as well as the categories in the sidebox. A totally reliable one is Uncollapsed Categories Tree by fragfutter, available from his website or packaged as an option in Categories Dressing.