You could probably do it in the database using phpMyAdmin, but deleting the categories will delete the products, too, and there aren't that many.