No need to edit any files.

In admin, go to Configuration -> My Store -> Show Category Counts. Set to false.