You may be able to add an observer (to listen for stock decrements)... Then do a SQL query to see if all products in the category are disabled (or have a quantity of 0)... Then disable the category if needed (and check the parent categories recursively). Not the most efficient, but might provide a starting place.