Never mind. I finally found it. I had to delete all of the attributes related to the product on the Catalog > Attributes Controller page.
I was previously trying to delete individual attributes on the Catalog > Products With Attributes Stock page. I could not delete the attributes from there.
Bookmarks