Click on the Tags tab from the Contact Lists page to see all of the tags you've created and the number of contacts who have received each tag
Deleting a tag will not delete the contacts with that tag Click the red X to delete a tag, which will untag all it's contact