To delete a links category:
  1. Go to Core > Content > Additional Content Types
  2. Select the Links tab
  3. From this screen, click the trashcan icon for the specific link category you wish to delete
Note: Deleting the category will delete any links that are listed as this being the Primary category. The links will also be removed from other categories they are shared with.