1. Go to Core > People Finder > Settings tab > Notification Settings.
  2. Uncheck all their subscriptions to notifications and pushpage distribution groups.
  3. Remove their Email and Text Number from the Notification Settings. Deleting their Email and Text Number from there will also remove it from their Contact Card.