1. Navigate to Web > Email alerts management
  2. Click drop down next to email address you want to remove, and select Delete