Once an email delivery has been scheduled, you can no longer remove a group from that send. You can cancel that send though, and then recreate the email with the correct group as long as your email was not scheduled to go out immediately.