When processing the Profile Updates, change the radio button from “Add the downloaded information...” to “Update the preferred address...”.  Essentially, when the Email Address field was brought over the first time, it was added it to the record, but since, the Connector requires you to select the update option in order for it to apply to that field type.