In Connect 5, you need to mark the "Refresh Group by Import" checkbox in order for the automatic import to remove old contacts.