Steps to Duplicate
1. Select an Organization and add a new Primary Address
2. Go to the individual record of the Primary Contact, notice how the old business address that they are the primary contact for still displays.
The temporary solution is to break the relationship between the primary contact and organization and then re-establish it after the new primary address for the Organization has been updated.