Historical Address Management only works for those addresses that are added to the contact through a direct interaction, such as an admin updating the address, or the constituent updated their address in Luminate. When you merge two records that have different addresses, the merge logic doesn't look at what is in the related list object and will allow duplicates in the related list after merging.