A custom constituent import/group assignment upload will only add members to the group included in your file and not overwrite any existing memberships.