You can do this by creating a Custom Constituent Import. You will need at least 3 column headers.
  1. Constituent ID
  2. Group ID
  3. Group Removal Flag
The Group Removal Flag column needs a value of TRUE or FALSE. TRUE will remove the constituent from the group and FALSE will not.