In order to remove all members from a smart group. with any topic selected, add the following criteria:
Last Name - Is Null

Since every user in the database will have a last name, no one will match this criteria and when you refresh the membership all members added via the Smart group criteria will be removed.