The site option mentioned in the title will only give users access to view centers, but no permissions to do anything inside.  The permissions needed for a Center site admin would need to be set with all permission levels but limited to a particular Security Category.