In the import, make sure the field Site Restriction is mapped, even if the batch template has the correct site as a default value in the Site Restriction column. If you the import file contains both new and existing constituents, one thing also worth considering is using the New/edit constituent collection field and ensuring that the Constituent Site field is mapped within.