Run a constituent import, leave the address fields blank, and add the following three fields:

PhoneType (Phone Type)
PhoneNum (Phone Number)
PhoneAddrImpID (Phone Address Import ID)