Create a formula to convert the field to a number:
if isNumeric({Field_Name}) then toNumber({Field_Name})

Now you will be able to insert a summary on this new formula.