In the Constituent Giving History Report, select the Format tab. In the Detail section, mark the Include non-givers on report checkbox.

NOTE:  If you have not included a query of specific constituents, or filtered on the constituent records via the Filters tab, marking to include the non-givers without filters will pull from every constituent record in your database.