This depends on how your recurring gifts are configured on your site. By default, failing gifts are never canceled i.e. set to Cancelled - Excessive Failures. If you would like for gifts to be cancelled after a certain number of successive failures, contact support and we can configure that for you.