When setting up the letter in Configuration, select the appropriate contact information in the export and add this to the merge document. Select this letter when mailing to contacts from the record.