Within the teacher grade book, hover over the box across from the student for that assignment and click on the red triangle.
Here you can add a comment in the large text box.

User-added image