This occurs when an older template is used in Page Designer, that needs to be changed to select the new version of the template, which uses the icons.    
For example, if the template is "Header, Footer, Accented", use "Header and Footer with an Accented Border" instead.