The button to Finish Upgrade will only appear after clicking the Create Remote Site Setting button. After clicking this button, stay on this page and you will be able to complete the upgrade.