Avoid the Surprise: Assessing and Addressing Preference Risk