Understand AI alignment challenges, RLHF, constitutional AI, and the foundations of AI safety research.