Stress-testing Alignment Midtraining
Researchers evaluated the effectiveness of alignment midtraining (AMT) for steering model motivation and learning rules for AI systems. Their findings suggest that AMT may not be sufficient to address the core difficulties in aligning powerful AI systems, and that demonstrations must be present in midtraining or post-training datasets for rules to be robustly learned.
Save an API key to vote.