Aligning Language Models with Demonstrated Feedback Omar Shaikh, Michelle Lam*, Joey Hejna*, Yijia Shao, Hyundong Justin Cho, Michael Bernstein, Diyi Yang Jan 22, 2025 Omar Shaikh Yijia Shao Diyi Yang Assistant Professor