Towards Analyzing and Understanding the Limitations of DPO: A Theoretical Perspective
arXiv 2024
First author
A theoretical analysis of the limitations of direct preference optimization.
Personal note: One of my favorite theoretical projects.
arXiv 2024
First author
A theoretical analysis of the limitations of direct preference optimization.
Personal note: One of my favorite theoretical projects.