← Publications

Towards Analyzing and Understanding the Limitations of DPO: A Theoretical Perspective

arXiv 2024

First author

A theoretical analysis of the limitations of direct preference optimization.

Personal note: One of my favorite theoretical projects.