---
title: "Aligning Large Language Models with Counterfactual DPO"
emoji: 🧠
colorFrom: yellow
colorTo: indigo
sdk: static
pinned: false
---

# Nerfies

This is the repository that contains source code for the Counterfactual DPO paper (https://arxiv.org/abs/2401.09566).



# Website License
<a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/"><img alt="Creative Commons License" style="border-width:0" src="https://i.creativecommons.org/l/by-sa/4.0/88x31.png" /></a><br />This work is licensed under a <a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/">Creative Commons Attribution-ShareAlike 4.0 International License</a>.