Utilization of negative samples

[HillZhang1999]

Dear authors:
First of all, I appreciate your engaging and informative work! I have a question regarding your research: I noticed that you only utilize positive samples for SFT when enhancing the policy models. Have you considered incorporating negative samples through methods such as DPO?

[zhangdan0602]

Thank you for your question! Indeed, we reproduce the baseline, Self-Rewarding, which runs the DPO using negative samples of LLMs judgments.