Skip to content

Commit

Permalink
Fix black
Browse files Browse the repository at this point in the history
  • Loading branch information
Alexey Gorbatovski authored and Alexey Gorbatovski committed Sep 19, 2024
1 parent abc448e commit 257f32f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion turbo_alignment/trainers/dpo.py
Original file line number Diff line number Diff line change
Expand Up @@ -292,7 +292,7 @@ def compute_loss(

ratio = -F.logsigmoid(log_odds)
losses = self.beta * ratio

nll_loss = -policy_chosen_logps

losses += nll_loss
Expand Down

0 comments on commit 257f32f

Please sign in to comment.