Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Give
biased_logits
the same dtype
as logits
Exllama generates logits in torch Half-dtype, but Outlines requires the Float-dtype. This small change converts the logits to the required dtype (whatever that might be), solving issue #583. Tested with Exllama on the example code on the github front page, and #583 is resolved.
- Loading branch information