v0.4.12

What's Changed

• Preserve eos in encoding when max_seq_length = -1 by @sanderland in #1694
• Add batched_next_token() and batched_sample() by @apaz-cli in #1693
• bump thunder dependency to main by @t-vi in #1701
• add support for batched input_pos to model by @t-vi in #1700
• Add batched_generate_fn() by @apaz-cli in #1702
• minor Readme update/typos by @Borda in #1710
• Fix device Error in Decode Stream by @Motsepe-Jr in #1707
• Temporarily remove MPS device support by @rasbt in #1718
• Add uvloop as a dependency by @rasbt in #1719
• Change default precision on macOS by @rasbt in #1720
• Bump for v0.4.12 by @rasbt in #1721

New Contributors

• @Motsepe-Jr made their first contribution in #1707

Full Changelog: v0.4.11...v0.4.12