Skip to content

v0.4.1: Misc Bug Fixes
Compare
Choose a tag to compare
@minimaxir minimaxir released this 09 Mar 04:37
· 55 commits to master since this release
v0.4.1
3539154
  • Fix CSV loading issue (#95)
  • Fix regex for stripping whitespace starting a generated text. (#92)
  • Fix an issue where the logger said using a custom tokenizer was actually using the default tokenizer.
  • Added a special_tokens param to allow the user to specify a List of token IDs to strip from the generated output (default: the bos_token_id and eos_token_id).
Assets 3
Loading