Add special_tokens_in_strings
Arg to byte_pair_tokenizer.
#4911
Job | Run time |
---|---|
17m 33s | |
2m 15s | |
14m 7s | |
13m 33s | |
9m 17s | |
56m 45s |
special_tokens_in_strings
Arg to byte_pair_tokenizer.
#4911
Job | Run time |
---|---|
17m 33s | |
2m 15s | |
14m 7s | |
13m 33s | |
9m 17s | |
56m 45s |