You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The Python script appears to replace the double-quote with a space, but the original sed surrounds the double quote with spaces. Is this an error?
Unrelated, (but since I have your attention ;), do you know whether the same preprocessing rules were used for the common crawl models? I'm asking specifically about the cc.en.300.bin fasttext model.
The text was updated successfully, but these errors were encountered:
I think I found a bug in the
preproc.py
script for string normalization here: https://gist.github.com/bittlingmayer/7139a6a75ba0dbbc3a06325394ae3a13#file-ft_wiki_preproc-py-L17The Python script appears to replace the double-quote with a space, but the original sed surrounds the double quote with spaces. Is this an error?
Unrelated, (but since I have your attention ;), do you know whether the same preprocessing rules were used for the common crawl models? I'm asking specifically about the
cc.en.300.bin
fasttext model.The text was updated successfully, but these errors were encountered: