Skip to content

Commit

Permalink
fix-vietnamese-tokens
Browse files Browse the repository at this point in the history
  • Loading branch information
koaning committed Jul 12, 2021
1 parent 1b0b1d2 commit dd28720
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion tests/test_tokenizers/test_spacy_blank.py
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
{
"text": "Trường đại học bách khoa hà nội",
"lang": "vi",
"result": ["Trường", "đại_học", "bách_khoa", "hà_nội"],
"result": ["Trường", "đại học", "bách khoa", "hà nội"],
},
]

Expand Down

0 comments on commit dd28720

Please sign in to comment.