You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Been working on parsing a large database of text in different languages and ran into a set of Unicode characters that causes YamlParser.ReadScalarAsString to lock-up permanently without an throwing an exception or any other form of error.
Example:
The initial culprit was "2", the full-width two character [U+FF12]. Some surface level testing showed that the other full-width numbers cause the same parsing lockup issue. All other text I tried supplying ran without issue.
Priority
This isn't a super high priority fix for me, I can just clean up the data before passing into the YamlParser, but thought it was worth documenting in case this is a sign of a larger unicode handling issue? Thanks, take care!
The text was updated successfully, but these errors were encountered:
Problem:
Been working on parsing a large database of text in different languages and ran into a set of Unicode characters that causes
YamlParser.ReadScalarAsString
to lock-up permanently without an throwing an exception or any other form of error.Example:
The initial culprit was "2", the full-width two character [U+FF12]. Some surface level testing showed that the other full-width numbers cause the same parsing lockup issue. All other text I tried supplying ran without issue.
Priority
This isn't a super high priority fix for me, I can just clean up the data before passing into the YamlParser, but thought it was worth documenting in case this is a sign of a larger unicode handling issue? Thanks, take care!
The text was updated successfully, but these errors were encountered: