SQLite FTS5 中文单字分词器。
感谢 CChan 贡献。
https://ld246.com/article/1641042386027
- Linux
gcc -fPIC -lm -shared siyuan.c -o siyuan-tokenizer.so
- macOS
gcc -fno-common -dynamiclib siyuan.c -o siyuan-tokenizer.dylib
- Windows
gcc -shared -I "sqlite3ext.h" -o siyuan-tokenizer.so siyuan.c