ringo

Description:

ringo

ringo #

ringo is japanese word separator.
Usage #
final ringo = await Ringo.init();
final tokenized = ringo.tokenize('吾輩はRingoである');
print('tokenized: $tokenized');
copied to clipboard
tokenized: [吾輩, は, Ringo, である]
⚡️ Features #

✅ Simple word separation(Japanese)
✅ Unknown word processing
✅ Build own dictionary(Create DoubleArray from TrieTree)
✅ Fast dictionary search(DoubleArray Algorithm)

Upcoming Features #

❌ MorphologicalAnalysis(Lattice Algorithm)

Contributing #

ringoは日本語の分かち書きをします．(今後，形態素解析もサポートする予定です)

License

For personal and professional use. You cannot resell or redistribute these repositories in their original state.

Share

• Share on Facebook
• Share on Twitter