The first version of a Japanese Tokenizer implementation using MeCab.
It hasn't been tested yet.
In order to compile property both MeCab and libiconv should be installed.
In ubuntu the following packages are needed: libmecab-dev mecab-ipadict-utf8
It's also recommended to install libiconv from source.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.xapian.org/pipermail/xapian-devel/attachments/20120420/8a46a824/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: jptoken-0.1.patch
Type: application/octet-stream
Size: 8950 bytes
Desc: not available
URL:
<http://lists.xapian.org/pipermail/xapian-devel/attachments/20120420/8a46a824/attachment-0002.obj>
