[Zope-dev] chinese text and zope.index

[Wichert Akkerman]

On 7/26/10 14:52 , Manabu TERADA wrote:
> Hi
>
> I think zope.index will not work for indexing simplified or traditional
> Chinese.  That is my observation of zope.index when I was working on
> Plone4 CJK indexing.  However by looking at SVN record of zope.indexing,
> I see some changes.  It could be working on Chinese, now.

I'm afraid it doesn't work at all.

> I feel that zope.index should be fixed to work on CJK as well.
> However, I have not get at it.  When will be the due date for the new
> zope.index which works CJK indexing. (It should not that hard to fix it.)

I'ld like to have it working today if at all possible :). I have no idea 
how to go about fixing it though.

> PS:
> I don't think it is good idea to use CJKSplitter on a new project.  None
> is maintaining CJKSplitter any more.  Moreover, CJKSplitter will not
> work on Japanese, and some problem on indexing English.

I looked at cjktools as well, but could not find a splitter in there. 
That might be due to my lack of understanding of CJK languages though.

Wichert.