[Zope] Unicode strings and search

Andreas Jung Andreas Jung <andreas@andreas-jung.com>
Thu, 12 Jun 2003 19:01:45 +0200


--On Donnerstag, 12. Juni 2003 19:38 Uhr +0300 Vladimir Petrovic 
<vladap@criticalpublics.com> wrote:

>
> (3) TextIndexNG (1.09). This index properly divided text in words.
> However,  querying the index with * doesn't produce results if non-latin1
> character is  used. Querying full words works:
>
> - searchResults ({'ind':_.unicode ('a*', 'utf-8')}) - works
> - searchResults ({'ind':_.unicode ('<alpha><alpha>', 'utf-8')}) - works
> - searchResults ({'ind':_.unicode ('<alpha>*, 'utf-8')}) - doesn't work.
>

I really can't believe that because the complete internal processing is done
with unicode strings. Please check the unittests of TextIndexNG and try
to build a unittest that reproduces your problem.

-aj