[Zope-dev] ZCatalog search problem with some extended chars

[technews@egsx.com]

Hi,

We use Arabic encoding, basically all characters are over the 127, and we
have been unable to use the search feature in Zope.  For now we are trying
to figure out how we can adapt our search engine to search those records.

Adonis

On Tue, 23 Nov 1999, Alexandre Ratti wrote:

> Hello,
> 
> 
> I tested the ZCatalog search feature on text with French extended 
> characters. I use Zope 2.1b2 on Win NT 4. I set the 'fr' locale in z2.py. 
> Zope restarted OK.
> 
> The results are strange: when words with extended characters are indexed in 
> Text Fields, some can be found and some can't. (No problems in Keyword Fields).
> 
> I think I narrowed it down to the following: some extended characters are 
> OK and some are not. I enclosed below a list of 'searchable' and 
> 'non-searchable' characters. I suppose there is a pattern but I couldn't 
> see it.
> 
> Did anyone witness similar behavior? Can I do something to fix it?
> 
> 
> Cheers.
> 
> Alexandre
> 
> ---------------
> 
> (When testing I included the actual character, not its entity 
> representation. However, I include the entities here for reference because 
> mailers may not display these characters properly).
> 
> Included information :
> HTML entity name - Octal code - ANSI code
> 
> Are not working on my box
> ---------------------------------------
> À - Octal \300 - ANSI 192
> Â - Octal \302 - ANSI 194
> Ä - Octal \304 - ANSI 196
> Ö - Octal \326 - ANSI 214
> à - Octal \340 - ANSI 224
> â - Octal \342 - ANSI 226
> ä - Octal \344 - ANSI 228
> ç - Octal \347 - ANSI 231
> è - Octal \350 - ANSI 232
> ö - Octal \366 - ANSI 246
> ù - Octal \371 - ANSI 249
> 
> Are working on my box
> ----------------------------------
> É - Octal \311 - ANSI 201
> Ê - Octal \312 - ANSI 202
> Î - Octal \316 - ANSI 206
> Ï - Octal \317 - ANSI 207
> Ô - Octal \324 - ANSI 212
> Û - Octal \333 - ANSI 219
> Ü - Octal \334 - ANSI 220
> é - Octal \351 - ANSI 233
> ê - Octal \352 - ANSI 234
> î - Octal \356 - ANSI 238
> ï - Octal \357 - ANSI 239
> ñ - Octal \361 - ANSI 241
> ô - Octal \364 - ANSI 244
> û - Octal \373 - ANSI 251
> ü - Octal \374 - ANSI 252
> 
> 
> _______________________________________________
> Zope-Dev maillist  -  Zope-Dev@zope.org
> http://lists.zope.org/mailman/listinfo/zope-dev
>            No cross posts or HTML encoding!
> (Related lists - 
>  http://lists.zope.org/mailman/listinfo/zope-announce
>  http://lists.zope.org/mailman/listinfo/zope )
>