[Zope] Indexing: ZopeSplitter and numbers

[Richard Jones]

On Tuesday 13 November 2001 23:05, Andreas Jung wrote:
> The answer is - as always - in the sources ;-) The splitting algorithm is
> pretty dumb. Roughly spoken it splits the text in words but not into
> numbers.
> To test the splitter try this:
>
> from ZopeSplitter import ZopeSplitter
> print list(ZopeSplitter('abc 123 t353 nmj'))
>
> gives ['abc', 't353', 'nmj']

Yes, I realise - my question was more "what's the reasoning behind it" ... 
which appears to be "it's dumb" and therefore, can we please fix it?


   Richard