[Zope] Problem with non-latin character sets in Page Templates

Mon May 17 16:03:19 EDT 2010

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hello,
Due to ICANN's decision to allow for non-Latin characters in domain
names, I thought I'd give our Zope installation a test to see how it
would handle it.  We've had problems with people copy and pasting from
MS Word, and its use of strange characters.  I'm sure at some point the
faculty here at Purdue will have a need to link to web sites using
non-Latin characters.

This is my example HTML:

<html>
  <head>
    <title>URL Test</title>
  </head>
  <body>
    <a
href="http://موقع.وزارة-الأتصالات.مصر">http://موقع.وزارة-الأتصالات.مصر</a>.
  </body>
</html>

Not only is it a different character set, but it is a right to left
character set.  This code works fine while editing a Page Template.
However, when viewing it, all of those characters in the href are
converted to question marks.  If the same HTML is pasted into a DTML
Method or a File object, Zope will convert the characters to ASCII
characters.  When viewed it will be viewed correctly.

Any reason that Page Templates may fail to render this properly?

- -Chris

- -- 

- --------------------------------------------------------------------
    Christopher N. Deckard      |     Lead Web Systems Developer
      cnd at ecn.purdue.edu        |    Engineering Computer Network
  http://eng.purdue.edu/ECN/    |         Purdue University
- ---- zlib.decompress('x\234K\316Kq((-J)M\325KM)\005\000)"\005w') ---

-----BEGIN PGP SIGNATURE-----
Version: GnuPG/MacGPG2 v2.0.12 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAkvxoQcACgkQ+zGkEDwn8UZcGACgufURwanURBIBcZUSLYYRkEvV
vKwAoNnGMlmOhE/GciZuTO3ldptuBr4Z
=mypE
-----END PGP SIGNATURE-----