Playing with Zope X3
Hello, is there any kind of tutorial/How-To move form Zope 2 to 3? Or just a beginners tutorial of Zope X3? I just want to play a bit with Zope X3 but I don't really get the point of Zope 3 without a tutorial. I've knowledge about Zope 2. Thx, Florian
dev.zope.org -> Zope 3 is your friend. -aj --On Montag, 12. Januar 2004 21:02 Uhr +0100 Florian Lindner <mailinglists@xgm.de> wrote:
Hello, is there any kind of tutorial/How-To move form Zope 2 to 3? Or just a beginners tutorial of Zope X3? I just want to play a bit with Zope X3 but I don't really get the point of Zope 3 without a tutorial. I've knowledge about Zope 2. Thx, Florian
_______________________________________________ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Hi there, I am about to finalize a Zope 2 site. It will mainly play the role of groupware app and storage server. My question is : i know i ll get quicly a big amount of PSD files (photoshop) they are usually quite heavy. Do you rekon i should store them on my server file system rather than the ZODB ? Do you see any trouble putting them all into the DB in a longer term ? (i know my python is large-file compiled). Storing on both FS and ZODB is it an easy thing to do ? Thanks in advance Seb
On Tue, Jan 13, 2004 at 12:01:09AM +0100, Sebastien Pastor wrote:
Hi there,
I am about to finalize a Zope 2 site. It will mainly play the role of groupware app and storage server. My question is : i know i ll get quicly a big amount of PSD files (photoshop) they are usually quite heavy. Do you rekon i should store them on my server file system rather than the ZODB ? Do you see any trouble putting them all into the DB in a longer term ? (i know my python is large-file compiled).
two issues: 1) A single large FileStorage has been a bit cumbersome to maintain (backups etc). recent developments (repozo.py) make it possible to do an incremental backup. There's also DirectoryStorage which on a suitable filesystem should be able to scale to a very large database. You can also mix-and-match and have multiple databases using DBTab. 2) Performance of serving large files or images from Zope is pretty bad, much slower than a static webserver like Apache. The worst part is that a few simultaneous requests for large files will essential DOS your entire zope site until they complete. I have not identified the precise point of pain, but I know that in my experience, 5 MB is OK and 50 MB is awful. I have worked around this by using FSCacheManager (available from CVS at collective.sf.net) which does "funky caching". It is easy to set up with Apache, but is only safe to use with anonymously-viewable content. I understand that Squid can be set up to do filesystem caching while forcing authentication on each request so it would be safe with secured content, so we might do that instead at a later date.
Storing on both FS and ZODB is it an easy thing to do ?
If you want the files on the filesystem, there are various solutions depending on your needs: LocalFS, FilesystemDirectoryView, and APE. I have not evaluated these for performance with large files, except LocalFS which I know is at least as slow as normal zope File objects. I tend to assume they are all slow. -- Paul Winkler http://www.slinkp.com Look! Up in the sky! It's TERRA-RANDY CHAIN MISTER! (random hero from isometric.spaceninja.com)
Paul Winkler wrote:
On Tue, Jan 13, 2004 at 12:01:09AM +0100, Sebastien Pastor wrote:
Hi there,
I am about to finalize a Zope 2 site. It will mainly play the role of groupware app and storage server. My question is : i know i ll get quicly a big amount of PSD files (photoshop) they are usually quite heavy. Do you rekon i should store them on my server file system rather than the ZODB ? Do you see any trouble putting them all into the DB in a longer term ? (i know my python is large-file compiled).
[snip]
Storing on both FS and ZODB is it an easy thing to do ?
If you want the files on the filesystem, there are various solutions depending on your needs: LocalFS, FilesystemDirectoryView, and APE. I have not evaluated these for performance with large files, except LocalFS which I know is at least as slow as normal zope File objects. I tend to assume they are all slow.
ExtFile should be quite a bit faster than LocalFS (it streams directly from the FS in most cases instead of first loading everything into Zope like LocalFS). Be sure to get the rewritten version Stefan Holek did: http://zope.org/Members/shh/ExtFile
Thanx Peter, i ll have a look @ ExtFile Cheers Seb Peter Sabaini wrote:
Paul Winkler wrote:
On Tue, Jan 13, 2004 at 12:01:09AM +0100, Sebastien Pastor wrote:
Hi there,
I am about to finalize a Zope 2 site. It will mainly play the role of groupware app and storage server. My question is : i know i ll get quicly a big amount of PSD files (photoshop) they are usually quite heavy. Do you rekon i should store them on my server file system rather than the ZODB ? Do you see any trouble putting them all into the DB in a longer term ? (i know my python is large-file compiled).
[snip]
Storing on both FS and ZODB is it an easy thing to do ?
If you want the files on the filesystem, there are various solutions depending on your needs: LocalFS, FilesystemDirectoryView, and APE. I have not evaluated these for performance with large files, except LocalFS which I know is at least as slow as normal zope File objects. I tend to assume they are all slow.
ExtFile should be quite a bit faster than LocalFS (it streams directly from the FS in most cases instead of first loading everything into Zope like LocalFS).
Be sure to get the rewritten version Stefan Holek did:
http://zope.org/Members/shh/ExtFile
------------------------------------------------------------------------
_______________________________________________ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Thanks Paul for all those infos. Would storing files using MySql or PostGreSQL be another viable solution? Have you tried that ? Seb Paul Winkler wrote:
On Tue, Jan 13, 2004 at 12:01:09AM +0100, Sebastien Pastor wrote:
Hi there,
I am about to finalize a Zope 2 site. It will mainly play the role of groupware app and storage server. My question is : i know i ll get quicly a big amount of PSD files (photoshop) they are usually quite heavy. Do you rekon i should store them on my server file system rather than the ZODB ? Do you see any trouble putting them all into the DB in a longer term ? (i know my python is large-file compiled).
two issues:
1) A single large FileStorage has been a bit cumbersome to maintain (backups etc). recent developments (repozo.py) make it possible to do an incremental backup. There's also DirectoryStorage which on a suitable filesystem should be able to scale to a very large database. You can also mix-and-match and have multiple databases using DBTab.
2) Performance of serving large files or images from Zope is pretty bad, much slower than a static webserver like Apache. The worst part is that a few simultaneous requests for large files will essential DOS your entire zope site until they complete.
I have not identified the precise point of pain, but I know that in my experience, 5 MB is OK and 50 MB is awful. I have worked around this by using FSCacheManager (available from CVS at collective.sf.net) which does "funky caching". It is easy to set up with Apache, but is only safe to use with anonymously-viewable content. I understand that Squid can be set up to do filesystem caching while forcing authentication on each request so it would be safe with secured content, so we might do that instead at a later date.
Storing on both FS and ZODB is it an easy thing to do ?
If you want the files on the filesystem, there are various solutions depending on your needs: LocalFS, FilesystemDirectoryView, and APE. I have not evaluated these for performance with large files, except LocalFS which I know is at least as slow as normal zope File objects. I tend to assume they are all slow.
On Tue, Jan 13, 2004 at 12:48:56PM +0100, Sebastien Pastor wrote:
Thanks Paul for all those infos. Would storing files using MySql or PostGreSQL be another viable solution? Have you tried that ?
I have not. -- Paul Winkler http://www.slinkp.com Look! Up in the sky! It's BAT-SPONGIFORM VIVISECTIONIST! (random hero from isometric.spaceninja.com)
I use BerkeleyDB with ZEO for storing bigfiles (up to 100MB) - it works pretty good and fast.
Florian Lindner wrote:
is there any kind of tutorial/How-To move form Zope 2 to 3? Or just a beginners tutorial of Zope X3? I just want to play a bit with Zope X3 but I don't really get the point of Zope 3 without a tutorial. I've knowledge about Zope 2.
The Zope 3 dev site/wikis have a developer's tutorial, a cookbook, and a heap of other good stuff. Naturally it's all in transition, but so is the code. Follow the link from any zope.org page. There is no real migration path for code as of yet (thus the X in 'X3') but you can move your brain. --jcc
participants (7)
-
Andreas Jung -
Florian Lindner -
Harald Koschinski -
J Cameron Cooper -
Paul Winkler -
Peter Sabaini -
Sebastien Pastor