November 1999 - Zope

Zope Startup Questions II (Son of Zope)
by Alexander Limi 15 Nov '99

15 Nov '99

Hello again. Thanks for the answers to my previous mail, the answers were to-the-point and, as all good answers do, provoked some more questions :) Without further ado, I give you - the questions: - Zope DB size We already have 300 artists, and expect it to come close to 1000 after a short while. The mp3s should be separated from the main DB, obviously, but separating bitmaps from the rest of the data is not desirable. However, with 1000 artists each having - say, 300K of data, one sooner or later approaches the 2G limit for linux boxes when counting the other content on the site. Does anybody know if this is a limitation of the kernel or the FS? And is it going to be fixed in the foreseeable future? On a side note, we plan on storing the mp3s on several servers spread throughout the country, and pass all requests for files to an object that queries the servers for their individual loads at the moment. Any thoughts on how to implement this in an elegant way using Zope/Python? - Backup How does one perform a backup of a file (data.fs) bigger than 1G without going offline? Even copying the file to another location to back it up from there could cause strange behaviour if people are changing details in the database along the way? Or is there something I haven't understood yet? To stop the transactions in the DB every time one does a backup (and 2G of data takes somr time to back up, no matter what solution :) - Multiple servers I've seen you mention ZOE in some of the discussions here, but could not find any information about it on the Zope site. Is this an external or internal product? What does it do? Any info appreciated. - And something from the previous mail: >> 6. This is a bit specific, but anyway: users should be able to write >> "http://mp3.no/artistname" and be sent directly to the artist with that >> name. Does Zope have any specific mechanisms for doing this? Michel wrote: >Uhm.... yes, but it would require some trickery if you want that >information to come from, say, a database, but nothing to complicated. >Otherwise, you can just create a top level folder for each artist. This >could get pretty hard to manage however, you might want to consider >http://site/Artists/artisname This is not an alternative, simply because people want simple URLs, and when they want to promote themselves they prefer URLs people remember. Thus, mp3.no/artistname is important. :) So, could you explain (roughly) the trickery involved in this? In addition, we are going to have two classes of users: artists & listeners, with slightly different needs: Artists should be able to upload songs, enter text for their webpage etc. The listeners should be able to have a customized "view" with login/cookie - a kind of "my.mp3.no" (á la my.excite.com) where they can pick the artists they are interested in, their own "skin" for the website, notification by email when one of their favourite artists releases anything and so on. It would be entirely acceptable for us to have two folders "artists" and "listeners" with the users in, as long as it is transparent to the users. Suggestions on how to best solve this in Zope are welcome (seeing as the Zen is not that strong in us - yet :) Thanks for your time, Alexander Limi MP3 Norway - http://mp3.no

5 5

acl_users from Zope.org [Q]
by Bruno Mattarollo 15 Nov '99

15 Nov '99

Hello... May I ask what is Zope.org using as acl_users? UserDB? or the standard acl_users from the Zope-2.0.1 dist.? TIA /B Bruno Mattarollo <brunomadv(a)ciudad.com.ar> --- Python Powered <http://www.python.org/psa/>

1 0

Re: [Zope] Zope Startup Questions II (Son of Zope)
by Ian Willis 15 Nov '99

15 Nov '99

It is more a limitation of the 32 bit chipset rather than a limitation of the filesystem. 64 bit systems don't have this problem and a journaling filesystem won't fix the problem. It was a design choice when the filesystem was designed, disks were small and 64 bit systems were on the horizon. I think thatIntel has done some fancy design work on the Xeons so that that have 36 bit registers that are used for addressing but it is basically a kludge( needs a nonstandard approach for just that platform ). The software kludge is to create an extra layer in the filesystem ( read slower ) design. There are patches round that do fix this problem but the reason why it has not been incorporated into the mainstream kernel is that it is bad (read nonstandard ) design. If you are addressing files of this size I would look very seriously at a 64 bit system simply for performance reasons. Ethan Fremen wrote: > > Pavlos Christoforou wrote: > > On Sat, 13 Nov 1999, Alexander Limi wrote: > > > Does anybody know if this is a limitation of the kernel or the FS? And > is > > > it going to be fixed in the foreseeable future? > > > > It is a limitation of the FS, and it will be fixed but I do not know > when. > > The next edition of Red Hat Linux will include a journaling filesystem- > i believe this is the one from SGI- which allows files in the > petabytes... > > -- > Ethan "mindlace" Fremen > you cannot abdicate responsibility > for your ideology. > > _______________________________________________ > Zope maillist - Zope(a)zope.org > http://lists.zope.org/mailman/listinfo/zope > No cross posts or HTML encoding! > (Related lists - > http://lists.zope.org/mailman/listinfo/zope-announce > http://lists.zope.org/mailman/listinfo/zope-dev )

1 0

RE: [Zope] catalog/site search error
by Michel Pelletier 15 Nov '99

15 Nov '99

> -----Original Message----- > From: Mark K. Smith [mailto:mark@sourcegear.com] > Sent: Monday, November 15, 1999 3:21 PM > To: Zope(a)zope.org > Subject: [Zope] catalog/site search error > > > I set up a site search using zcatalog. It works fine > sometimes, but other > times for certain words it returns the error message below. > Each time I type > new word that causes the error, the Error Value changes. First, you can remove the error by updating your catalog. Second, I *really* want to be able to reproduce this. So... Update your catalog, and reproduce it just once. Once it happens, update the catalog again and keep reproducing it until you have an exact sequence of steps that cause the problem. I'm very interested in finding out that sequence. Third, are you using CatalogAware ZClasses? -Michel > > Any help or guidance would be appreciated. > > Thanks, > > Mark > > Mark K. Smith > SourceGear Corporation > www.sourcegear.com > 217/356-0105 x234 > > ------------------------------------ > > Error Type: KeyError > Error Value: 133 > > Traceback (innermost last): > File /usr/local/Zope/lib/python/ZPublisher/Publish.py, line 214, in > publish_module > File /usr/local/Zope/lib/python/ZPublisher/Publish.py, line 179, in > publish > File /usr/local/Zope/lib/python/Zope/__init__.py, line 201, in > zpublisher_exception_hook > (Object: ApplicationDefaultPermissions) > File /usr/local/Zope/lib/python/ZPublisher/Publish.py, line 165, in > publish > File /usr/local/Zope/lib/python/ZPublisher/mapply.py, line > 160, in mapply > (Object: report) > File /usr/local/Zope/lib/python/ZPublisher/Publish.py, line 102, in > call_object > (Object: report) > File /usr/local/Zope/lib/python/OFS/DTMLMethod.py, line > 145, in __call__ > (Object: report) > File > /usr/local/Zope/lib/python/DocumentTemplate/DT_String.py, line 502, > in __call__ > (Object: report) > File /usr/local/Zope/lib/python/DocumentTemplate/DT_In.py, > line 592, in > renderwb > (Object: catalog) > File /usr/local/Zope/lib/python/Products/ZCatalog/Lazy.py, > line 190, in > __getitem__ > File > /usr/local/Zope/lib/python/Products/ZCatalog/Catalog.py, line 159, in > __getitem__ > KeyError: (see above) > > > > _______________________________________________ > Zope maillist - Zope(a)zope.org > http://lists.zope.org/mailman/listinfo/zope > No cross posts or HTML encoding! > (Related lists - > http://lists.zope.org/mailman/listinfo/zope-announce > http://lists.zope.org/mailman/listinfo/zope-dev ) >

1 0

RE: [Zope] security question
by Chris McDonough 15 Nov '99

15 Nov '99

Sam, The index_html in the subfolder may be referencing DTML methods in the root object through acquisition (e.g. standard_html_header and standard_html_footer).... try a "dummy" index_html within the subfolder that doesn't reference any other methods. -----Original Message----- From: Sam Gendler [mailto:sgendler@teknolojix.com] Sent: Monday, November 15, 1999 2:14 PM To: zope(a)zope.org Subject: [Zope] security question I have a zope site that has anonymous access completely disabled in the root directory. If I create a folder underneath the root, and attempt to give anonymous access to that folder, zope still gives me a login dialog box when accessing that folder. This occurs whether I have 'acquire permissions' on or off in the sub-folder. Is this correct behaviour or a bug, or am I overlooking something. --sam _______________________________________________ Zope maillist - Zope(a)zope.org http://lists.zope.org/mailman/listinfo/zope No cross posts or HTML encoding! (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )

1 0

catalog/site search error
by Mark K. Smith 15 Nov '99

15 Nov '99

I set up a site search using zcatalog. It works fine sometimes, but other times for certain words it returns the error message below. Each time I type new word that causes the error, the Error Value changes. Any help or guidance would be appreciated. Thanks, Mark Mark K. Smith SourceGear Corporation www.sourcegear.com 217/356-0105 x234 ------------------------------------ Error Type: KeyError Error Value: 133 Traceback (innermost last): File /usr/local/Zope/lib/python/ZPublisher/Publish.py, line 214, in publish_module File /usr/local/Zope/lib/python/ZPublisher/Publish.py, line 179, in publish File /usr/local/Zope/lib/python/Zope/__init__.py, line 201, in zpublisher_exception_hook (Object: ApplicationDefaultPermissions) File /usr/local/Zope/lib/python/ZPublisher/Publish.py, line 165, in publish File /usr/local/Zope/lib/python/ZPublisher/mapply.py, line 160, in mapply (Object: report) File /usr/local/Zope/lib/python/ZPublisher/Publish.py, line 102, in call_object (Object: report) File /usr/local/Zope/lib/python/OFS/DTMLMethod.py, line 145, in __call__ (Object: report) File /usr/local/Zope/lib/python/DocumentTemplate/DT_String.py, line 502, in __call__ (Object: report) File /usr/local/Zope/lib/python/DocumentTemplate/DT_In.py, line 592, in renderwb (Object: catalog) File /usr/local/Zope/lib/python/Products/ZCatalog/Lazy.py, line 190, in __getitem__ File /usr/local/Zope/lib/python/Products/ZCatalog/Catalog.py, line 159, in __getitem__ KeyError: (see above)

1 0

Cheap LINUX Zope host?
by tommy_b＠my-deja.com 15 Nov '99

15 Nov '99

Oops, I'm going to use LINUX as the host OS. I've done a bit of research on using SCSI. IWill & Tekram put out SCSI3 cards under $70 (according to http://www.pricewatch.com) Anyone use these guys? However, I'm not sure a cheap/close-out SCSI drive will match the performance-to-value ratio to a new ATA-66. http://www.storagereview.com has lots of drive tests that leads me to this thought. If I was spending more than $1000 for a new system, I'd go SCSI for sure. I need to keep below $700, but SCSI is one of my first planned upgrades. Is SCSI worth me getting a old used system with 64MB of RAM & slapping a SCSI card into it, or should I go for a new (dual) Celeron with 128MB? Has anyone actually done performce tests with Zope & SQL to compare what component has the most impact for a _cheap_ system: CPU, memory, or HD throughput (ATA vs SCSI)? Thanks for Stephan, Jim, & Nitin for the replies! -- On Sun, 14 Nov 1999 18:28:56 Nitin Borwankar wrote in "Re: [Zope] What to buy for cheap Zope host?": >tommy_b(a)my-deja.com wrote: >> I'm building a computer to train & test Zope. I hope to use PostgreSQL or MySQL for storing a good-sized database. Zope would be used for allowing users to enter data & for output of formated querries. >> I wish to spend no more than $700 on this new computer I'm building (not including sound & video card + monitor). What should I spend the most money on, CPU, memory, HD, or a balance? >> I'm leaning towards a PPGA Celeron 366 (possibly overclocked), buying a 128MB stick of P100 RAM, and the fastest ATA drive $120 can buy. Is this the right direction? Ram's rather expencive now, or else I'd get 256MB right away. > >In either case spending some money and getting a SCSI controller and drive gives a measurable contribution to performance. However this may take you into the next price point segment ~1000$. I have found there are good bargains on SCSI drives to be had on eBay and ONSALE auctions - go for new and 7200RPM or more. --== Sent via Deja.com http://www.deja.com/ ==-- Share what you know. Learn what you don't. --------- End Forwarded Message --------- --== Sent via Deja.com http://www.deja.com/ ==-- Share what you know. Learn what you don't.

3 2

Re: [Zope] setup for an odbc connection!
by Jim Sanford 15 Nov '99

15 Nov '99

Not difficult to make login only site. Give anonymous users no access rights (uncheck all checkboxes under Anonymous under Security Tab at your top level.) Put users in acl_users folder at root of your site. Create a new role (MEMBER for example) and give all the users at least that role. Give MEMBER appropriate access rights (view, use database methods ...) All users will now have to login. Jim Sanford Databases Engineer 334-661-5770 jsanford(a)atinucleus.com http://www.atinucleus.com Accelerated Technology, Inc. 720 Oak Circle Drive East Mobile, AL 36609 **Source Code, No Royalties, Any CPU ... It just makes sense. ----- Original Message ----- From: Rod Za <rodza(a)bhnet.com.br> To: Jim Sanford <jsanford(a)atinucleus.com> Sent: Monday, November 15, 1999 1:57 PM Subject: Re: [Zope] setup for an odbc connection! > Hello Jim, > > Thank you very much. I do that, and now this is working very well! 8-) > sorry by my ignorance! > is complicate make a site where the user must log-in (with a valid user name > and password) to see some informations. (like in a bank site?) > > Thank you for the attention! > > Rod Za > > > ----- Original Message ----- > From: Jim Sanford <jsanford(a)atinucleus.com> > To: Rod Za <rodza(a)bhnet.com.br>; <zope(a)zope.org> > Sent: Monday, November 15, 1999 5:07 PM > Subject: Re: [Zope] setup for an odbc connection! > > > > you should be able to access the dbf file with the Microsoft dBase ODBC > > driver. you would need to set up a system DSN for it: > > > > Start-Settings-Control Panel > > Select ODBC > > Select System DSN > > Click Add > > Select Microsoft dBase Driver(*.dbf) > > Click Finish > > Give it a Data Source Name > > Enter a Description if you wish > > Select version (III, IV 5.0) > > Select a Directory (c:\dbfs) > > Select Indexes > > > > Create a ZODBCDA connection to the system DSN (it should appear in the > > dropdown in the ZODBCDA create screen) > > > > You would refer to the file in your SQL statement in a ZSQL method: > > > > SELECT * FROM cass WHERE mailer_id = 'MetroMail' > > > > Jim Sanford > > Databases Engineer > > > > 334-661-5770 > > jsanford(a)atinucleus.com > > http://www.atinucleus.com > > > > > > Accelerated Technology, Inc. > > 720 Oak Circle Drive East > > Mobile, AL 36609 > > **Source Code, No Royalties, Any CPU ... It just makes sense. > > > > > > ----- Original Message ----- > > From: Rod Za <rodza(a)bhnet.com.br> > > To: <zope(a)zope.org> > > Sent: Monday, November 15, 1999 12:38 PM > > Subject: [Zope] setup for an odbc connection! > > > > > > > Hello all, > > > Maybe someone can help me. I have a dbf file that i need to consult with > > > Zope. > > > This is a simple file (named cass.dbf). Ok. I have installed the ZODBC > and > > > like to know how to use this. > > > I have try various resources to make this but i can't. > > > First of all. need i configure the windows odbc manager to locate my > > > cass.dbf file? (this is in c:\dbfs\) > > > > > > > > > Thank you very much. > > > > > > Rod Za > > > > > > > > > _______________________________________________ > > > Zope maillist - Zope(a)zope.org > > > http://lists.zope.org/mailman/listinfo/zope > > > No cross posts or HTML encoding! > > > (Related lists - > > > http://lists.zope.org/mailman/listinfo/zope-announce > > > http://lists.zope.org/mailman/listinfo/zope-dev ) > > > > > > > > > > > > _______________________________________________ > > Zope maillist - Zope(a)zope.org > > http://lists.zope.org/mailman/listinfo/zope > > No cross posts or HTML encoding! > > (Related lists - > > http://lists.zope.org/mailman/listinfo/zope-announce > > http://lists.zope.org/mailman/listinfo/zope-dev ) > > > >

1 0

security question
by Sam Gendler 15 Nov '99

15 Nov '99

I have a zope site that has anonymous access completely disabled in the root directory. If I create a folder underneath the root, and attempt to give anonymous access to that folder, zope still gives me a login dialog box when accessing that folder. This occurs whether I have 'acquire permissions' on or off in the sub-folder. Is this correct behaviour or a bug, or am I overlooking something. --sam

1 0

setup for an odbc connection!
by Rod Za 15 Nov '99

15 Nov '99

Hello all, Maybe someone can help me. I have a dbf file that i need to consult with Zope. This is a simple file (named cass.dbf). Ok. I have installed the ZODBC and like to know how to use this. I have try various resources to make this but i can't. First of all. need i configure the windows odbc manager to locate my cass.dbf file? (this is in c:\dbfs\) Thank you very much. Rod Za

2 1