- Zope - Zope lists

Re[2]: [Zope] CASE tools and Zope
by Alexander Chelnokov 28 Jun '00

28 Jun '00

Hello Dieter, Wednesday, June 28, 2000, 3:57:56 AM, you wrote: DM> If your patient data is in an SQL database, you do not need DM> to build (redundant) ZClass instances for them. DM> Instead, you would use Z SQL Methods to access them. As i realize, ZSQL methods are merely SQL statements for data manipulation - select, insert, delete and so on. But some application logic and data integrity rules may be IMHO wrapped into ZClasses instead of triggers and stored procedures. It looks promising for instance to have base class Patient (with appropriate ZSQL methods), which can produce other classes like Patient with knee problems, Patient for total arthroplasty and so on, where properties of base class including ZSQL are inherited and require minimal additions/changes. Do i suppose wrong? Best regards, Alexander N. Chelnokov Ural Scientific Institute of Traumatology and Orthopaedics str.Bankovsky, 7. Ekaterinburg 620014 Russia E-mail: uniitos(a)mail.utnet.ru, alex_chel(a)hotmail.com ICQ: 25640913

2 1

2.2b3 Tutorial issues
by Luke Tymowski 28 Jun '00

28 Jun '00

Hello, The tutorial included with 2.2b3 now "works"; however, the documents are in the wrong order (9, 10, 11, 1, 2, 3, 4 etc). And every page generates a JavaScript error on IE 5.01 (syntax error on line 74). Luke

1 0

mozilla and zope play nicely again!
by Anthony Baxter 28 Jun '00

28 Jun '00

The basic auth problem of mozilla-on-linux that's been around since around the 1st or 2nd of June are now fixed, as of 2000-06-27-20-M17 (note that I don't believe that straight M17 has the fixes applied.) Yay! Anthony

3 2

ZODB performance: reads to writes
by Jimmie Houchin 28 Jun '00

28 Jun '00

I know this has been brought up before, but I don't remember if this question has been asked. I've been reading everything I could find on the ZODB. Currently I am reading 'Introduction to the Zope Object Database' by Jim Fulton at http://www.zope.org/Members/jim/Info/IPC8/ZODB3/index.html . Towards the end of the paper under Status, he starts referring to future features. Under 'Application-level conflict resolution protocols' he states this, 'Applications with much higher write to read ratios are likely to encounter frequent conflict errors which can seriously affect performance.' Is this pretty much the primary reason that it is generally said that the ZODB isn't as well suited to high write situations? Or is there more to it than that? The reason I ask is this. My app by it's nature as a community/portal will have plenty of writes in certain areas. However, due to the structure of the website and the app most all writes are to unique objects, are appends to an object or the person editing the object is the owner and has no one to conflict with. In this case there should be little if any ConflictErrors due to different users trying to commit changes to the same object. In the case of the appends, it would be like a bboard and there would be no conflict. Appends will be done in the order received. Will an app as described above still suffer from problems with high writes? Thanks for any help. Jimmie Houchin

5 8

Re: [Zope] ZODB or not ZODB?
by Cary O'Brien 28 Jun '00

28 Jun '00

> charset="iso-8859-1" > > I am implementing a document Library using Zope. It has an exhaustive index > with several thousand topics in an outline residing on a PostgreSQL > database. This works well and I like it. > > My question is where is the best place to store the documents themselves? > They will be static HTML documents ranging from 1-50Kb in size roughly. > There will probably be at least 10,000-15,000 of these documents in the > library once all is said and done. > > In my mind I have three options: > > 1. Store them on the filesystem. > 2. Store them in a PgSQL table as blobs. > 3. Store them as DTML Docs in the ZODB. > The filesystem, imho. This lets you spread things out over multiple disks and even (perhaps) multiple systems. Worst case you've got 50k x 15k = 750M. Big for a ZODB (?), but no sweat for a file system. PgSQL blobs are not yet ready for prime time. For one thing, I think they are all created in the same directory. And I'm a big PgSQL fan, so this pains me to say, but it is true. They are working on it. See the TOAST project in the postgresql mailing lists. You want to spread the documents out over a couple of directories. I've set up systems where everything had an ID and we'd split things up via digits in the id. I.e. document 252a8b7c is file 25/2a/7b/25218b7c. You could even compress the files if you wanted to. And you could use the "LocalFileSystem" (is that it?) product to serve up the files through Zope. You could tweak it to decompress too. > I would like to eventually have full text searching capabilities, so that > makes #1 less attractive (I would likely need my own Python method to do > it). #2 is somewhat of a pain to implement due to limitations in the PgSQL > row size and text searching would be slow. With #3 I could in theory use a > ZCatalog to implement the searching, so that is done for me. > I'd put the full text search into PostgreSQL. When the doc comes in, strip out the keywords and index it. > Is ZODB up to the task of storing this quantity of objects? What problems > might I run into? Is it a wise idea, could a data.fs file of this size > (~3-400MB) become too easily corrupted? Should I use a separate data.fs file > just to store the documents (ie using mountedFileStorage)? Or is it better > to use method #1 or #2? Information from anyone with experience in this > regard is greatly appreciated. > We implemented a system using #1. Actually, we had lots of little documents so we concatted and gziped them in batches of 200, keeping the filename, offset, and length. Turns out it was quick enought to unzip the file and pick out the document of interest. And batching them up kept the compression ratio up. System worked great, but was cancelled about a week before it was going to go online. ouch. I'll let others speak to 3. I've never had a problem with ZODB, but I've never put 750MB in it. -- cary > -Casey Duncan > caseman(a)mad.scientist.com > > > --__--__-- >

3 3

RE: [Zope] Q: LoginManager and SQL-US?
by Wilkinson Charlie E 28 Jun '00

28 Jun '00

Thanks to Dan Pierson and J.Atwood for pointing me at the GUF/SQL howto. I've beating my head against LM since. I even looked at the source code (which might be more useful if I spoke Python... Anyway, here's what I think I've figured out: Four methods must be created under a UserSource, whether DTML method, external, or whatever: userExists - passed 'username', return 1 if exists. userAuthenticate - passed 'username', 'password', return 1 if valid user. userRoles - passed 'username', return user roles in either space-delimited string, or list. userDomains - passed 'username', return either a list of valid domains (example?) or an empty list/string(?) to leave it wide open. How is that? Am I even getting close? It's worth noting that I still haven't been able to get LM working on either of two installs. At home I got past userExists and userAuthenticate, but then kept getting "Forbidden." It appears that I'm not successfully returning a list of roles back to the UserSource code. (When I uncomment the stuff to report that from ForbiddenPage, my roles are empty.) But is it possible that the real problem is the domains, or something else? At work, I can't seem to get past the login screen. I've tried dropping <dtml-raise ...> and python raise all over the damn place and it appears that program flow is going nowhere near those four methods or their wrappers in UserSource.py. The traceback shows: Traceback (innermost last): File /usr/local/Zope-2.1.6-src/lib/python/ZPublisher/Publish.py, line 214, in publish_module File /usr/local/Zope-2.1.6-src/lib/python/ZPublisher/Publish.py, line 179, in publish File /usr/local/Zope-2.1.6-src/lib/python/Zope/__init__.py, line 202, in zpublisher_exception_hook (Object: ElementWithAttributes) File /usr/local/Zope-2.1.6-src/lib/python/ZPublisher/Publish.py, line 151, in publish File /usr/local/Zope-2.1.6-src/lib/python/ZPublisher/BaseRequest.py, line 446, in traverse File /usr/local/Zope-2.1.6-src/lib/python/Products/LoginManager/LoginManager.py, line 149, in lm_unauth (Object: SheetProviderContainer) File /usr/local/Zope-2.1.6-src/lib/python/OFS/DTMLDocument.py, line 166, in __call__ (Object: loginForm) File /usr/local/Zope-2.1.6-src/lib/python/DocumentTemplate/DT_String.py, line 502, in __call__ (Object: loginForm) File /usr/local/Zope-2.1.6-src/lib/python/DocumentTemplate/DT_Raise.py, line 128, in render (Object: 'LoginRequired') LoginRequired: (see above) Clue anyone? TIA, Charlie > -----Original Message----- > From: Dan L. Pierson [mailto:dan@sol.control.com] > > Wilkinson Charlie E writes: > > 1. Can LoginManager be (easily?) made to meet my specific need? > > Probably, it includes a GenericUserSource, which is essentially a > clone of Generic User Folder (see below). > > > 2. Has anyone done an SQL UserSource yet, or can anyone > > give me a clue how to make one? > > You should look at Generic User Folder, and the HowTo that > tell how to > set it up with Postgressql. Basically, you need to create a > number of > SQLMethods to query your database and some wrappers for these > methods. The SQLMethods are the only thing that has to care > about the > details of your database format. >

1 0

ZODB/FSSession TransactionError
by Brian McClain 28 Jun '00

28 Jun '00

Well, I got a second installation of Zope running OK in another directory after correcting some group/permission errors on my part. It seems I can now use FSSession with this second installation with no problems (fingers crossed "Oh please please please"). In my original Zope installation, I'm still getting the same EOFError when I try to view a document containing <dtml-call FSSession>. I have been unable to reproduce the original TransactionError in the original Zope. I have mucked around with the 1st Zope since receiving this initial TransactionError - mostly removing var/Data.fs, etc.. and reinstalling FSSession etc... so that I could start "fresh". If I get the original Zope to behave I'll describe the procedure... Thanks, Brian

2 1

RE: [Zope] Data.fs.lock?
by Toby Dickenson 28 Jun '00

28 Jun '00

Windows definitely provides the right default behaviour here; in most cases reading a file while someone else is writing to it is a great way to read garbage. Its annoying for the minority of cases where it does make sense (such as data.fs) that the Unix-like behaviour (ie, unsafe ;-) isn't available to Python. Is anyone from DC listening? would you accept a patch to FileStorage for Windows that relied on an extension module? > -----Original Message----- > From: Chris Withers [mailto:chrisw@nipltd.com] > Sent: 28 June 2000 12:04 > To: tdickenson(a)geminidataloggers.com > Cc: addyd(a)unk.edu; zope(a)zope.org > Subject: Re: [Zope] Data.fs.lock? > > > Toby Dickenson wrote: > > It's definitely normal, and arguably a problem. > > > net stop zope > > copy c:/zope/var/data.fs c:/zope/var/backupdata.fs > > net start zope > > I'd say it's definitely a problem if you have to stop zope to do a > backup :( > > But then, I'd say it's a problem running (Zope on) Windows in a > production environment ;-) > > cheers, > > Chris >

1 0

DTML question
by Luke Tymowski 28 Jun '00

28 Jun '00

Hello, I want to retrieve the last 3 filenames from a subfolder and display them in a document. If I set the size of the retrieval to 1, I get just 1 name returned. If I set the size to 3, I get everything in the folder. (if I use 2 I also get everything in the subfolder ) Here is my code (using 2.2b2): <dtml-with Document> <dtml-in "objectValues(['DTML Document'])" size=3 sort=id> <dtml-var id> <dtml-var title><br> </dtml-in> </dtml-with> thanks, Luke

2 1

RE: [Zope] HTML Editors that recognize DTML (was bastardized form ofXML)
by Jon Franz 28 Jun '00

28 Jun '00

I dont have one off hand, I usually use the built in browser based editor. hrm. I'll setup one up over the weekend (I've done it in the past for asp and such, so its old hat for me) Does anyone know of a good (free!) java applet based text editor? Something with basic color tagging abilities and maybe even (gasp) a spell checker, search/replace, etc? If there is one, we could mod it to spit its output as a form post, and hus have a great built-in editor for most browsers... Also, its not XML compliant either, but I have a shorter dtml syntax patch available for download at: http://www.zope.org/Members/Coventry/dtml_shortcut it is a really small patch, and just allows <: to replace <dtml- or <!--# inside your documents, such as in the snippet below: <:var foo> <:if expr="la=lala"> So you think la and lala are the same!? <:else> Ah, so you see a diffrence! </:if> it just leads to less typing. Comming from the asp/php world (as of late, I also do C and Perl<G>), I got used to typing a lot less characters to switch from markup to scripting, and so figured I'd dive in and make this change... My 'wordfile.txt' for ultraedit will include this alternate syntax too. -----Original Message----- From: Eric L. Walstad [mailto:Eric@Walstads.net] Sent: Friday, June 23, 2000 6:14 PM To: Jon Franz Cc: zope(a)zope.org Subject: RE: [Zope] HTML Editors that recognize DTML (was bastardized form ofXML) Hi Jon, Regarding Ultra-edit32 // and the file 'wordlist.txt' it uses can be // edited easily to // add new tags or keywords, or to define whole new languages of tags and // keywords. Have you created a 'wordlist.txt' file that handles the DTML tags? If so, would you mind sharing it? Thanks, Eric.

4 3