- Zope-Dev - Zope lists

Have any ideas for aliasing meta type, role name, etc?
by LEE, Kwan Soo 08 Mar '99

08 Mar '99

Hi, Zopistas, I've been translating Zope frame work into Korean, as I told before and almost nobody showed interest. Now what I call KZope seems working, though many dtml files are to be translated still. Currently, KZope shows part Korean, part English screens. I guess the relative easy of translating Zope into another human language comes from that many key words of Zope frame work are stored as a value of dictionary(right?). BUT, there IS a Problem. What if one export/import Zope objects between EZope & KZope? It shows wired things. And I guess this comes from that object from EZope or KZope has different meta infos. One possible solution is much further dissociation of "Presentation" from "Logic". See the example below from OFS/Folder.py(don't worry of strange characters or boxes in <from KZope> column. That is (or was) Korean chars) <from EZope> <from KZope> class Folder(....): class Folder( ... ): """ ... ... """ meta_type='Folder' <-a-> meta_type='폴더' id ='folder' <-b-> id ='folder' title ='Folder object' <-c-> title ='폴더 객체' icon ='p_/folder' <-d-> icon ='p_/folder' meta_type and title strings appear on the screen. So I translate them. id will be a part of url, so I'd better not translate them. icon string is Zope frame work default. So I do not. I SEE a some lack of consistency here. Why should part of internal python code(meta_type) will appear on the user screen? Don't you think DTML part of Zope frame work should control what appears on the user screen? What, I guess, to be a solution is making meta_type, role, etc into a tuple which inclues a dictionay. i.e. meta_type=('Folder', {'default':'Folder', 'Korean':'폴더', 'German':'XXX', 'Czech':'YYY'}) __ac_roles__=( ('Manager', {'default':'Manager', 'Korean':'관리자', 'German':'xxx', 'Czech':'yyy'}), ('Anonymous', {...} ) ) Oh, yes, this is a HUGE & comples task and DC will not benefit from this in a near future. And I do not ask DC to do so. What I want is the suggestions from the more knowledgables. Could be there much more simple and elegant way? tuplizing meta infomation will punish the performance too much? Will the Zope frame work structure be altered to make this kinds approach impossible? Just think Globally. Dream of the soon-to-be-huge China market. Possible BENEFITS of 'tuplizing' meta infos will include safer route to upgrading individual Zope Products. LEE Kwan Soo. ps. If my English expressions are offensive, that's not my intention but the showcase of how hard to use English.

2 1

External Methods and adding users
by Shaw, Howard 07 Mar '99

07 Mar '99

I wrote a quickie External Method that is called when I add an individual to a database. It proceeds to create a directory for the individual, add a UserFolder, add a user to the UserFolder. However, it attempts to set the user's password to the user's id, and for some reason, this fails to work. I don't know how to see what password it did set... When I call _AddUser, or whatever that function is, _doAddUser, I think maybe, am I supposed to pass an already encrypted password? When I open the user in the management folder and type the password in manually, it works perfectly. Please help. Howard Clinton Shaw III Howard Clinton Shaw III

1 0

a possible neat hook into Zope's object DB...
by Anthony Baxter 07 Mar '99

07 Mar '99

Have a look at http://www.inf.bme.hu/~mszeredi/avfs/ - it's a (linux-only) library that gets preloaded before an executable, and allows you to access a 'virtual file system'. The examples that are shipped are looking inside various archive formats - tar.gz, that sort of thing, but it's possible something similar could be useful to access Zope's object DB... Anthony

1 0

Re: [Zope-dev] Features / Demos want
by Dave G 07 Mar '99

07 Mar '99

>Christopher Petrilli wrote: >> On Sun, Mar 07, 1999 at 08:51:18AM +0800, Kent Sin wrote: > >> >> > 13. Multi-linguage management: use browser's lang perference to select >> > language sent out, with auto menu generate in that lang and change lang >> > menu auto gen. When a page is modified, list all pages need to modify in >> > other languages. (some what like fontpage's task list?). >> >> This would be neat, but... this is a HUGE HUGE HUGE HUGE task, and I've >> never found a web site that does it "automatically", only thru selecting >> seperate menu itenms. Make sense? > >Actually, Chris, I think the Debian Linux home page at www.debian.org does >do auto language selection. I've never experienced it myself (being one >of those nearly-mono-lingual Americans everyone like to trash) but I've >heard it is automatic. > >Couldn't resist - set Netscape to prefer German (de), force-reloaded >www.debian.org, and lo and behold, there's a bunch of unreadable Deutch >on my screen! (well unreadable to _me_;-) > >Ross > That could be done through ZServer, most Mac Webservers (Web* and QPQ come to mind) can set a preference to auto redirect for language specific sites. The webmaster has to setup seperate root folders for each domain and language, then the webserver uses the correct root folder based on the browsers language preferance. This would be relatively easy if (when ?) ZServer supported Vhosting. DAve. > >> >> Chris "On the Plains of Hesitation bleach the bones of countless millions who, at the Dawn of Victory, sat down to wait, and waiting -- died"

1 0

Is DocumentTemplate thread-safe?
by skip＠mojam.com 06 Mar '99

06 Mar '99

Can multiple threads call a DocumentTemplate instance simultaneously, or do I need to lock it? Thx, Skip Montanaro | Mojam: "Uniting the World of Music" http://www.mojam.com/ skip(a)mojam.com | Musi-Cal: http://www.musi-cal.com/ 518-372-5583

1 0

Will ZServer help me in this scenario?
by skip＠mojam.com 06 Mar '99

06 Mar '99

Glad to see this list has been created. I am currently using ZopeHTTPServer in the following architecture: Apache <-----> ZopeHTTPServer <-----> Musi-Cal DB HTTP XML-RPC Some requests from the net (searches) require a full round-trip to the database. Other things, like displaying an otherwise static DTML page, don't. The problem is that the ZopeHTTPServer is single-threaded at the moment, so if a search takes a long time (say, a couple seconds), simple stuff like calling a DTML template (which might execute in a tenth of a second), block. This, of course, causes Apache to get its britches in a twist and lots of its child processes start to pile up, memory gets short, yadda, yadda, yadda. I've had some trouble with deadlocks when trying to run ZHS multi-threaded (probably missed some object that needed to be locked). Will running ZServer with its asyncore/asynchat modules help alleviate this problem? Will I need to make changes to Fredrik Lundh's XML-RPC code to make this work? (XML-RPC is a given at this point. We're calling Musi-Cal's database from both Python and Perl at this point and it works great.) How stable is the ZServer alpha release? If it's mostly the FTP and PCGI support that is still experimental, I can live with that since I don't use either one. Thanks, Skip Montanaro | Mojam: "Uniting the World of Music" http://www.mojam.com/ skip(a)mojam.com | Musi-Cal: http://www.musi-cal.com/ 518-372-5583

2 1

TESTING TOOL & A ZOPE TEST
by Theodore Patrick 06 Mar '99

06 Mar '99

HEY DEV-ZOPE, I gather several of you out there know about this but for those who don't: <I AM A DEVELOPER & HAVE NOTHING TO DO WITH THIS PRODUCT - NO FLAMES PLEASE> We have been using this product for the last week and it has made a tremendous difference in the quality of the software we are developing with ZOPE and other web tools. As I though about it, many out there would benefit knowing about this tool, as I didn't until recently. </I AM A DEVELOPER & HAVE NOTHING TO DO WITH THIS PRODUCT - NO FLAMES PLEASE> WEB HAMMER 2.1 - Product Review It simulates web requests, LOTS OF THEM. You can configure it to do the following: Flood any URL with 40 Simultaneous connections(Get,Post,Head Requests) One Page of Settings - Easy to Use. - See attached File. **BE CAREFUL YOUR SYSTEM ADMINISTRATOR WILL FREAK OUT!!!!!** If you want to know when your server will crash, this will find that limit. We started using the application on several PERL and ZOPE apps in the office and we immediately found out where our apps were weak. In one case, one code change gave us 5X scalability on a simple script, we would have never known without the tool. We are also using it to test our form collection scripts and the database behind. Since you can do a POST we were validating middlewear and Database entries in no time, It is easy to check for errors with 1-2 Post try 40,000 --> You will find bugs. Try simulating 40,000 form submissions in 20 minutes and see where your database and server are. First time we ran the app it smoked everything (WebServer+Middlewear+Database(Oracle 8.0.5)). Nothing but Ashes!!! After some minor code changes we were handling the load fine. It costs some $85.00, but it lets you sleep at night knowing your system won't break, under the most strange & serious circumstances. Or it will tell you when you need to switch to bigger iron. You can get it at http://www.serverobjects.com/products.htm#WebHammer <http://www.serverobjects.com/products.htm#WebHammer> There is an evaluation copy that supports 2 threads per second, so you can try it for free. We have configured 2 Win boxes to simulate the loading on our servers. Each one does nothing but load test. If you are putting your reputation on the line, test to find you code's limits before your client does. It is $85 of insurance we would pay over and over. <ZOPE> We ran this tool against the Zope Server on some complex scripts, because of ZOPE's caching ability after the first couple of hits the server screamed! In our testing after ZOPE rendered the first page everything else seemed to come out of the cache. Zope also would thrash if the object: A. was not cached B. was a unique request C. involved a database connection. <INDIGO THRASH TEST> Thrash v. To cause a server to use memory and resources violently. If your system monitor goes 100%,2%,100%,15%,100% quickly you are Thrashing. As this is very OS dependent and very very code dependent. Server Hardware = Dell 410 DUAL P400 Raid0 2-9gb + 512RAM (PLENTY OF ZIP) TEST is similar code on identical Hardware 1. Linux-ZApache-ZOPE = "Min Thrash - No Death" --> It is very difficult to Kill. We ran 80 Threads across the box and killed the database but the middlewear and web server were still waiting for more requests. Quite a show for Linux/ZAP/ZOPE. Easy to code. 2. Linux-Apache-MODPERL = "Min Thrash - No Death" --> It is very very difficult to Kill. We ran 95 Threads across the box and killed the database but the middlewear and web server were still waiting for more requests. Quite a show for Linux/APACHE/MODPERL. Hard to code-requires experience. 3. NT-IIS-PERL= "MAX Thrash & Death" --> 40 Threads over 10 Minutes = IIS DEATH There is what looks to be a memory leak in IIS that causes a strange response in IIS4 sp3. It is similar to the server vomiting on itself. The memory requirement grows and then peaks and goes back to 10%, weird. We are working on tuning and some other strategies. This is really an IIS/NT problem it doesn't handle threads anywhere close to Linux/Apache. 4. NT-IIS-ZOPE= "MED Thrash & Death" --> 40 Threads over 20 Minutes = IIS DEATH SAME As PERL - There is what looks to be a memory leak in IIS that causes a strange response in IIS4 sp3. It is similar to the server vomiting on itself. The memory requirement grows and then peaks and goes back to 10%, weird. We are working on tuning and some other strategies. This is really an IIS/NT problem it doesn't handle threads anywhere close to Linux/Apache. We are working on Tuning IIS4 --> See http://www.microsoft.com/backstage/whitepaper.htm <http://www.microsoft.com/backstage/whitepaper.htm> ------------------------------------------------------------ </INDIGO THRASH TEST> <?>Is there a way to preload ZOPE's cache? Just a thought.</?> We also tested input from forms into a database from ZOPE, Although our results are specific to our implementation, typically the bottleneck is opening and closing the database connections. It caused allot of thrashing on both sides(middlewear & database). <DigCre>Hint, Hint ---> Any word on Aqueduct Integration for Zope?</DigCre> Overall the ZOPE process was as fast as any we have seen, ColdFusion and other middlewear packages. Considering the time we saved coding & configuration, Zope is worth its weight in gold. Zope also scales very well on very complex queries. <ZTABLES> Input from forms to ZTABLES is 40X-50X Faster(Tested!)than dealing with database connections. We are collecting the data into ZTABLES and then replicating it into Oracle during the wee hours. The design is faster than anything out there. ADD indexing or searching -->ZTABLES(Period!) Searching a database live in Zope takes a hit(!!!potentially every request is unique!!! = No Caching), but moving the data into the ZTABLES first makes the server sing. It is a performance boost that you have to see to believe. Why don't you guys charge for ZTABLES & AQUADUCT as components? I would not mind paying for it as I gather everyone else wouldn't. Considering the advantages are HUGE!!! </ZTABLES> </ZOPE> Just thought you ought to know! Theodore E. Patrick email: tpatrick(a)indigonetworks.com <mailto:tpatrick@indigonetworks.com> phone: 615-777-0070 ext.125 Indigo Networks - The Ultimate Choice In Who Sees You. http://www.indigonetworks.com <http://www.indigonetworks.com>

1 0

SQL methods q:
by Jordan B. Baker 05 Mar '99

05 Mar '99

Hi guys: I'm trying to write a SQL method though, and its giving me an error when I try to test it.. Error, exceptions.TypeError: keyword parameter redefined SQL used: Could not render the query template! The query I was using: SELECT searches.engineID as engine, queries.param as query, MAX(searches.timestamp) AS time, searches.position AS position, MIN(lastsearch.timestamp) AS lastupdate, lastsearch.position AS lastsearch, searches.URL as URL, 'NA' as change, engines.graphic as engine_gfx FROM searches LEFT JOIN searches as lastsearch USING (queryID,engineID), engines, queries WHERE lastsearch.timestamp BETWEEN  AND  AND searches.timestamp BETWEEN  AND  AND queries.clientID =  AND queries.queryID = searches.queryID AND engines.engineID = searches.engineID AND searches.timestamp != lastsearch.timestamp GROUP BY searches.engineID, searches.queryID ORDER BY searches.engineID ASC, searches.queryID ASC, searches.timestamp ASC, lastsearch.timestamp DESC ; Any ideas what I could be doing wrong? BTW, Zope is great! I've been kinda messing around with it for a while, also checking out PHP3 and other UNIX-based scripting languages and I've very impressed. TIA, -jordan.

1 0

Re: [Zope-dev] simple array-ish things in SQL/Zope
by Jeffrey P Shell 05 Mar '99

05 Mar '99

>From: Jeff Bauer <jbauer(a)rubic.com> > I do something similar with large text fields. Rather than > use PostgreSQL's unique (non-portable) array system, I store > collections of primitives as strings and use eval() when reading > the fields. > > >>> aList = [1, 'a', 2.5] > >>> field_value = repr(aList) > ... perform some database insert operation > ... read the field back in > >>> aList = eval(field_value) > > This works well for lists and dictionaries that contain other > lists, dictionaries, and primitive data types. It provides a > possible alternative to storing object data when you're > required to use a relational database system. Running eval on any external data source can be potentially risky. An option is to write pickles to the RDBMS. This allows storage of much more complex objects and it's harder for a third party with access to the database to write a potentially damaging pickle to a field than it is to write a potentially damaging expression. The downside is that storing a string repr of a python list or dict is still semi-searchable/readable through SQL for other operations. A stored pickle is not. >> [Julian>>] >> I am using PostgreSQL's array system for a "categories" field >> in a database, it return records in a format like: >> '{"foo"}' >> '{"foo","bar"}' >> '{"foo"}' >> >> I am trying to extract the list of unique categories - in >> this example: ["foo","bar"] >> >> This would be a complete nuisance to do in DTML. I have decided >> to read the SQL method's results into an external method and edit >> them there - but first I need to know how to call a SQL method >> without the "in" DTML tag. Do you have to store it in an array? If you can store the data in the categories field in some sort of delimited list (like comma delimited), you can use something like::  <H3></H3> <H4>Categories:</H4> <UL>  <LI></LI>  </UL> <HR NOSHADE>  Conversely, if you had a user enter data in a form with checkboxes or a SELECT list to choose categories, assuming that you use the Zope ":list" type on the input form, you can do the following in an SQL method:: INSERT INTO something (title, categories) VALUES ( , '' ) Another (and slightly better) way to do it would be to run the string.join command in the DTML Method/Document that calls the SQL method that does the insertion and pass it in as an argument. Modify the previous SQL code to look like the following:: INSERT INTO something (title, categories) VALUES ( ,  ) And use the following DTML to insert the data that came in from the form::  In essence, this is how I've used UserDB in some consulting projects that allowed the customer to add/edit users in the system. The column being used for the users roles is a comma delimited field, and the interface presented uses checkboxes to select which roles the user has. The roles are joined using the above, or split. An extra benefit of using this is that I can use regular SQL expressions to, say, list all of the users with role "Admin" by using SQL like the following: SELECT * FROM users WHERE user_roles LIKE '%%' There's a myriad of ways of approaching this situation. I'm no mega-SQL guru, but the above approach has worked fine for me in situations where I have a simple list of objects to store/retrieve from SQL. .jPS | jeffrey(a)digicool.com zope, through the web. www.zope.org

2 1

Re: [Zope] Using Zope with CORBA (new user question)
by Ross J. Reedstrom 05 Mar '99

05 Mar '99

Jeffrey P Shell wrote: > Crossing over from the Zope mailing list to zope-dev: > >>>>>> "Paul" == Paul Everitt <Paul(a)digicool.com> writes: > > > > Would it be worthwhile to start looking at and hacking ZServer? > > Yes. ZServer really restores Zope's original intent from the Bobo days: > publishing objects through a variety of protocols. I think ILU support was > once attempted back in those days. However, a Bobo app at that time could > only have one publishing mechanism (ie, CGI, PCGI, FastCGI, ILU, etc...). > ZServer allows for multiple publishing mechanisms in the same application, > allowing access to the objects through the web, through FTP, or through any > other protocol developed for ZServer/Medusa. > Hmm, I've been musing a bit about a zopefs module for linux. I couldn't code it, but I'm the Advisor for the (newly formed) Rice Linux Users Group, and some of those kids are very bright... Would Zserver be the place to start looking to hack something like that together? Or perhaps the ZClient thing I've seen mentioned... There was once something called userfs under linux, that allowed essentially arbitrary implementations of file system drivers in user space. One example that came with it was an ftpfs, so that, combined with Zserver's ftp support, gets us there. However, a cleaner implementation not involving FTP would be nice. Only problem - as far as I remember, userfs hasn't been updated since linux kernel 1.0 something (I think 1.2 broke it) Ross, (wanting to use all those crazy unix commands, like find/awk/sed/grep on his bobobase!) -- Ross J. Reedstrom, Ph.D., <reedstrm(a)rice.edu> NSBRI Research Scientist/Programmer Computer and Information Technology Institute Rice University, 6100 S. Main St., Houston, TX 77005

1 0