- Zope - Zope lists

Re: [Zope] Re: Access Rules
by Dennis Allison 19 Sep '02

19 Sep '02

"Chris McDonough" <chrism(a)zope.com> replied: > > The first problem you have is that you're trying to compute the time > differences between page switches in realtime. Don't do that. Log > the simple stuff first and postprocess it to get the more > complicated stuff. > > Furthermore, I think the second problem you have is one of > filtering. There are some URL accesses that you don't care about > (like accesses to the "chrome" and images that make up the UI) and > that's OK. Just give the objects that you *do* care about a "file > extension" something like "_html". So each thing you want to render > in ZZZZ, call it "page1_html", "page2_html", etc. Log every page > access using a URL. Then filter the log based on your file > extension before postprocessing. > Yes, I'd thought about using the Z2.log file, but decided it would be easier to do it in the guts of Zope becasue I could programatically resolve ambiguities when they arise. Looks like I may need to back off from that position. It is true that the Z2.log is adequate most of the time although there are instances where I cannot detemine whether a logged GET is a page closing event or not. Processing the Z2.log file would have to be done in pseudo real-time since the usage report is supposed to be available as a snapshot on demand. The naming conventions pretty much match the ones you suggest. Thanks. I give the Z2.log a go.

2 1

Re: [Zope] freezope users
by eric.n.dunn＠bankofamerica.com 19 Sep '02

19 Sep '02

DO you pay or is your mailhost free? complaw(a)hal-pc.org on 09/19/2002 02:01:32 PM To: Eric N. Dunn/USA/BAC@BankofAmerica cc: Subject: Re: [Zope] freezope users > > > Does anyone use freezope.org and config. the mailhost to use the > polarhome.com mailhost? I use freezope, and configure mailhost, but not to polarhome.com. Is there a particular problem? Some e-mail servers won't relay messages that come from a domain other than their own. Ron

2 1

RE: [Zope] Changing REQUEST in a javascript
by Passin,Thomas B. (Tom) 19 Sep '02

19 Sep '02

[ Dag Nygren] > > > Another method is to have Zope put all of the potential > choices in the > > second > > select box into the Javascript code that gets sent to the > client. You could > > use an associative array to do this. Then populate the > second select box with > > the items in that key of the Javascript associative array. > This method works > > good only when the total number of items is relatively > small in both selects > > and doesn't change very often. > > This is probably not a good idea in my case as I in the final > page will have 5 SELECTS with 4-10 alternatives that are > dependant on each other. The total number of permutations is too high. > Do not be too quick to discard the option. You can probably write a Zope page or script that would generate the alternatives automatically, and the number of Javascript objects would be low enough so that performance would be very good. You should read up on how to create arbitrary Javascript objects using function(), because it lets you do some very neat things quite easily. I have created several pages where the page contains data, and javascript populates several select lists after the page has loaded. One thing to know if you plan to change the contents of a select list after the page has loaded. Netscape 4xx browsers cannot change the page layout once the page has loaded. Therefore you have to make sure that your select boxes are wide enough when the page first loads. One way to do that is to give them a dummy option, such as <option>------------------------------------- You can replace that option when you reload them later. Later browsers (e.g., IE5+ and Mozilla) can resize the select boxes and you do not have to do this hack. Cheers, Tom P

1 0

Re: [Zope] Re: Access Rules
by Dennis Allison 19 Sep '02

19 Sep '02

"Chris McDonough" <chrism(a)zope.com> wrote: > How do you define a "page"? I consider a "page" the thing rendered > when a user visits a URL. Since access rules trigger on any URL > visitation, this means you can write a log of "pages" visited via an > access rule. But it seems you are defining "page" in a different > way; what defines a "page" to you? > > Do you want to track all calls to other Zope objects inside a Zope > object? This is very difficult and probably not worth it. The logs > generated would be huge and would have pointless amounts of detail, > most of which you probably wouldn't care about. > Good point--I may have simplified the problem too much. Users see a rendered screen created by rendering a number of Zope and HTML objects. LLL HHHHHHHHH aaa bbbbbbbbb nnn ZZZZZZZZZ <= user screen nnn ZZZZZZZZZ nnn ZZZZZZZZZ The space indicated by the Z's is the one of interest. It's the user's workspace and most content is displayed there. It's usually a single Zope object (with possible sub objects) or a HTML page served from the local file system. The screen itself is implemented using frames not tables. Naviation happens through a variety of different mechanism including client-side JavaScript to move from one content frame to another. Suppose I have three objects, A, B, and C each of which can be displayed in the Z area. However it happens via the naviagation, I want to log the time Z displays objects A, B, and C-- sally A t0 t1 sally B t1 t2 sally C t2 t3 sally A t3 t4 and so forth where t0... are times and the navigation moves amongst the various objects with no intermediate steps. I am only interested in tracking the root object of each of the various possible displayable pages. Had the Site Access approach done the job, I was expecting to filter out much of the information early to keep the size of the log file within bounds and to minimize overheads as much as possible. One approach would be to insert a bit of DTML or python script to do the logging, but there are lots of pages and most are static. I suppose I could make a wrapper for them which does the logging--but I think that's the wrong place to do it. I'm hoping there's a hook which does pretty much the same thing... BTW, I think it is necessary to track calls to other Zope objects at some level. Using the example above, when object A gets rendered you get a 'user sally sees object A at time t0' event. Later another object gets rendered (in the example, object B) which generates two events: 'user sally no longer sees object A at time t1' and 'user sally sees object B at time t1'. The logging process is complicated because rendering object A may reference sub-objects (including object B, say) and may reference objects that are not part of the set of objects being logged. The latter case closes has to be handled to determine the user is no longer viewing to currently open object.

2 1

Re: [Zope] Changing REQUEST in a javascript
by Dag Nygren 19 Sep '02

19 Sep '02

Firstly thankyou very much for the thorough listing of the alternatives. This should be in a FAQ somewhere. > There are a few solutions to the one select populates another problem: > > One is to have the first select trigger a form post to Zope, which returns the > same page with new data in the second select box cooresponding to the > selection. This is the easiest to get to work cross-browser and could even > work with Javascript turned off. This is what I have now > Another method is to have Zope put all of the potential choices in the second > select box into the Javascript code that gets sent to the client. You could > use an associative array to do this. Then populate the second select box with > the items in that key of the Javascript associative array. This method works > good only when the total number of items is relatively small in both selects > and doesn't change very often. This is probably not a good idea in my case as I in the final page will have 5 SELECTS with 4-10 alternatives that are dependant on each other. The total number of permutations is too high. > A third method would be to use the Virtual Cowboys Javascript XML-RPC library > to query the server "out of bound" from the client when a selection in the > first box was made. The query would ask Zope for the items to put in the > second select dynamically. This would work well for any number of select > items, and always be up to date. It would only work on recent IE and Mozilla > browsers though, because it requires DOM level 3 support. This is an interesting idea even if I don't like limiting the types of browsers that works with it, too many of those out there. > Another method similar to 3, but not requiring anything more than Javascript > 1.2(?) support and frames is to use a frameset with an invisible frame that > you can refresh from the visible frame. The invisible frame would be used to > send requests to Zope and receive the Javascript code necessary to populate > the second list box. This would prbably be most "Zope":ish and sounds quite neat in the sense that you could make a nice object out of the list-boxes making all very modular. Strange that there isn't a Zope Product already for this.. Not very much use for Formulator in this though (?) Have to make myself familiar with frames again, and fresh up my javascript knowledge > Which method I chose depends on a few factors: > > How many items will be in each select list > How comfortable are you with client-side vs. server-side programming > What browsers you must support > How dependant you want your application to be on Javascript A very big thankyou again Dag

1 0

Re: [Zope] Major problems with slow catalog querie
by Lea Smith 19 Sep '02

19 Sep '02

The catalog search times mentioned below are the time the query is with the catalog called from a python script like... context.do_nothing_script() results = context.portal_catalog( search_dict ) context.do_nothing_script() The 'do_nothing_script' does just that, but it shows me exactly the time the catalog takes using the CallProfiler Product. The 'search_dict' is a dictionary of the search queries for the catalog indexes as I found this improved the catalog speed a little, rather than passing the whole REQUESt dict. (This is being run on a P111 900Mhz with win2000, Zope 2.5.1, Python 2.1.3) >If you can isolate a case where searching the catalog alone (with no >other >operations being performed) takes minutes I would like a chance to >analyse >it closer. I am digging around my code at the moment trying to find problems I have created myself :-). I have discovered a few errors and this has helped with the speed. I have have two search forms: 1. Basic search which searches on: 'SearchableText' (textindex), 'Subject' (keywordindex), 'Type' (keywordindex), 'sort_on', and 'sort_order' I have managed to improve the catalog search to around 0.5 to 1 second. The 'sort_on' parameter seems to chew up most of this time. Is there any way to improve the 'sort_on' speed? 2. Advanced search which can search on one or more of the following; 'SearchableText' (textindex), 'Subject' (keywordindex), 'Type' (keywordindex), 'type' (keywordindex), 'modified' (fieldindex {passing 'query':'blah' and 'range':'min' in a dict} ), 'item_size' (fieldindex), 'value' (fieldindex {passing 'query':['q_min','q_max'] and 'range':'minmax' in dict} ), 'Creator' (fieldindex), 'state' (fieldindex), 'country' (fieldindex), 'sort_on', and 'sort_order'. I have noticed that the 'modified' parameter causes a huge hit on the catalogs performance. Is this normal? Are there things I can do to improve it? Passing the following to the portal_catalog causes the catalog to take around 35-45 seconds on average (These queries return 400 results from the 10,500 items cataloged)... {'modified': {'range': 'min', 'query': DateTime('1995/01/01')}, 'Type': ['Classified'], 'sort_on': 'modified', 'review_state': 'published', 'sort_order': 'reverse'} Taking out the 'modified' key and passing the following reduces the catalog search time to approx 0.5 to 1 second on average... {'Type': ['Classified'], 'sort_on': 'modified', 'review_state': 'published', 'sort_order': 'reverse'} The catalog returns results within 0.5 to 1 second with any combination of the indexes searched on as listed for the advanced search above. But as soon as the modified query is put into the search_dict it all goes out the window. I had experimented with creating an index which cataloged the modified date as a floating point number. Searching on the floating point number (modified date) made no difference to the search speed. As I wrote this I thought whether cataloging the date as an interger would be any different. Searching the modified date as an interger has reduced the search time from average of 35-45 seconds down to 1.5 - 5 seconds. Still not as fast as I would like, but a whole lot better. Does this suggest I have a problem with zope or the cmf? I have run out of ideas to improve it further. >Some questions for you first: >How many objects are in your catalog, 11,000? At this stage there is around 10,500 objects. These are stored in 8 'Portal Folder' folders in a generic member account. One of these folders holds approx 5600 of these items, could this be causing a problem for the catalog? Future content will be created by individual members in the cmf. The generic account won't have more content added to it. Content will more than likely be slowly deleted or moved from this generic account to another member account for someone to take over. The objects are instances of Products which inherit from either Skinned_Folder or Link from the CMFDefault. And all objects inherit DefaultDublinCoreImpl from CMFDefault. >How many indexes are you searching simultaneously? >What kinds of indexes are these? >Do the searches involve globbing? (* and ? wildcards for text >searches). The Vocabulary in use is the default 'ZopeSplitter' with globbing enabled. I haven't got as far as testing search speeds with wildcards as yet. >Globbing searches can be achingly slow using TextIndex/Vocabulary (The >vocabulary is at fault). ZCTextIndex seems to perform much better in >this >regard. Any help you can give or where I can find examples/information on performance of similar zope/cmf sites as a comparison of what I should be able to squeeze out of zope would be a great help. Thanks for your time, it is very much appreciated. Richard __________________________________________________ Do You Yahoo!? Everything you'll ever need on one web page from News and Sport to Email and Music Charts http://uk.my.yahoo.com

2 1

Import errors on an absent Product
by Jean Jordaan 19 Sep '02

19 Sep '02

Hi all We have this Zope app, OK? For a requirement quite unrelated to this app, we added a Product that we wrote, ArticleManager, consisting of a part on the filesystem and some ZClasses. Our client had some issues with the first app, so we brought their Data.fs over to our side. Our setup here doesn't include ArticleManager, as it is irrelevant to this app. We deleted the references to ArticleManager in the Control_Panel, but now, unpredictably, we get an import error on ArticleManager raised from Connection.py's setstate method. Huh? Nothing in our app is referencing ArticleManager, and as far as we know, we've deleted the references to it from the ZODB. Does this look recognizable to anyone? -- Jean Jordaan Upfront Systems http://www.upfrontsystems.co.za

3 2

hidding acl_users folder
by markus 19 Sep '02

19 Sep '02

is there a way to hide the acl_users folder in ZMI for special users? thanks, markus

2 1

Xron not compatible with Zope 2.5.1?
by VanL 19 Sep '02

19 Sep '02

Hello, I installed the Xron product, and I can't seem to use it with Zope 2.5.1. Whenever I try to view a Xron DTML method, I get the following: Site Error An error was encountered while publishing this resource. Debugging Notice Zope has encountered a problem publishing your object. The object at http://mig:8080/team/vanl/test has an empty or missing docstring. Objects must have a docstring to be published. Has anyone seen this before? Is there something that has superceded Xron that is currently maintained? Thanks, VanL ------------------------------------------------------------------------

2 1

Re: newbies question on ZODB
by Paul Tiemann 19 Sep '02

19 Sep '02

>I need to allow users to store large amounts of files (PDF, doc) in a >database (or directory), with several information linked to the file >(author, title, description ...). Then Index the content of the files >to be able to search. It sounds like you'll want to take a look at Casey Duncan's DocumentLibrary product: http://sourceforge.net/projects/nlada-library/ >Would it be advisable to use the ZODB to store these files (say more >than 5.000 files or +/- 1 GB) ? How would you link the additional >information to the file and catalog the whole file content ? With the DocumentLibrary now you have both options. The default is to store documents in the ZODB, but there is a patch (by Robin Farine) which lets you store them on the filesystem outside of the ZODB. My personal preference is to keep my ZODB smaller, so I'd store the documents on the filesystem, but that's just my opinion, and others might disagree... ;) Paul

1 0