November 2002 - Zope

error-handling product?
by Dylan Reinhardt 15 Nov '02

15 Nov '02

Hi all, So I'm in the habit of configuring standard_error_message to kick out an e-mail under certain error conditions. That usually works fine, except now I've got a site that -- for reasons not worth going in to -- creates hundreds of errors per day because there's one feature that actually depends on *not finding* an image file. Suffice it to say that wasn't my first choice of how to design it. Be that as it may, I don't want to suppress reporting of "not found" errors, just those that follow a particular pattern... and that takes me at least a couple steps beyond what DTML should be asked to do. I'm thinking of writing an error-handling product, but since errors are such a basic fact of life, I'd be surprised if something didn't already exist. A Google search on zope, error and product turns up nothing of interest, of course... the words are used together far too commonly. Does anyone know if such a thing already exists? If so, would you be so kind as to point me to it? TIA, Dylan

2 1

Reclaim the Stupid Logfile Traceback Format!
by Johan Carlsson [EasyPublisher] 15 Nov '02

15 Nov '02

Hi, In Zope 2.6 there is a new Site Error Log object and the traceback has been modified to not include the full path of modules, but only paths relatice from the lib/python. This is sensible when working TTW. But why on earth does the Stupid Log File use the same traceback format. I use Textpad for Windows as my primary Zope debug tool and it I have configured it to parse the Stupid Log File, making all file references hyper links. This stops working with the new traceback format. So is there an easy way (or even standard way) to reset the traceback format for the Stupid Log File? Best Regards, Johan Carlsson -- Torped Strategi och Kommunikation AB Johan Carlsson johanc(a)easypublisher.com Mail: Birkagatan 9 SE-113 36 Stockholm Sweden Visit: Västmannagatan 67, Stockholm, Sweden Phone +46-(0)8-32 31 23 Fax +46-(0)8-32 31 83 Mobil +46-(0)70-558 25 24 http://www.easypublisher.com http://www.torped.se

2 1

Re: Folder Property problem
by Maik Jablonski 15 Nov '02

15 Nov '02

Roel Van den Bergh wrote: > Apparantly this Property is inherited by all subfolders. change <dtml-if gebouwcode> to <dtml-if "hasProperty('gebouwcode')"> -mj -- Maik Jablonski __o www.zfl.uni-bielefeld.de _ \<_ Deutsche Zope User Group Bielefeld, Germany (_)/(_) www.dzug.org

1 0

ZopeTime breakage since CDT became CST
by Tim Wilson 15 Nov '02

15 Nov '02

Hi everyone, I posted on this topic a week or so ago, but I've since found another example of the problem. This is such a simple thing that I'm wondering if there's something broken in Zope. Here's what happens: I post our school's daily lunch menus on our site. The menus are retrieved from the ZCatalog and each menu has a date attribute that gives that date for that menu. What is supposed to happen is that the current day's menu gets displayed until 12:35 p.m. (the end of the lunch period) and then switches to the next menu after that. This worked perfectly until the recent time change. Here's the PythonScript that retrieves the menu: """ Retrieve the next lunch menu from the Catalog """ currentTime = context.ZopeTime() if currentTime > context.ZopeTime().earliestTime() + 12.583/24: tomorrow_earliest = context.ZopeTime().earliestTime() + 1 else: tomorrow_earliest = context.ZopeTime().earliestTime() next_week_latest = context.ZopeTime().latestTime() + 7 return context.nutrition.menus.Catalog( {'school' : 'Henry Sibley High School', 'menu_date' : [tomorrow_earliest, next_week_latest], 'menu_date_usage' : 'range:min:max', } ) Doing <dtml-var ZopeTime() fmt="pCommon"> gives the correct time. Currently, the menus switch at 1:35 p.m. Anyone have an idea what to do? Is there a problem with the earliestTime() method perhaps? -Tim -- Tim Wilson | Visit Sibley online: | Check out: Henry Sibley HS | http://www.isd197.org | http://www.zope.com W. St. Paul, MN | | http://slashdot.org wilson(a)visi.com | <dtml-var pithy_quote> | http://linux.com

3 2

RE: [Zope] Data.fs falls into 33GB hole
by sean.upton＠uniontrib.com 15 Nov '02

15 Nov '02

Hmm... I heard somewhere that packing a filestorage used memory proportional to the storage size. I would consider posting to the ZODB-dev list, perhaps for some more pointers on how to get out of this? Sean -----Original Message----- From: Tino Wildenhain [mailto:tino@wildenhain.de] Sent: Thursday, November 14, 2002 5:15 PM To: Howard Hansen; zope(a)zope.org Subject: Re: [Zope] Data.fs falls into 33GB hole Hi Howard, why fsrecover? Your Data.fs is big but should not be corrupt. I would even suspect if you simply pack it, it should go to around 360-400MB again. Zope packs by renaming it and then copys the most recent objects over. So you only need the space for actual Data.fs + Data.fs after packing. Your last backup was at 360MB, so the packet Version schould be at this level. Since you have a backup on your Windows box, you dont have to worry, I'd say. HTH Tino Wildenhain --On Donnerstag, 14. November 2002 13:36 -0800 Howard Hansen <howardahansen(a)yahoo.com> wrote: > I have several, fairly-large sites running on my > machine and at the last backup, my Data.fs file stood > at 340MB. Zope itself only took up 50MB of RAM, so I > didn't worry about the size of the file. Disk space > is essentially infinite nowadays, right? > > Yes, but imagine my shock when I checked out why my > backup routine took a long time and then failed. I > found that Data.fs took up 33GB of space on the disk! > Yikes! > > I must step back for a moment and salute everyone who > made this possible. Everyone at Zope, Linus, Guido, > Maxtor, AMD, Intel, and the manufacturers of all of > the little components who have conspired to make a > sticky mess like this possible. > > My Data.fs file grew to 33GB and I DIDN'T NOTICE. > > Looking over the Undo lists, I found hundreds of > transactions that said simply "by Zope". Some > experimentation led me to discover that these were > inserted by JRedirector. It summarizes redirections, > and my assumption that it did it under the Undo radar > proved incorrect. I've since disabled JRedirector. > > Running df on my disk, I find that I've filled 74% of > the 55GB data partition, so there's no chance of > making a copy locally and figuring it out from there. > Serendipidously, I did have a 60GB drive literally > sitting on the shelf. I popped it into my Windows PC > (I'd been able to get fsrecover.py to run on it, but > not on the Linux box) started copying over the network > This took a couple of hours. I tried to run > fsrecover on the big file and it failed immediately: > >> python.exe fsrecover.py -v 2 -P 184000 j:\Data.fs > j:\Data_recovered_all.fs > Recovering j:\Data.fs into j:\Data_recovered_all.fs > Traceback (most recent call last): > File "fsrecover.py", line 328, in ? > if __name__=='__main__': recover() > File "fsrecover.py", line 221, in recover > seek(0,2) > IOError: [Errno 22] Invalid argument > > I guess there are indeed some limits. I wrote a > quick program to make a copy of the first > 1,000,000,000 bytes of the file. I ran fsrecover on > that without problems. This tells me that the file > itself is OK. It just needs to be packed or filtered. > > I've got thousands of good transactions interspersed > with tens of thousands of noise transactions. > > Questions: > > 1) Can I safely pack a database this huge on my live > machine? > 2) If that doesn't work, can I easily figure out > transaction boundaries? If so, I could either chop > the big file up into smaller chunks and serially > attach new tails to the file, then fsrecover the whole > thing. > 3) If I can figure out transaction boundaries, can I > filter out transactions by type? I've got > approximately 32GB of JRedirector transactions that > I'd be happy to remove. > > As always, thanks for listening and I eagerly await > your wisdom. > > > Howard Hansen > http://howardsmusings.com > > > __________________________________________________ > Do you Yahoo!? > Yahoo! Web Hosting - Let the expert host your site > http://webhosting.yahoo.com > > _______________________________________________ > Zope maillist - Zope(a)zope.org > http://lists.zope.org/mailman/listinfo/zope > ** No cross posts or HTML encoding! ** > (Related lists - > http://lists.zope.org/mailman/listinfo/zope-announce > http://lists.zope.org/mailman/listinfo/zope-dev ) _______________________________________________ Zope maillist - Zope(a)zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )

4 3

Folder Property problem
by Roel Van den Bergh 15 Nov '02

15 Nov '02

Hi all, For my lazy users I'm trying to add a property to some folders and display it. At some point in the folder hiearchy I want to display a number linked to the Title or Id of that folder. I added a Property to these folders. Displaying the numbers works fine where they should appear, but they also appear at places where they should not. Apparantly this Property is inherited by all subfolders. Anny sugestions? TIA Roel. code taken from CMF 1.2: <table border="0" cellspacing="0" cellpadding="2" nowrap> <tr> <td> </td> <td><font size="2"><b>Folders</b></font></td> <td> </td> <dtml-in expr="objectValues( [ 'Folder', 'Portal Folder', 'CMF Collector', 'Photo Folder' ] )" skip_unauthorized sort="title_or_id"> <td width="18" align="center"><img align="middle" src="&dtml-portal_url;/&dtml-getIcon;" alt="&dtml-Type;" title="&dtml-Type;" border="0"></td> <td width="200"><a href="&dtml-absolute_url;/"><dtml-var title_or_id></a></td> <td> <dtml-if gebouwcode> <dtml-var gebouwcode> <dtml-else>  </dtml-if> </td> </dtml-in> </table>

1 0

RE: [Zope] Data.fs falls into 33GB hole
by sean.upton＠uniontrib.com 15 Nov '02

15 Nov '02

Out of curiousity, how long did this take? -----Original Message----- From: Howard Hansen [mailto:howardahansen@yahoo.com] Sent: Thursday, November 14, 2002 7:03 PM To: Tino Wildenhain; zope(a)zope.org Subject: Re: [Zope] Data.fs falls into 33GB hole Thanks Tino for reminding me that I have a backup. I threw caution to the wind and packed it. This took a while, as you might imagine, but Data.fs slimmed down to 350mb. I guess Zope Just Works. Howard Hansen http://howardsmusings.com --- Tino Wildenhain <tino(a)wildenhain.de> wrote: > Hi Howard, > > why fsrecover? Your Data.fs is big but should not be > corrupt. I would even suspect if you simply pack > it, it should go to around 360-400MB again. > Zope packs by renaming it and then copys the most > recent objects over. So you only need the space > for actual Data.fs + Data.fs after packing. > Your last backup was at 360MB, so the packet Version > schould be at this level. > Since you have a backup on your Windows box, you > dont > have to worry, I'd say. > > HTH > Tino Wildenhain > > --On Donnerstag, 14. November 2002 13:36 -0800 > Howard Hansen > <howardahansen(a)yahoo.com> wrote: > > > I have several, fairly-large sites running on my > > machine and at the last backup, my Data.fs file > stood > > at 340MB. Zope itself only took up 50MB of RAM, > so I > > didn't worry about the size of the file. Disk > space > > is essentially infinite nowadays, right? > > > > Yes, but imagine my shock when I checked out why > my > > backup routine took a long time and then failed. > I > > found that Data.fs took up 33GB of space on the > disk! > > Yikes! > > > > I must step back for a moment and salute everyone > who > > made this possible. Everyone at Zope, Linus, > Guido, > > Maxtor, AMD, Intel, and the manufacturers of all > of > > the little components who have conspired to make a > > sticky mess like this possible. > > > > My Data.fs file grew to 33GB and I DIDN'T NOTICE. > > > > Looking over the Undo lists, I found hundreds of > > transactions that said simply "by Zope". Some > > experimentation led me to discover that these were > > inserted by JRedirector. It summarizes > redirections, > > and my assumption that it did it under the Undo > radar > > proved incorrect. I've since disabled > JRedirector. > > > > Running df on my disk, I find that I've filled 74% > of > > the 55GB data partition, so there's no chance of > > making a copy locally and figuring it out from > there. > > Serendipidously, I did have a 60GB drive literally > > sitting on the shelf. I popped it into my Windows > PC > > (I'd been able to get fsrecover.py to run on it, > but > > not on the Linux box) started copying over the > network > > This took a couple of hours. I tried to run > > fsrecover on the big file and it failed > immediately: > > > >> python.exe fsrecover.py -v 2 -P 184000 j:\Data.fs > > j:\Data_recovered_all.fs > > Recovering j:\Data.fs into > j:\Data_recovered_all.fs > > Traceback (most recent call last): > > File "fsrecover.py", line 328, in ? > > if __name__=='__main__': recover() > > File "fsrecover.py", line 221, in recover > > seek(0,2) > > IOError: [Errno 22] Invalid argument > > > > I guess there are indeed some limits. I wrote a > > quick program to make a copy of the first > > 1,000,000,000 bytes of the file. I ran fsrecover > on > > that without problems. This tells me that the > file > > itself is OK. It just needs to be packed or > filtered. > > > > I've got thousands of good transactions > interspersed > > with tens of thousands of noise transactions. > > > > Questions: > > > > 1) Can I safely pack a database this huge on my > live > > machine? > > 2) If that doesn't work, can I easily figure out > > transaction boundaries? If so, I could either > chop > > the big file up into smaller chunks and serially > > attach new tails to the file, then fsrecover the > whole > > thing. > > 3) If I can figure out transaction boundaries, can > I > > filter out transactions by type? I've got > > approximately 32GB of JRedirector transactions > that > > I'd be happy to remove. > > > > As always, thanks for listening and I eagerly > await > > your wisdom. > > > > > > Howard Hansen > > http://howardsmusings.com > > > > > > __________________________________________________ > > Do you Yahoo!? > > Yahoo! Web Hosting - Let the expert host your site > > http://webhosting.yahoo.com > > > > _______________________________________________ > > Zope maillist - Zope(a)zope.org > > http://lists.zope.org/mailman/listinfo/zope > > ** No cross posts or HTML encoding! ** > > (Related lists - > > > http://lists.zope.org/mailman/listinfo/zope-announce > > http://lists.zope.org/mailman/listinfo/zope-dev ) > > __________________________________________________ Do you Yahoo!? Yahoo! Web Hosting - Let the expert host your site http://webhosting.yahoo.com _______________________________________________ Zope maillist - Zope(a)zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )

2 1

Re: How to upload files into ZODB via shell script
by Josef Meile 15 Nov '02

15 Nov '02

> Hello, > > I just want to upload some files (PDF and Image files, partly targeted > to an ExtFile object) to Zope once some event occures on my system > (triggered by a cron job or a certain mail reaching the system). You could create a script in Zope where you do what you want to do and give a user the manager role. Then in unix you can call the method by using "wget". You also have to create a ".wgetrc" with the login and password of that user. Don't forget to secure that file in order to avoid that other users can access it. Regards, Josef.

1 0

Re: Basic DTML syntax question- variable value test
by Josef Meile 15 Nov '02

15 Nov '02

> It looks good but maybe you should try this: > > <dtml-if "str(AppRecDate)=='1900/01/01'"> There's a small mistake there. You should use: <dtml-if "_.str(AppRecDate)=='1900/01/01'"> Regards, Josef.

1 0

How to upload files into ZODB via shell script
by Andreas Tille 15 Nov '02

15 Nov '02

Hello, I just want to upload some files (PDF and Image files, partly targeted to an ExtFile object) to Zope once some event occures on my system (triggered by a cron job or a certain mail reaching the system). Is there a straigthforeward way to do so? If not I guess I have to use an SQL database and store the objects I want to use there. Kind regards Andreas.

2 1