- Zope - Zope lists

need advice on mass data processing
by Allen Huang 09 Jan '07

09 Jan '07

I have a data file that has over 110000 entry of 3 column data (string, float, float) currently I have written my program so it will do an entry by entry processing with zope. This operation is like this 1. read data (the data file) 2. create product (a python product that store three field data: one string and two float data) 3. update product (update the three field entries) when I first tried it out with the first 1000 entries it took about 30 seconds. That means its going to take 50 ~ 60 minutes for 110000 entries. It not every day that you have to process over 110000 data entries but processing over 60 minutes is still kind of long. So I was wondering if anyone could propose a different method of doing this..... Love to heard any replies... Allen __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com

3 2

all_meta_types confusion
by Garth B. 09 Jan '07

09 Jan '07

Hey everyone, Zope 2.9.6 I'm trying to filter the objects that appear in the Add drop down, and I'm having odd results. There are two scenarios. In the first scenario, the active user is a Manager and my folderish object does not have a defined all_meta_types function. Everything shows up in the Add drop down as expected. When I define all_meta_types for my folderish object to only return one kind of object, the "Add xxxxx" button appears as one would expect. In the second scenario, I have a role "Editor" which controls what kinds of objects the user can add. When I do not have an all_meta_types function defined on my folderish object, only those objects that the role permits the user to add are shown. When I define all_meta_types for my folderish object to only return one of the kinds of objects that the role does permit, the user can't add anything. No "Add xxxxx" button that one would normally see when only able to add a single type of object to a folderish object. For the same type of object, and when logged in as an "Editor", the call to user.has_permission() (around line 254) in filtered_meta_types() in ObjectManager.py, returns false when all_meta_types is defined, and returns true when it isn't. I don't know why the user would not have permission to add this type of object when all_meta_types is defined versus when it isn't. This is why I'm confused. No errors or exceptions. So, in summary, when I don't have all_meta_types defined for my folderish object, the five types of objects the role is permitted to add is shown in the Add drop down. When I set all_meta_types to only permit one of those five types of objects to be added, the user can't add anything. A user with the Manager role doesn't appear to have this problem. Any suggestions for what's going on here? Any insights are appreciated! Thank you, Garth

3 4

Re: [Zope] need advice on mass data processing
by Allen Huang 09 Jan '07

09 Jan '07

There is other solution that uses RDBMS to what I'm trying to do, and I'm considering using PostGreSQL after. But before that, I want to using ZOPE and ZODB because I feel this could work. But in ZOPE vs RDBMS, why do you consider RDBMS first, why not ZOPE? can your give me the pros and cons in your perspective? ----- Original Message ---- From: Jonathan <dev101(a)magma.ca> To: zope(a)zope.org Sent: Tuesday, January 9, 2007 9:21:18 PM Subject: Re: [Zope] need advice on mass data processing ----- Original Message ----- From: "Andrew Milton" <akm(a)theinternet.com.au> To: "Andreas Jung" <lists(a)zopyx.com> Cc: "Zope" <zope(a)zope.org> Sent: Tuesday, January 09, 2007 4:21 AM Subject: Re: [Zope] need advice on mass data processing > +-------[ Andreas Jung ]---------------------- > | > | Sorry, but you are misusing Zope. Put your data into a RDBMS and be the > | happiest man in the world. The ZODB is not a data toilet. Nothing more > | to add from my side on this particular issue. > > I concur. One caveat though... if you want to be able to do a text search on the string portion of your data, then ZCatalog would be an appropriate tool. Jonathan _______________________________________________ Zope maillist - Zope(a)zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com

2 1

Solved (Re: Strange ZEO related Tracebacks (ZEO.cache, line 915, in _makeroom))
by Jean Jordaan 08 Jan '07

08 Jan '07

Hi all > * Module ZEO.cache, line 915, in _makeroom > > KeyError: 10201651 It turns out that this was due to an undersized /tmp partition (17M, while the default cache size is 20M). Configuring Zope to use a persistent cache made this error go away. -- jean . .. .... //\\\oo///\\

1 0

Migrate exUserFolder back to User Folder
by Chris Crownhart 08 Jan '07

08 Jan '07

Hello, I have a site that is using the exUserFolder product as acl_users in the root folder. I would like to migrate it back to a normal User Folder. My problem, however, is that the passwords are encrypted by default in exUserFolder, and I do not now how to migrate those encrypted passwords back to the normal User Folder. Any ideas? Thanks, Chris

4 5

Re: Re: [Zope] Limit size download file in Zope wih LocalFS
by Alan 08 Jan '07

08 Jan '07

Thanks Andrea for your attention. Not clear error message. If I try to download a file bigger than 128 kb, I got a smaller file and when I 'cat' it I got the 'object' (like <open file '/scratch/ccpngrid/JOBS/PDBS_all.pdb', mode 'rb' at 0x323c7558>) Playing with the browser mode of LocalFS (tab 'View' in ZMI) I can upload big files but I get the same problem as above when downloading. The first thing I did was to ask to our server administrator and so far she told me nothing was done but migrating our portal to apache, yet she pointed out the fact that everything else is working but LocalFS, then the likely culprit is LocalFS... Anyway, it was working before... Cheers, Alan On 04/01/07, Andreas Jung <lists(a)zopyx.com> wrote: > - --On 4. Januar 2007 17:52:07 +0000 Alan <alanwilter(a)gmail.com> wrote: > > > Hi List! > > > > I got a problem. I found out that any file located in a LocalFS folder > > bigger than 128 Kb (precisely 131071 bytes) cannot be download from > > zope portal since the administrator move it over apache. > > > > I mean, I can download a pdf file of 8 Mb from Plone, but I cannot > > download > > any file from a LocalFS area bigger than the value above. > > > > > > Any particular error message? Your administrator might have limited > the size for POST requests? > > - -aj -- Alan Wilter S. da Silva, D.Sc. - CCPN Research Associate Department of Biochemistry, University of Cambridge. 80 Tennis Court Road, Cambridge CB2 1GA, UK. >>http://www.bio.cam.ac.uk/~awd28<<

3 4

Strange ZEO related Tracebacks (ZEO.cache, line 915, in _makeroom)
by Jean Jordaan 08 Jan '07

08 Jan '07

Hi all I packed and copied a Data.fs file from one machine to another. Now I see this on the new machine: Traceback (innermost last): * Module ZPublisher.Publish, line 187, in publish_module_standard * Module Products.PlacelessTranslationService.PatchStringIO, line 51, in new_publish * Module ZPublisher.Publish, line 144, in publish * Module Zope2.App.startup, line 199, in zpublisher_exception_hook * Module ZPublisher.Publish, line 113, in publish * Module ZPublisher.mapply, line 88, in mapply * Module ZPublisher.Publish, line 40, in call_object * Module Shared.DC.Scripts.Bindings, line 311, in __call__ * Module Shared.DC.Scripts.Bindings, line 348, in _bindAndExec * Module App.special_dtml, line 175, in _exec * Module DocumentTemplate.DT_Let, line 76, in render * Module DocumentTemplate.DT_In, line 643, in renderwob * Module DocumentTemplate.DT_In, line 771, in sort_sequence * Module ZODB.Connection, line 704, in setstate * Module ZODB.Connection, line 760, in _setstate * Module ZODB.serialize, line 495, in setGhostState * Module ZODB.serialize, line 488, in getState * Module ZODB.serialize, line 436, in _persistent_load * Module ZODB.Connection, line 207, in get * Module ZEO.ClientStorage, line 746, in load * Module ZEO.ClientStorage, line 774, in loadEx * Module ZEO.cache, line 293, in store * Module ZEO.cache, line 980, in add * Module ZEO.cache, line 915, in _makeroom KeyError: 10201651 (Also, an error occurred while attempting to render the standard error message.) Does anyone know what is bothering _makeroom ? Regards, -- jean . .. .... //\\\oo///\\

1 0

Re: [Zope] saving/creating an object to an exsisting folderish object
by Allen Huang 08 Jan '07

08 Jan '07

Will... I just found out that I'm suppose to migrate to ZPT. But, I start with DTML to begin with and I've be doing it for the past two years, so it's kind hard for me to move on to xml and ZPT right off the bat. But the tag:attribute structure still confuses me. Anyways, thanks for all your help Andreas, couldn't done it without you forcing me to think about my problem. ----- Original Message ---- From: Andreas Jung <lists(a)zopyx.com> To: Allen Huang <swapp0(a)yahoo.com>; Zope <zope(a)zope.org> Sent: Monday, January 8, 2007 4:39:32 AM Subject: Re: [Zope] saving/creating an object to an exsisting folderish object --On 7. Januar 2007 08:07:28 -0800 Allen Huang <swapp0(a)yahoo.com> wrote: > I found the solution... use _.getitem(name) > > this took some book flipping through some basic methods of zope modules > in 'The Book of ZOPE' by Beehive. A pretty good book for beginners Why (the hell) are you (still) using DTML (as newbie). You are strongly encouraged to use ZPT. -aj __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com

2 1

Re: [Zope] saving/creating an object to an exsisting folderish object
by Allen Huang 07 Jan '07

07 Jan '07

I found the solution... use _.getitem(name) this took some book flipping through some basic methods of zope modules in 'The Book of ZOPE' by Beehive. A pretty good book for beginners ----- Original Message ---- From: Allen Huang <swapp0(a)yahoo.com> To: zope(a)zope.org Sent: Sunday, January 7, 2007 5:00:03 PM Subject: Re: [Zope] saving/creating an object to an exsisting folderish object I don't have a problem with manage_addProduct(). I know how it works. Creating objects in a folder is not a problem to me. My problem is the folderish object which I'm trying to find with a string input. If you've read my previous message, the server output error with name.manage_addFile('point', 'a point') because name is a str object and does not have manage_addFile. I understand this. But name is an id to an exsisting folder that I want to access and do operation inside. how would I modify name.manage_addFile('point', 'a point') into a working statement? ----- Original Message ---- From: Andreas Jung <lists(a)zopyx.com> To: Allen Huang <swapp0(a)yahoo.com>; Zope <zope(a)zope.org> Sent: Sunday, January 7, 2007 4:06:27 PM Subject: Re: [Zope] saving/creating an object to an exsisting folderish object --On 7. Januar 2007 00:02:21 -0800 Allen Huang <swapp0(a)yahoo.com> wrote: > 'name' is a string obj > I have a exsisting folder > > name == folder.getId() > > say I want to use manage_addFile('point', 'a point') into this folder > with the getId() == name > > but I can't do name.manage_addFile('point', 'a point') because 'name' is > a str object > > so how do I create a file inside a folder whose id is 'name'? > > here is a german FAQ: <http://www.zope.de/dokumentation/faqs/entwicklung/PythonScripts/add_product…> Google for manage_addProduct() or search on zope.org -aj __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com _______________________________________________ Zope maillist - Zope(a)zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com

2 1

zope document management
by pol 07 Jan '07

07 Jan '07

Hi all, I would like to share my user view about zope, I would like zope to strive to embody into Data.fs the best trimmed down objects as possible, leaving on the file system most of the content. Text files and pictures should be accessible by external editors, mail should be accessible by external mail readers, and so on. Zope main role would then be to establish connections between external objects, collecting, indexing, sorting and viewing external objects (editing capability would not be needed). Is anybody working in that direction? thank you -- Pol

4 5