- Zope-Dev - Zope lists

Is 2GB a FileStorage limitation still?
by Jason Spisak 09 May '00

09 May '00

Zopists, If the documentation URL below is still accurrate, the 2GB limitation question is *not* related to the OS or platform. """ The format uses 32-bit position pointers. For this reason, the format can only be used for moderately sized databases, containing no more than 2GB of data. A 64-bit file storage variant will be provided in the future. """ http://www.zope.org/Documentation/Developer/Models/ZODB/ZODB_FileStorage_Fi… Just clearing things up. All my best, -- Jason Spisak 444(a)hiretechs.com

2 1

Deleting Image
by anderson 09 May '00

09 May '00

Friends, How can I delete a image object throws the DTML ? Thanks so much anderson

2 1

Inter version problems & ZCatalog problems (long)
by Ondrej Palkovsky 09 May '00

09 May '00

I just tried to develop a small system for publishing informations. It has the following structure: KnowledgeBase folder .... kMessage .... kMessage .... kSearchFolder ......kMessage .... Folder ......kMessage etc. Source is available at http://sorry.vse.cz/~xpalo03/kbase.tar.gz I have following problems: Adding kMessage into KnowledgeBase structures doesn't work in 2.1.6 version, but works in 2.1.4 version. I always get Permission denied on manage_editProperties. I use following code to found a root folder: <dtml-in PARENTS skip_unauthorized=1> <dtml-if "meta_type=='KnowledgeBase'"> <dtml-call "REQUEST.set('kBaseId',id)"> </dtml-if> </dtml-in> <dtml-call "REQUEST.set('kBaseObj',_.getattr(_.this,kBaseId))"> This suffers from one problem, when thare is a Folder with same name of the 'root' folder, but I didn't find another way to do it (any suggestions?) This sets the 'kBaseObj' to the topmost 'KnowledgeBase' Folder. This code is in constructor of kmessage: <dtml-call "REQUEST.set('kSequence',kSequence+1)"> <dtml-call "kBaseObj.propertysheets.Seqopt.manage_editProperties(REQUEST)"> It doesn't work in 2.1.6 from factory, but works when called from a DTML method elsewhere. In 2.1.4. it's ok both in factory & method. Another problem is with catalog. I wanted to be able to search in Subtrees, but didn't find any way how to limit ZCatalog in respect to the 'path'. I created a ZClass inherited from ZCatalog and I let this thing being called from a kMessage constructor: <dtml-call "REQUEST.set('myUrl',this().url())"> <dtml-call "REQUEST.set('myObj',this())"> <dtml-in PARENTS> <dtml-if "meta_type=='KnowledgeBase' or meta_type=='kSearchFolder'"> <dtml-try> <dtml-call "uncatalog_object(myUrl)"> <dtml-except> </dtml-try> <dtml-call "catalog_object(myObj,myUrl)"> </dtml-if> </dtml-in> This should register this message in all ZCatalog-inherited classes upwards. It gets, but in the classes higher then the one the Catalogs gets updated somewhat badly. Suppose this structure: kbase (KnowledgeBase) ..folder (kSearchFolder) ....mesg1 ....mesg2 Now searching for Title in 'folder' is ok, but from 'kbase' I get no result for 'mesg1' and line corresponding to mesg1 for Title='mesg2', for other messages it's all this way moved. When I do Update Catalog, everything gets fixed. Any suggestions? Ondrej -- IBM's original motto: Cogito ergo vendo; vendo ergo sum.

1 0

Save as
by ibriones 09 May '00

09 May '00

Hello: I would like to use a link to save the actual html page. I don't know how i can do this. I wold like make this with Netscape and IE. How can i do this? -- Ismael Briones Vilar Administrador de Sistemas ibriones(a)amutis.com Amutis Telecomunicaciones S.A. Tlf: +34 96.353.67.67 Gran Vía Marqués del Turia, 27, 1 Fax: +34 96.353.53.58 46005 Valencia (Spain)

1 0

Collector
by Toby Dickenson 09 May '00

09 May '00

There seems to be a problem in adding new items to the Collector. Is anyone else seeing this? Toby Dickenson tdickenson(a)geminidataloggers.com

1 0

Data.fs corruption when creating lots of objects.
by R. David Murray 09 May '00

09 May '00

OK, so I'm trying to reload this 60K record database that I screwed up the load on before (but got it working anyway). I think I'm doing it right this time <wry grin>. But the load craps out with a database corruption error. (I'm doing the reload, by the way, because trying to compress the original database results in a broken database (ie: I could see a certain folder in the management interface but trying to access it resulted in a resource not found error message for its URL). This time I'm doing the work under FreeBSD 3.4-stable and Zope 2.1.4. (2.1.4 rather than 2.1.6 because of the reindex_object bug in 2.1.6). I don't see any checkins for ZODB in the CVS recent enough to be an issue. I have an external method that opens the source data file and builds the ZClass objects to hold the data. The method puts fifty items in each folder, generating folders and subfolders as necessary to achieve that. Every 1000 object additions I do a get_transaction().commit(). (I tried commit(1), but that didn't seem to write anything to the disk and memory just kept growing, so I switched to a full transaction commit which seems to work). At a Data.fs size of around 200MB, I get the following error returned by Client.py (which I use to call the external method): bci.ServerError: bobo exception (File: /usr/local/zope/directory/lib/python/ZODB/FileStorage.py Line: 617) Line 617 says: if doid != oid: raise CorruptedDataError, h So what it is reading back from the DB is not agreeing with what it expected. I also tried loading the objects in groups of 2500, compressing the DB after each sectional load. At around 75MB the compression failed with an error message that I'm afraid I failed to write down, but it had to do with a mismatch between the size of a transaction and the size of a contained or container data structure. In terms of the number of objects created, that was sooner than in the full load case. I've tried the big load twice, and it failed both times at around 200MB, but at different specific file sizes. I'm not sure if that means it was in a different transaction group or not, but I'm guessing so. Debugging suggestions are gratefully accepted. I've started perusing FileStorage.py, but it is somewhat heavy mojo and I haven't figured out where to start debugging yet. I also wish the thing failed sooner in the load; it's a pain to have to wait two hours for each test run to fail...I think I'll redo the sectional load and try to capture a maybe-valid database such that the next load causes the corruption. The source data is only 8MB, and the Data.fs before the load is about 5MB, if anyone feels like trying to reproduce it (you just have to promise to throw the data away afterwards <grin>). I'm also happy to give anyone who wants to work on this a temporary login on the dedicated box on which I'm trying to do this load. Hmm, I guess I might as well attach the external method here in case I'm doing something stupid. Or if someone can suggest a better way to do the load that will allow me to sidestep whatever bug I'm tickling I'd also be grateful, though I'd like to shoot this bug in any case. If I'd known I was going to run into this much trouble I'd have used Postgres to store the data (I may have to do that yet!), but there are good (future) reasons for having the data in the ZODB... --RDM def importDL(self,REQUEST): """ """ from string import split inf = open('/usr/local/zope/directory/Extensions/DLData') data = inf.readline() inner = 0 mid = 0 outer = 0 mid_s = "m%s" % mid outer_s = "%s" % outer while data: if inner%1000==0: get_transaction().commit() (SIC_code, SIC_desc, business_name, city, fax_phone, in_regions, keywords, primary_phone, state, street_address1, street_address2, zip, null) = split(data[:-1],'\t') if inner%50==0: if mid%50==0: outer = outer + 1 outer_s = "%s" % outer self.manage_addFolder(id=outer_s,title=outer_s) mid = mid+1 mid_s = "m%s" % mid self[outer_s].manage_addFolder(id=mid_s,title=mid_s) inner = inner+1 inner_s = "i%s" % inner newDL = self[outer_s][mid_s].manage_addProduct['ECardProduct'].\ DirectoryListingClass.createInObjectManager(inner_s,REQUEST) newDL.propertysheets.info.manage_editProperties({ 'SIC_code': SIC_code, 'business_name': business_name, 'city': city, 'fax_phone': fax_phone, 'in_regions': split(in_regions), 'primary_phone': primary_phone, 'state': state, 'street_address': street_address1, 'zip': zip, 'useSIC_code': 1 }) newDL.reindex_object() data = inf.readline() return "OK"

1 1

ZPatterns Win Binary
by Kevin Howe 08 May '00

08 May '00

Is there an NT binary available for the new ZPatterns3 C program? I don't have much experience with C, and my encounters with the GNU C Compiler leave much to be desired :) kh

1 0

Interface documentation review
by Michel Pelletier 08 May '00

08 May '00

Hello, Drop everything you are doing and take a look at Brian Lloyd's latest contribution to the InterfacesWiki, PropertyManager and PropertySheets. A few folks have weighed in good comments, Join Them and make etch your name permenantly into History. http://www.zope.org/Members/michel/Projects/Interfaces/Properties -- -Michel Pelletier http://www.zope.org/Members/michel/MyWiki Visit WikiCentral for the latest Zen: http://www.zope.org/Members/WikiCentral

3 2

Accessing objects uploaded into Zope
by Thomas Weholt 08 May '00

08 May '00

Hi, How can I, in Python-code, using Zope-classes, access objects uploaded "into" Zope`s databases using the running Zope ftp-server? I upload a file called test.img and want to extract that file from the database, process it and put it into a another storage outside Zope. ( In future use, the filename won`t be static, but the extension willl, so I want to use that as a search-criteria. ) If anybody can point to a solution for this specific problem or a place to learn more on how to access the internals of Zope, please let me know. Thomas

1 0

Defining new properties for users
by Thomas Weholt 08 May '00

08 May '00

Hi, I need to create new properties for users of a website, ex. security-level so that info can be filtered depending on what a user is allowed to see. How can I do this in code in a new product based on the 'Boring Product'-package? I want to do as much as possible in clean python-code using Zope-classes. Thomas

1 0