Importing Files + metadata into zodb
Hi all, I have about 300mb worth of legacy files which I may need to either import into the zodb, or else be able to access through the zope interface whilst they are still stored on the file system they are currently on. a few vaguely related questions: a) What products, if any, are available for doing a mass import like this? b) What is the practical limit on how much data the zodb can hold? If I have more data than this, is it possible to have more than one zodb, and if so, how? c) There is metadata associated with the files (ie Word metadata) which I would like to be able to access - are there any products which would help me to do this? Any hints or thoughts sent in my general direction appreciated Thanks :) _________________________________________ Wendy Langer ICQ#: 71726799 More ways to contact me: http://wwp.icq.com/71726799 See more about me: http://web.icq.com/whitepages/about_me?Uin=71726799 _________________________________________
"Wendy" == Wendy Langer <wlanger@bigpond.net.au> writes:
Wendy> a) What products, if any, are available for doing a mass Wendy> import like this? Zope also runs an ftp server, so you can just ftp into port 8021 and mput the files. How you specify the username and port will depend on your ftp client, but once you are logged in you can do something like 'mput *.doc' to upload all the files Wendy> b) What is the practical limit on how much data the zodb Wendy> can hold? If I have more data than this, is it possible to Wendy> have more than one zodb, and if so, how? I recently bumped up against the 2GB file size limit on linux. I don't know what the story is for other OSs. On linux, the 2.4.x series of kernels does support files larger than 2GB. But you need to compile python with large file support. After you run configure, change the OPT line to read: OPT= -ggdb -O2 -Wall -Wstrict-prototypes -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 and 'make install'. Then rebuild zope. After these changes, the max size for Data.fs is 2^63 (or 2^64?) which is practically infinite. But I have moved to LocalFS for serving large numbers of large files (20-30GB each) and am very happy with it. If you used this, you could simply ft Wendy> c) There is metadata associated with the files (ie Word Wendy> metadata) which I would like to be able to access - are Wendy> there any products which would help me to do this? What is Word metadata? Cheers, John Hunter
participants (2)
-
John Hunter -
Wendy Langer