hi all,
Tres Seaver wrote:
>On behalf of the Zope Foundation and its members, I'm pleased to
>announce the 2.13.23 release of the Zope2 package:
Great!
>/path/to/venv/bin/pip install \
>https://raw.githubusercontent.com/zopefoundation/Zope/2.13.23/requirements.…
raboso:/home/zope/2.13.23$ ./bin/pip install https://raw.githubusercontent.com/zopefoundation/Zope/2.13.23/requirements.…
Downloading/unpacking https://raw.githubusercontent.com/zopefoundation/Zope/2.13.23/requirements.…
Downloading requirements.txt
Cannot unpack file /tmp/pip-9UQkA6-unpack/requirements.txt (downloaded from /tmp/pip-GQuiZE-build, content-type: text/plain; charset=utf-8); cannot detect archive format
Cannot determine archive format of /tmp/pip-GQuiZE-build
Storing complete log in /home/zope/./.pip/pip.log
---------------
raboso:/home/zope/2.13.23$ ./bin/pip install --index-url=http://download.zope.org/Zope2/index/2.13.23/ Zope2
Downloading/unpacking Zope2
Could not find any downloads that satisfy the requirement Zope2
No distributions at all found for Zope2
Storing complete log in /home/zope/./.pip/pip.log
---------------
raboso:/home/zope/2.13.23$ ./bin/easy_install -i http://download.zope.org/Zope2/index/2.13.23 Zope2
Searching for Zope2
Reading http://download.zope.org/Zope2/index/2.13.23/Zope2/
Couldn't find index page for 'Zope2' (maybe misspelled?)
Scanning index of all packages (this may take a while)
Reading http://download.zope.org/Zope2/index/2.13.23/
No local packages or download links found for Zope2
Best match: None
Traceback (most recent call last):
File "./bin/easy_install", line 8, in <module>
load_entry_point('setuptools==0.6c11', 'console_scripts', 'easy_install')()
File "/home/zope/2.13.23/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/setuptools/command/easy_install.py", line 1712, in main
File "/home/zope/2.13.23/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/setuptools/command/easy_install.py", line 1700, in with_ei_usage
File "/home/zope/2.13.23/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/setuptools/command/easy_install.py", line 1716, in <lambda>
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/home/zope/2.13.23/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/setuptools/command/easy_install.py", line 211, in run
File "/home/zope/2.13.23/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/setuptools/command/easy_install.py", line 434, in easy_install
File "/home/zope/2.13.23/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/setuptools/package_index.py", line 475, in fetch_distribution
AttributeError: 'NoneType' object has no attribute 'clone'
---------------
./bin/easy_install ../Zope2-2.13.23.tar.gz works but seems to use the wrong
requirements so Zope2 does not start.
How am I supposed to install Zope2 this time? Which INSTALL.rst,
INSTALL-buildout.rst or INSTALL-virtualenv.rst am I supposed to read (please
provide URL)?
Regards,
Michael Brunnbauer
--
++ Michael Brunnbauer
++ netEstate GmbH
++ Geisenhausener Straße 11a
++ 81379 München
++ Tel +49 89 32 19 77 80
++ Fax +49 89 32 19 77 89
++ E-Mail brunni(a)netestate.de
++ http://www.netestate.de/
++
++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
++ USt-IdNr. DE221033342
++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
This may be more of a zodb / relstorage question - I hope it's ok to ask
on the Zope list.
I'm seeing behavior using relstorage and blobs that I didn't expect:
If I upload a large file, say 2 gigs, I am noticing that our SQL
database also grows by 2 Gigs, along with the blob storage.
After a pack, the space is reclaimed on the SQL side, and everyone is
happy.
FWIW - it's videos that are doing this.
I am pretty sure it's the undo log that's growing, based on the fact
that a pack reclaims the space.
Can this behavior be turned off for a specific field or content type?
So undo logs are preserved for everything BUT this monster of a content
type?
Seems strange to do this tho.
Are there other alternatives, like calling .pack() directly on the
field's storage after it's set?
Our problem is that our sql database grows to a huge size between our
weekly packs, and backups of the sql dumps are becoming unmanageable.
Our blob backups are ready to deal with this kind of size, but not the
sql backups.
----------
Going deeper down the rabbit hole, although I don't think it's relevant,
is the fact that I hacked and replaced the storage class for the field.
Instead of using AnnotationStorage - which I found used as default for
ImageField - I intercept the data during storage.set(), ship it out to a
separate storage facility, and replace the data with a happy message
"This is not where your data is" which is then written to the blobs.
It works just great - keeping our blob storage growth from going
crazy. If you try to 'download' the file from Plone, you'll get the
text file with the happy message.
Now that I've been shown that the Blob Storage is functioning just fine,
but the SQL storage size is going off the charts, I hope I'm not back at
square one.
The goal is to allow users to think they are uploading 4Gb videos into
Plone, when under the covers, we're actually shipping the video files
off to some fancy off-site storage. (Akamai) So we don't have to store
them and back them up on-site, and our blob directories remain
manageable in size.
The storage hack can be seen here:
https://github.com/RadioFreeAsia/rfa.kaltura/blob/master/rfa/kaltura/storag…
I'm not proud of it, but it works.
--
Mike McFadden
Radio Free Asia
Technical Operations Division
2025 M Street NW
Washington DC 20036 USA
This e-mail message is intended only for the use of the addressee and may contain information that is privileged and confidential. Any unauthorized dissemination, distribution or copying is strictly prohibited. If you receive this transmission in error, please contact network(a)rfa.org.