Can anyone comment on past experiences with various postgres adapters? I am using the latest PoPy (201) and have just recently noticed psychopg. Is it better, faster, more reliable or any of the above?
obviously yes. but look at my email address and at psycopg hosting site before giving too much weight to my words... :) more seriously, psycopg is actively developed (i.e., we usually fix bugs in 2-3 days and release a new version about 24h afterwards) and we are really commited to DB-API compliance. what can i say apart from give psyco a try? http://initd.org/Software/psycopg/ ciao, federico -- Federico Di Gregorio MIXAD LIVE Chief of Research & Technology fog@mixadlive.com Debian GNU/Linux Developer & Italian Press Contact fog@debian.org A short story: I want you. I love you. I'll miss you. -- Me
I'm trying to take a "File" object in ZODB and iterate over the entire thing (about 300,000 lines) and insert into a Postgres database. The file is about 37MB of comma sepearated numbers. I guess Zope treats the entire transaction as one transaction and doesn't really ever come back from attempting to insert every row. Do you have an idea on how to split this up into multiple transactions or do a commit or some sort so that Zope doesn't croke? Thanks, -Chris Federico Di Gregorio wrote:
Can anyone comment on past experiences with various postgres adapters? I am using the latest PoPy (201) and have just recently noticed psychopg. Is it better, faster, more reliable or any of the above?
obviously yes. but look at my email address and at psycopg hosting site before giving too much weight to my words... :)
more seriously, psycopg is actively developed (i.e., we usually fix bugs in 2-3 days and release a new version about 24h afterwards) and we are really commited to DB-API compliance. what can i say apart from give psyco a try? http://initd.org/Software/psycopg/
ciao, federico
On Mon, May 21, 2001 at 10:42:53AM -0500, Christopher N. Deckard wrote:
I'm trying to take a "File" object in ZODB and iterate over the entire thing (about 300,000 lines) and insert into a Postgres database. The file is about 37MB of comma sepearated numbers. I guess Zope treats the entire transaction as one transaction and doesn't really ever come back from attempting to insert every row. Do you have an idea on how to split this up into multiple transactions or do a commit or some sort so that Zope doesn't croke?
Thanks, -Chris
Has it been exported to filespace? Is it a Unix-like system? Are you comfortable writing edit scripts? If yes to all of these, then I would recommend using psql to inject it into the database. If not, I would drop it to the filesystem and then use psql ;-). Jim Penny
Federico Di Gregorio wrote:
Can anyone comment on past experiences with various postgres adapters? I am using the latest PoPy (201) and have just recently noticed psychopg. Is it better, faster, more reliable or any of the above?
obviously yes. but look at my email address and at psycopg hosting site before giving too much weight to my words... :)
more seriously, psycopg is actively developed (i.e., we usually fix bugs in 2-3 days and release a new version about 24h afterwards) and we are really commited to DB-API compliance. what can i say apart from give psyco a try? http://initd.org/Software/psycopg/
ciao, federico
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
Jim Penny wrote:
On Mon, May 21, 2001 at 10:42:53AM -0500, Christopher N. Deckard wrote:
I'm trying to take a "File" object in ZODB and iterate over the entire thing (about 300,000 lines) and insert into a Postgres database. The file is about 37MB of comma sepearated numbers. I guess Zope treats the entire transaction as one transaction and doesn't really ever come back from attempting to insert every row. Do you have an idea on how to split this up into multiple transactions or do a commit or some sort so that Zope doesn't croke?
Thanks, -Chris
Has it been exported to filespace? Is it a Unix-like system? Are you comfortable writing edit scripts? If yes to all of these, then I would recommend using psql to inject it into the database. If not, I would drop it to the filesystem and then use psql ;-).
Jim Penny
Jim, What do you mean by exported to the filespace? Zope 2.3.2 running on RedHat Linux 7.1 with my own compiled Postgres 7.1.1. I want all transactions (inserts, updates, even table creations) to be handled through Zope. I do not want to give users access to a shell on the system. I could do the number of inserts that I need to do over xml-rpc, but again, I want this to be as simple as upload a CSV (comma seperated) file, specify the table, and have it insert every row in the file. Again, I don't want to give anyone access to a shell on the machine. Everything must be done through Zope. -Chris
participants (3)
-
Christopher N. Deckard -
Federico Di Gregorio -
Jim Penny