Re: [Zope] Worldpilot IMAP Bl00z
Ryan Hughes wrote:
"A.J. Rossini" wrote:
(zope list removed from followup)
> "TS" == Tres Seaver <tseaver@palladion.com> writes:
TS> I have installed WP 1.01 on a fresh Zope 2.1.3. On the same TS> RH 6.1 box, I am running the stock imapd, which I can connect TS> to from Netscape's Messenger.
TS> The files/directories under /var/spool/worldpilot are owned by TS> nobody.zope (I start Zope as root).
TS> When I log in, the browser spins after displaying the WP TS> headers. top on the server shows the Zope python process TS> (running as nobody) and an imapd process (running as me) TS> sucking all the CPU, but nothing happens.
TS> If I click on one of the links in the header, I can see the TS> calendar, to-do list, etc., but the mail pane shows a Zope TS> error, with "readonly -- INBOX" at the foot of the traceback.
TS> What am I doing wrong? --
Tres (and worldpilot) -
Did this ever get solved, or a hint of a solution? I'm seeing this identical situation, Python 1.52, patched imaplib.py(?), Zope 2.1.4, and worldpilot 1.0.1, i.e. 1.00.3, WU-imap (version not known).
The scenario is Zope on an Debian/Intel box, WU-imap on a Slowaris 2.7 (ultrasparc) box.
On debian, it's www-data.www-data (ownership, and Zope is running as www-data), so /var/spool/worldpilot is set accordingly...
I don't get the INBOX at all (but my home directory is 1.5Gb, might take a while to look for folders? I'm not imap-familiar, but noted a comment to that effect on the list); I've got an apparent "freeze-up" at this point. This is after waiting 5 minutes...
I can get to the calendars, etc...
Any thoughts?
Please check if the patched imaplib.py is really the one being imported?
The other issue is that if you're using UW IMAP it will probably list your whole INBOX which is apparently your home directory. This could take a while especially if you home directory is large.
I'mm trying to get together the facts of using WorldPilot with UW IMAP to make a FAQ, since we ourselves have no experience with UW IMAP.
Please check your worldpilot with an account that has a small home directory and let me know if the size is the problem. If your Zope process still cranks forever, then it's an imaplib.py issue. Up to now patching it solved the problem (as far as our experience concerns).
WU IMAP on a RH 6.x box is *bizarre*., Ok, I kicked this off before dinner, having added some debugging output to imaplib.py. When I came back, there was a TON of it dumped across the console at which I was running Zope, but no mail. Basically, it had walked down through all the .gnome/* directories, sucking up bitmaps, retular files, subdirectories, everything (ICK!). Maybe we need to add a property to the WorldPilot object which lets you configure the folder passed to the initial list() call (e.g., to be something like "~/Mail"). This parameter would default to the empty string, so that the Cyrus clients would continue to operate as before. I'll see if I can't come up with some kind of patch. Tres. -- ========================================================= Tres Seaver tseaver@palladion.com 713-523-6582 Palladion Software http://www.palladion.com
Michel Pelletier wrote:
Tres Seaver wrote:
WU IMAP on a RH 6.x box is *bizarre*.,
Try editing the configuration file sometime. It's the one that ends in .c
My sarcasm meter is in the shop after an accidental exposure to comp.lang.perl.misc (ugly story, don't ask), so I'm not sure how big a brick of salt to apply. WU IMAP is a nice stick for clobbering those who think Zope's documentation stinks; there is absolutely *nothing* in the package to give the hapluse admin any clue how to configure the damn thing. I spent about 4 hours this weekend prowling the net looking to resolve this issue. -- ========================================================= Tres Seaver tseaver@palladion.com 713-523-6582 Palladion Software http://www.palladion.com
Hi Tres, This was written up last week and after a little digging on egroups (I thought I had saved that message) I finally found it. Jo Meder provided the following information <quote> Chances are, that the request to "LIST *" in directory "" that imaplib issues cause your imapd to begin scanning your whole home directory which can be a lot of data, as we all know. I worked around this problem by creating /etc/c-client.cf with the following contents (the first line is required by imapd, otherwise the file is not accepted): --------------------------------------cut here ------------------- I accept the risk for IMAP toolkit 4.1. set black-box-directory /var/spool/imap_folderlinks/ --------------------------------------cut here ------------------- I then created /var/spool/imap_folderlinks and symlinked the directory in which my mailbox folders reside to /var/spool/imap_folderlinks/jo Repeat for all users on the system and set permissions appropriately. Jo. </quote> Also some information on this can be found in the file imaprc.txt that should be in /usr/doc/ or where ever RH dumps it. (I'm running this on SuSE myself.) I have tried this fix but I probably will. On Tue, 29 Feb 2000, Tres Seaver wrote: <snip>
WU IMAP on a RH 6.x box is *bizarre*.,
Ok, I kicked this off before dinner, having added some debugging output to imaplib.py. When I came back, there was a TON of it dumped across the console at which I was running Zope, but no mail. Basically, it had walked down through all the .gnome/* directories, sucking up bitmaps, retular files, subdirectories, everything (ICK!).
Maybe we need to add a property to the WorldPilot object which lets you configure the folder passed to the initial list() call (e.g., to be something like "~/Mail"). This parameter would default to the empty string, so that the Cyrus clients would continue to operate as before. I'll see if I can't come up with some kind of patch.
Tres. -- ========================================================= Tres Seaver tseaver@palladion.com 713-523-6582 Palladion Software http://www.palladion.com
_______________________________________________ Zope maillist - Zope@zope.org http://lists.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope-dev )
-- Jack Ungerleider The Ungerleider Group Creative Solutions for Cooperative Computing jack@jacku.com www.jacku.com
Jack Ungerleider wrote:
Hi Tres, This was written up last week and after a little digging on egroups (I thought I had saved that message) I finally found it. Jo Meder provided the following information
<quote> Chances are, that the request to "LIST *" in directory "" that imaplib issues cause your imapd to begin scanning your whole home directory which can be a lot of data, as we all know.
I worked around this problem by creating /etc/c-client.cf with the following contents (the first line is required by imapd, otherwise the file is not accepted):
--------------------------------------cut here ------------------- I accept the risk for IMAP toolkit 4.1. set black-box-directory /var/spool/imap_folderlinks/ --------------------------------------cut here -------------------
I then created /var/spool/imap_folderlinks and symlinked the directory in which my mailbox folders reside to /var/spool/imap_folderlinks/jo
Repeat for all users on the system and set permissions appropriately.
Jo. </quote>
I will be roasted -- I thought I'd followed these directions already, and still had it hang. When I went back to try again, I discovered that the symlinks were screwy (how imapd found my home directory at all is a good question). When I clean them up, it works!
Also some information on this can be found in the file imaprc.txt that should be in /usr/doc/ or where ever RH dumps it. (I'm running this on SuSE myself.) I have tried this fix but I probably will.
Hmmm, /usr/doc/imap-4.5 has only a README file, which doesn't mention the /etc/c-client.cfg file at all (it talks about building the package, and setting up the /etc/services and /etc/inetd.conf files to make IMAP work). Thanks very much for reposting those directions! Tres. -- ========================================================= Tres Seaver tseaver@palladion.com 713-523-6582 Palladion Software http://www.palladion.com
Tres Seaver wrote:
Ryan Hughes wrote:
"A.J. Rossini" wrote:
(zope list removed from followup)
>> "TS" == Tres Seaver <tseaver@palladion.com> writes:
TS> I have installed WP 1.01 on a fresh Zope 2.1.3. On the same TS> RH 6.1 box, I am running the stock imapd, which I can connect TS> to from Netscape's Messenger.
TS> The files/directories under /var/spool/worldpilot are owned by TS> nobody.zope (I start Zope as root).
TS> When I log in, the browser spins after displaying the WP TS> headers. top on the server shows the Zope python process TS> (running as nobody) and an imapd process (running as me) TS> sucking all the CPU, but nothing happens.
TS> If I click on one of the links in the header, I can see the TS> calendar, to-do list, etc., but the mail pane shows a Zope TS> error, with "readonly -- INBOX" at the foot of the traceback.
TS> What am I doing wrong? --
Tres (and worldpilot) -
Did this ever get solved, or a hint of a solution? I'm seeing this identical situation, Python 1.52, patched imaplib.py(?), Zope 2.1.4, and worldpilot 1.0.1, i.e. 1.00.3, WU-imap (version not known).
The scenario is Zope on an Debian/Intel box, WU-imap on a Slowaris 2.7 (ultrasparc) box.
On debian, it's www-data.www-data (ownership, and Zope is running as www-data), so /var/spool/worldpilot is set accordingly...
I don't get the INBOX at all (but my home directory is 1.5Gb, might take a while to look for folders? I'm not imap-familiar, but noted a comment to that effect on the list); I've got an apparent "freeze-up" at this point. This is after waiting 5 minutes...
I can get to the calendars, etc...
Any thoughts?
Please check if the patched imaplib.py is really the one being imported?
The other issue is that if you're using UW IMAP it will probably list your whole INBOX which is apparently your home directory. This could take a while especially if you home directory is large.
I'mm trying to get together the facts of using WorldPilot with UW IMAP to make a FAQ, since we ourselves have no experience with UW IMAP.
Please check your worldpilot with an account that has a small home directory and let me know if the size is the problem. If your Zope process still cranks forever, then it's an imaplib.py issue. Up to now patching it solved the problem (as far as our experience concerns).
WU IMAP on a RH 6.x box is *bizarre*.,
Ok, I kicked this off before dinner, having added some debugging output to imaplib.py. When I came back, there was a TON of it dumped across the console at which I was running Zope, but no mail. Basically, it had walked down through all the .gnome/* directories, sucking up bitmaps, retular files, subdirectories, everything (ICK!).
Maybe we need to add a property to the WorldPilot object which lets you configure the folder passed to the initial list() call (e.g., to be something like "~/Mail"). This parameter would default to the empty string, so that the Cyrus clients would continue to operate as before. I'll see if I can't come up with some kind of patch.
Tres. -- ========================================================= Tres Seaver tseaver@palladion.com 713-523-6582 Palladion Software http://www.palladion.com
Just curious, what does the result of a LIST with "~/Mail" look like on UW IMAP? What is the top node labeled as? I guess I could add a parameter to control the behaviour of the LIST call. Cheers, Ryan -- Ryan Hughes <rh@n-h.net> Neuberger & Hughes GmbH http://www.n-h.net ___________________________________________________ WorldPilot Get Synched - http://www.worldpilot.org The Open Source Personal Information Manager Server Powered by Python and Zope - http://www.zope.org
On Fri, 03 Mar 2000, Ryan Hughes wrote: <snip>
Just curious, what does the result of a LIST with "~/Mail" look like on UW IMAP? What is the top node labeled as? I guess I could add a parameter to control the behaviour of the LIST call.
Cheers, Ryan
-- Ryan Hughes <rh@n-h.net> Neuberger & Hughes GmbH http://www.n-h.net <snip>
Hi Ryan, I thought I'd jump in on this since it gives me a good reason to learn a little more about how IMAP works. ;-) I logged in via telnet to my test system and determined (with some help from the IMAP4 RFC) that the command being executed is LIST "" * Since the UW IMAP server logs the user into their system account I can only assume that this drops them into their home directory. If I execute the requested command it will return nothing unless a Mail directory exists in the users subdirectory. (I have one user setup this way from earlier tests and one without the directory.) Executing the command LIST Mail * returns the same as LIST ~/Mail * for the user with a Mail directory. I will attempt to do some checking on the functionality of the .imaprc file that is sort of documented and see if this can be used to work past the problem. -- Jack Ungerleider The Ungerleider Group Creative Solutions for Cooperative Computing jack@jacku.com www.jacku.com
Jack Ungerleider wrote:
On Fri, 03 Mar 2000, Ryan Hughes wrote:
<snip>
Just curious, what does the result of a LIST with "~/Mail" look like on UW IMAP? What is the top node labeled as? I guess I could add a parameter to control the behaviour of the LIST call.
Cheers, Ryan
-- Ryan Hughes <rh@n-h.net> Neuberger & Hughes GmbH http://www.n-h.net <snip>
Hi Ryan,
I thought I'd jump in on this since it gives me a good reason to learn a little more about how IMAP works. ;-)
I logged in via telnet to my test system and determined (with some help from the IMAP4 RFC) that the command being executed is
LIST "" *
Since the UW IMAP server logs the user into their system account I can only assume that this drops them into their home directory. If I execute the requested command it will return nothing unless a Mail directory exists in the users subdirectory. (I have one user setup this way from earlier tests and one without the directory.)
Executing the command LIST Mail * returns the same as LIST ~/Mail * for the user with a Mail directory.
I will attempt to do some checking on the functionality of the .imaprc file that is sort of documented and see if this can be used to work past the problem.
If you can figure out improvements on how to configure UW IMAP for interoperation with WorldPilot that would be great. We're currently lacking a UW IMAP server with a reasonable amount of data on it for looking into the issues. I'm putting in a parameter to control the LIST call, I think that should reduce the load for the large part of the users, but we're open for any further adaptions. Cheers, Ryan
-- Jack Ungerleider The Ungerleider Group Creative Solutions for Cooperative Computing jack@jacku.com www.jacku.com
-- Ryan Hughes <rh@n-h.net> Neuberger & Hughes GmbH http://www.n-h.net ___________________________________________________ WorldPilot - Get Synced - http://www.worldpilot.org The Open Source Personal Information Manager Server Powered by Python and Zope - http://www.zope.org
Ryan Hughes wrote:
Tres Seaver wrote: <snip>
Maybe we need to add a property to the WorldPilot object which lets you configure the folder passed to the initial list() call (e.g., to be something like "~/Mail"). This parameter would default to the empty string, so that the Cyrus clients would continue to operate as before. I'll see if I can't come up with some kind of patch.
Just curious, what does the result of a LIST with "~/Mail" look like on UW IMAP? What is the top node labeled as? I guess I could add a parameter to control the behaviour of the LIST call.
I checked the WU IMAP mailing list, and found the following: http://www.washington.edu/imap/listarch/msg06947.html In short, Mark Crispin (the author of WU IMAP) strongly recommends avoiding the "*" wildcard altogether, using rather "%". In this case, the '\NoSelect' flag indicates (I think) that the item is a directory, and could be drilled into; or perhaps the '\NoInferiors' says "this is a leaf -- don't descend" (my ignorance of the IMAP protocol is showing). I guess the idea here is to avoid using LIST once, but to do it "on demand" as the user drills down the tree. Mark also recommends using "LSUB" to pick up "subscribed" mail folders. Hope this helps! Tres. -- ========================================================= Tres Seaver tseaver@palladion.com 713-523-6582 Palladion Software http://www.palladion.com
Tres Seaver wrote:
Ryan Hughes wrote:
Tres Seaver wrote: <snip>
Maybe we need to add a property to the WorldPilot object which lets you configure the folder passed to the initial list() call (e.g., to be something like "~/Mail"). This parameter would default to the empty string, so that the Cyrus clients would continue to operate as before. I'll see if I can't come up with some kind of patch.
Just curious, what does the result of a LIST with "~/Mail" look like on UW IMAP? What is the top node labeled as? I guess I could add a parameter to control the behaviour of the LIST call.
I checked the WU IMAP mailing list, and found the following:
http://www.washington.edu/imap/listarch/msg06947.html
In short, Mark Crispin (the author of WU IMAP) strongly recommends avoiding the "*" wildcard altogether, using rather "%". In this case, the '\NoSelect' flag indicates (I think) that the item is a directory, and could be drilled into; or perhaps the '\NoInferiors' says "this is a leaf -- don't descend" (my ignorance of the IMAP protocol is showing).
I guess the idea here is to avoid using LIST once, but to do it "on demand" as the user drills down the tree. Mark also recommends using "LSUB" to pick up "subscribed" mail folders.
Hope this helps!
Thanks. We will eventually be looking into optimisations for the list command, to reduce the depth of braches traversed. If any UW IMAP users can confirm which flags represent what in that context, that would be helpful. Then we could avoid listing them. Cheers, Ryan
Tres. -- ========================================================= Tres Seaver tseaver@palladion.com 713-523-6582 Palladion Software http://www.palladion.com
-- Ryan Hughes <rh@n-h.net> Neuberger & Hughes GmbH http://www.n-h.net ___________________________________________________ WorldPilot Get Synched - http://www.worldpilot.org The Open Source Personal Information Manager Server Powered by Python and Zope - http://www.zope.org
participants (4)
-
Jack Ungerleider -
Michel Pelletier -
Ryan Hughes -
Tres Seaver