[Zope] zope and sitecopy

Jean Jordaan jean@upfrontsystems.co.za
Sun, 29 Jul 2001 19:11:34 +0200


> From: Paul Everitt <paul@digicool.com>
>
> I've been using sitecopy (there's a Windows command-line port)
> with some success.

On this topic, my 2c: we're using sitecopy, but we're observing some
odd, though consistent, behaviour.

Short version:

 - 'sitecopy --fetch test' with protocol ftp is BROKEN: it gets all
   filenames as duplicates.

 - 'sitecopy --fetch test' with protocol webdav works just fine.

 - 'sitecopy --synch test' with protocol webdav is BROKEN: all
   Page Templates fail with 500 internal error.

 - 'sitecopy --synch test' with protocol ftp works just fine.

Therefore, this way of working works:

 - Fetch via webdav, edit .sitecopyrc, and synch and update via
   ftp. If you need to fetch again (added objects Zopeside), go
   back to step 1.

Other caveat: sitecopy seems to ignore ~/.netrc for ftp (requires
username and password in ~/.sitecopyrc), but not for webdav.

Long version:

------------------------------------------------------------------
Here is the relevant ~/.sitecopyrc stanza:
------------------------------------------------------------------

site test
    server          localhost
# '--synch' and '--update' via ftp
#   port            10021
#   protocol        ftp
# '--fetch' via webdav
    port            10900
    protocol        webdav
    remote          /zpt
    local           /home/jean/work/feko-website/zpt
    state           timesize
    username        jean
    password        xxxx
    nodelete        # not everything is downloaded: don't delete those
                    # files on the server
    exclude         /acl_users
    exclude         MailHost
    exclude         *~
    exclude         *.swp

------------------------------------------------------------------
Fetch attempt via ftp:
------------------------------------------------------------------

[jean@blommie sitecopy-test]$ sitecopy --fetch test
sitecopy: Fetching site `test' (on localhost in /zpt/)
[...]
File: apl_ant_pla.htm - size 7010
File: apl_ant_pla.htm - size 7010
File: apl_ant_des.htm - size 12058
File: apl_ant_des.htm - size 12058
Directory: faq/
Directory: faq/
Directory: images/
Directory: interface/
Directory: interface/
Directory: popups/
Directory: popups/
sitecopy: Fetch completed successfully.

------------------------------------------------------------------
Corresponding Zope log:
------------------------------------------------------------------

127.0.0.14327 ==> 220 blommie FTP server (Medusa Async V1.13 [experimental])
ready.
127.0.0.14327 <== USER jean
127.0.0.14327 ==> 331 Password required.
127.0.0.14327 <== PASS <password>
127.0.0.14327 ==> 230 Login successful.
127.0.0.14327 <== PASV
127.0.0.14327 ==> 227 Entering Passive Mode (127,0,0,1,16,232)
127.0.0.14327 <== LIST -laR /zpt/
127.0.0.14327 ==> 150 Opening ASCII mode data connection for file list
127.0.0.14327 ==> 226 Transfer complete
127.0.0.14327 <== QUIT
127.0.0.14327 ==> 221 Goodbye.

------------------------------------------------------------------
A subsequent ftp synch fails when trying to create directories
repeatedly.

Successful webdav fetch and failing webdav synch (note: fetching
*images* works. The '*.htm' files below are all Page Templates):
------------------------------------------------------------------

[jean@blommie sitecopy-test]$ rm ~/.sitecopy/test
[jean@blommie sitecopy-test]$ sitecopy --fetch test
[...]
[jean@blommie sitecopy-test]$ sitecopy --synch test
sitecopy: Synchronizing site `test' (on localhost in /zpt/)
Downloading interface/checkRequiredFields: [] failed:
500 Internal Server Error
Downloading faq/mem_faq.htm: [] failed:
500 Internal Server Error
Downloading faq/node1.html: [] failed:
500 Internal Server Error
Downloading faq/node2.html: [] failed:
500 Internal Server Error
Downloading faq/node3.html: [] failed:
500 Internal Server Error
[...]

------------------------------------------------------------------
Corresponding log:
------------------------------------------------------------------

127.0.0.1 - - [29/Jul/2001:18:48:26 +0200] "OPTIONS /zpt/ HTTP/1.1" 200 330
"" "sitecopy/0.10.15 neon/0.11.0"
127.0.0.1 - - [29/Jul/2001:18:48:36 +0200] "PROPFIND /zpt/ HTTP/1.1" 207
227986 "" "sitecopy/0.10.15 neon/0.11.0"
127.0.0.1 - - [29/Jul/2001:18:49:24 +0200] "OPTIONS /zpt/ HTTP/1.1" 200 330
"" "sitecopy/0.10.15 neon/0.11.0"
127.0.0.1 - - [29/Jul/2001:18:49:24 +0200] "GET
/zpt/interface/checkRequiredFields HTTP/1.1" 500 4010 "" "sitecopy/0.10.15
neon/0.11.0"
127.0.0.1 - - [29/Jul/2001:18:49:25 +0200] "GET /zpt/faq/mem_faq.htm
HTTP/1.1" 500 3994 "" "sitecopy/0.10.15 neon/0.11.0"

------------------------------------------------------------------
Successful fetch via ftp:
------------------------------------------------------------------

[jean@blommie sitecopy-test]$ sitecopy --synch test
sitecopy: Synchronizing site `test' (on localhost in /zpt/)
Downloading faq/mem_faq.htm: [.......] done.
Downloading faq/node1.html: [................................] done.
Downloading faq/node2.html: [....................................] done.
Downloading faq/node3.html: [..................................] done.
Downloading faq/node4.html: [...................................] done.
Downloading faq/node5.html: [.............................] done.
Downloading faq/node6.html: [..................] done.
[...]

------------------------------------------------------------------
Corresponding Zope log:
------------------------------------------------------------------

127.0.0.14334 ==> 220 blommie FTP server (Medusa Async V1.13 [experimental])
ready.
127.0.0.14334 <== USER jean
127.0.0.14334 ==> 331 Password required.
127.0.0.14334 <== PASS <password>
127.0.0.14334 ==> 230 Login successful.
127.0.0.14334 <== TYPE I
127.0.0.14334 ==> 200 Type set to Binary.
127.0.0.14334 <== PASV
127.0.0.14334 ==> 227 Entering Passive Mode (127,0,0,1,16,239)
127.0.0.14334 <== RETR /zpt/faq/mem_faq.htm
127.0.0.14334 ==> 150 Opening Binary mode data connection for file
'/zpt/faq/mem_faq.htm'
127.0.0.14334 ==> 226 Transfer complete
127.0.0.14334 <== PASV
127.0.0.14334 ==> 227 Entering Passive Mode (127,0,0,1,16,241)
127.0.0.14334 <== RETR /zpt/faq/node1.html
127.0.0.14334 ==> 150 Opening Binary mode data connection for file
'/zpt/faq/node1.html'
[...]

I hope this helps someone ..

Jean