I am having problems using rsync on cygwin to properly copy the ownership of files from windows to windows. I am running: rsync -avPA //src_addr/some/path /local/dst/path/ Based on: http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html and: http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t2462647.html ENV: CYGWIN=ntsec tty I am running this on Windows Server 2003 R2 SP2 (a DC), the SRC is a Windows XP SP2 domain member. I have tried patching the cygwin rsync source to enable ACL support, and had this confirmed by rsync --version This didn't work so I got rsync-acl-2.6.9.tar.bz2 from: http://mattmccutchen.net/myrsync/ and configured with --enable-acl-support This still does not work. Is what I am trying to do not possible, or am I just doing something wrong? Thanks for any input. -- - havoc
I have also noticed that permissions aren't always copied under windows. I've heard you can use robocopy to do it. I have not because it hasn't been critical to my operation but supposedly, you can use something like ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU After the backup script. This should not copy any files and just copy the file permissions and attributes. Let me know if that helps. BTW, robocopy is part of the windows 2003 resource kit. _____________________________ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail stevezemlicka@gmail.com -----Original Message----- From: rsync-bounces+stevezemlicka=gmail.com@lists.samba.org [mailto:rsync-bounces+stevezemlicka=gmail.com@lists.samba.org] On Behalf Of havoc Sent: Monday, October 01, 2007 9:59 AM To: rsync@lists.samba.org Subject: cygwin rsync windows to windows ACL problem I am having problems using rsync on cygwin to properly copy the ownership of files from windows to windows. I am running: rsync -avPA //src_addr/some/path /local/dst/path/ Based on: http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html and: http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t2462647.h tml ENV: CYGWIN=ntsec tty I am running this on Windows Server 2003 R2 SP2 (a DC), the SRC is a Windows XP SP2 domain member. I have tried patching the cygwin rsync source to enable ACL support, and had this confirmed by rsync --version This didn't work so I got rsync-acl-2.6.9.tar.bz2 from: http://mattmccutchen.net/myrsync/ and configured with --enable-acl-support This still does not work. Is what I am trying to do not possible, or am I just doing something wrong? Thanks for any input. -- - havoc -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
On 10/1/07, havoc <havoc@havoc.org> wrote:> I am having problems using rsync on cygwin to properly copy the > ownership of files from windows to windows. > I am running: rsync -avPA //src_addr/some/path /local/dst/path/ > > Based on: > http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html > and: > http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t2462647.html > > ENV: CYGWIN=ntsec tty > I am running this on Windows Server 2003 R2 SP2 (a DC), the SRC is > a Windows XP SP2 domain member. > I have tried patching the cygwin rsync source to enable ACL support, > and had this confirmed by rsync --version > This didn't work so I got rsync-acl-2.6.9.tar.bz2 from: > http://mattmccutchen.net/myrsync/ > and configured with --enable-acl-support > This still does not work.What incorrect ownership did rsync set on the destination? That might give me a clue what the problem is. Is the receiving rsync running as an administrator so that it has the power to set ownership arbitrarily? (Once it is, you may have to pass --super to make sure it realizes that.) Do you have entries in your Cygwin /etc/passwd and /etc/group (see http://www.cygwin.com/cygwin-ug-net/ntsec.html ) on both sides for all the owners involved? Matt
I don't think so. Let's get terminology out of the way first. The computer sending data is the client and the computer storing the backups is the server. Rsync needs to read the whole file stored on the server to know what data the client needs to send. Since you are only running rsync on the client, the entire file needs to be transmitted from the server to the client, then read and analyzed. Then, a partial transfer may occur. So you can do a partial transfer but before that is possible, the client needs a full transfer from the server to see what it needs to send. _____________________________ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail stevezemlicka@gmail.com -----Original Message----- From: havoc [mailto:havoc@havoc.org] Sent: Monday, October 01, 2007 11:54 AM To: Stephen Zemlicka Subject: Re: cygwin rsync windows to windows ACL problem So even with a mapped drive --partial will have no effect? Is this cygwin/Windows specific behavior (as it does work on linux)? On Monday 01 October 2007, Stephen Zemlicka wrote:> Remember, if you don't have the rsync daemon running on the remote > computer, rsync will transfer whole files anyway. I'm working at getting > around this issue with mapped drives but haven't had a lot of timerecently> to get it ironed out and fully tested. If you are not running rsync onthe> system you are backing up to, rsync will run exactly like robocopy (ie. > with the -W option). > > _____________________________ > Stephen Zemlicka > Integrated Computer Technologies > PH. 608-558-5926 > E-Mail stevezemlicka@gmail.com > > -----Original Message----- > From: rsync-bounces+stevezemlicka=gmail.com@lists.samba.org > [mailto:rsync-bounces+stevezemlicka=gmail.com@lists.samba.org] On BehalfOf> havoc > Sent: Monday, October 01, 2007 11:46 AM > To: rsync@lists.samba.org > Subject: Re: cygwin rsync windows to windows ACL problem > > Yes, mapped drive, "kindof", it's a netbios default share, but essentially > the > same thing. > I am trying to avoid any situation that requires special handling on the > remote (client workstation) side, like additional software to install and > maintain. > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > Yup, that's what I originally intended but I probably wasn't very clear. > > So basically you would add > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > to run after the rsync finishes. > > > > How are you running rsync with no remote daemon running? Mapped drive? > > Why not run the remote daemon, I believe rsync can even initiate the > > remote > > > daemon from the client side if you want. (hopefully my terminology is > > correct there) > > > > _____________________________ > > Stephen Zemlicka > > Integrated Computer Technologies > > PH. 608-558-5926 > > E-Mail stevezemlicka@gmail.com > > > > -----Original Message----- > > From: rsync-bounces+stevezemlicka=gmail.com@lists.samba.org > > [mailto:rsync-bounces+stevezemlicka=gmail.com@lists.samba.org] On Behalf > > Of > > > havoc > > Sent: Monday, October 01, 2007 11:28 AM > > To: rsync@lists.samba.org > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > Intriguing, you're saying to use rsync to copy/sync the data, the use > > robocopy > > to only recursively set permissions? Robocopy can do this without > > transferring data? > > I haven't finished reading all about it yet, but have started with: > > http://en.wikipedia.org/wiki/Robocopy > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > I have synced terabytes of data across DSL connections using robocopy > > > with no problem. Robocopy is just as fast as rsync on whole files and > > > I find > > > > it > > > > > to be even faster on folders with large numbers of small files (though > > > I hear the next release of rsync is supposed to speed that up). > > > > > > However, if you must use rsync, you can still use the robocopy that I > > > specified earlier. Rsync would be responsible for all the filecopying> > > > and > > > > > robocopy would be responsible for only the attributes and permissions. > > > Since rsync is a *nix utility, I doubt much effort will be put into > > > compatibility with windows permissions. > > > > > > _____________________________ > > > Stephen Zemlicka > > > Integrated Computer Technologies > > > PH. 608-558-5926 > > > E-Mail stevezemlicka@gmail.com > > > > > > -----Original Message----- > > > From: rsync-bounces+stevezemlicka=gmail.com@lists.samba.org > > > [mailto:rsync-bounces+stevezemlicka=gmail.com@lists.samba.org] On > > > Behalf > > > > Of > > > > > havoc > > > Sent: Monday, October 01, 2007 11:00 AM > > > To: rsync@lists.samba.org > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > Unfortunately I don't think it will work. > > > We have two offices in the same corporate park connected by an > > unreliable > > > > radio backhaul, and several terabytes of data to sync daily, hence my > > > desire > > > > > > to get rsync working :( > > > > > > PS: I will definitely check out robocopy for other uses, thank you :) > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > Robocopy does copy only the new or changed files. However it does > > copy > > > > the > > > > > > > whole files (similar to the -W switch in rsync). I use robocopy > > > > whenever > > > > > I > > > > > > > already have a secure connection (VPN) or when my backups don't > > include > > > > > large (multi GB) database files. To see if robocopy will work by > > > > itself for you, add the -W switch and see if that's acceptable. > > > > It'll take a bit longer for changed files but will be just as fast > > > > for new files. > > > > > > > > _____________________________ > > > > Stephen Zemlicka > > > > Integrated Computer Technologies > > > > PH. 608-558-5926 > > > > E-Mail stevezemlicka@gmail.com > > > > -----Original Message----- > > > > From: rsync-bounces+stevezemlicka=gmail.com@lists.samba.org > > > > [mailto:rsync-bounces+stevezemlicka=gmail.com@lists.samba.org] On > > > > Behalf > > > > > > Of > > > > > > > havoc > > > > Sent: Monday, October 01, 2007 10:50 AM > > > > To: rsync@lists.samba.org > > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > > > Does robocopy handle partial transfers, and backups of changed > > > > deleted files? > > > > My reason for wanting rsync is to maintain a mirror, and accomplish > > > > incremental backups via --backup --backup-dir=<blah> with rsync. > > > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > > I have also noticed that permissions aren't always copied under > > > > > windows. I've heard you can use robocopy to do it. I have not > > > > > because it hasn't been critical to my operation but supposedly,you> > > > > can use something like > > > > > > > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > > > > > > > After the backup script. This should not copy any files and just > > > > > copy the file permissions and attributes. Let me know if that > > helps. > > > > > > BTW, robocopy is part of the windows 2003 resource kit. > > > > > > > > > > _____________________________ > > > > > Stephen Zemlicka > > > > > Integrated Computer Technologies > > > > > PH. 608-558-5926 > > > > > E-Mail stevezemlicka@gmail.com > > > > > -----Original Message----- > > > > > From: rsync-bounces+stevezemlicka=gmail.com@lists.samba.org > > > > > [mailto:rsync-bounces+stevezemlicka=gmail.com@lists.samba.org] On > > > > > Behalf > > > > > > > > Of > > > > > > > > > havoc > > > > > Sent: Monday, October 01, 2007 9:59 AM > > > > > To: rsync@lists.samba.org > > > > > Subject: cygwin rsync windows to windows ACL problem > > > > > > > > > > I am having problems using rsync on cygwin to properly copy the > > > > > ownership of files from windows to windows. > > > > > I am running: rsync -avPA //src_addr/some/path /local/dst/path/ > > > > > > > > > > Based on: > > > > > http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html > > > > > and: > >http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t2462647.> > > > > >h tml > > > > > > > > > > ENV: CYGWIN=ntsec tty > > > > > I am running this on Windows Server 2003 R2 SP2 (a DC), the SRC is > > > > > a Windows XP SP2 domain member. > > > > > I have tried patching the cygwin rsync source to enable ACL > > > > > support, and had this confirmed by rsync --version > > > > > This didn't work so I got rsync-acl-2.6.9.tar.bz2 from: > > > > > http://mattmccutchen.net/myrsync/ > > > > > and configured with --enable-acl-support > > > > > This still does not work. Is what I am trying to do not possible, > > > > > or am I just doing something wrong? > > > > > > > > > > Thanks for any input. > > > > > > > > > > -- > > > > > > > > > > - havoc > > > > > > > > -- > > > > > > > > - havoc > > > > > > -- > > > > > > - havoc > > > > -- > > > > - havoc > > -- > > - havoc-- - havoc
Ah, yes, was a terminology mismatch, I understand now. On Monday 01 October 2007, Stephen Zemlicka wrote:> I don't think so. Let's get terminology out of the way first. The > computer sending data is the client and the computer storing the backups is > the server. Rsync needs to read the whole file stored on the server to > know what data the client needs to send. Since you are only running rsync > on the client, the entire file needs to be transmitted from the server to > the client, then read and analyzed. Then, a partial transfer may occur. > So you can do a partial transfer but before that is possible, the client > needs a full transfer from the server to see what it needs to send. > > _____________________________ > Stephen Zemlicka > Integrated Computer Technologies > PH. 608-558-5926 > E-Mail stevezemlicka@gmail.com > > -----Original Message----- > From: havoc [mailto:havoc@havoc.org] > Sent: Monday, October 01, 2007 11:54 AM > To: Stephen Zemlicka > Subject: Re: cygwin rsync windows to windows ACL problem > > So even with a mapped drive --partial will have no effect? > Is this cygwin/Windows specific behavior (as it does work on linux)? > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > Remember, if you don't have the rsync daemon running on the remote > > computer, rsync will transfer whole files anyway. I'm working at getting > > around this issue with mapped drives but haven't had a lot of time > > recently > > > to get it ironed out and fully tested. If you are not running rsync on > > the > > > system you are backing up to, rsync will run exactly like robocopy (ie. > > with the -W option). > > > > _____________________________ > > Stephen Zemlicka > > Integrated Computer Technologies > > PH. 608-558-5926 > > E-Mail stevezemlicka@gmail.com > > > > -----Original Message----- > > From: rsync-bounces+stevezemlicka=gmail.com@lists.samba.org > > [mailto:rsync-bounces+stevezemlicka=gmail.com@lists.samba.org] On Behalf > > Of > > > havoc > > Sent: Monday, October 01, 2007 11:46 AM > > To: rsync@lists.samba.org > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > Yes, mapped drive, "kindof", it's a netbios default share, but > > essentially the > > same thing. > > I am trying to avoid any situation that requires special handling on the > > remote (client workstation) side, like additional software to install and > > maintain. > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > Yup, that's what I originally intended but I probably wasn't very > > > clear. So basically you would add > > > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > > > to run after the rsync finishes. > > > > > > How are you running rsync with no remote daemon running? Mapped drive? > > > Why not run the remote daemon, I believe rsync can even initiate the > > > > remote > > > > > daemon from the client side if you want. (hopefully my terminology is > > > correct there) > > > > > > _____________________________ > > > Stephen Zemlicka > > > Integrated Computer Technologies > > > PH. 608-558-5926 > > > E-Mail stevezemlicka@gmail.com > > > > > > -----Original Message----- > > > From: rsync-bounces+stevezemlicka=gmail.com@lists.samba.org > > > [mailto:rsync-bounces+stevezemlicka=gmail.com@lists.samba.org] On > > > Behalf > > > > Of > > > > > havoc > > > Sent: Monday, October 01, 2007 11:28 AM > > > To: rsync@lists.samba.org > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > Intriguing, you're saying to use rsync to copy/sync the data, the use > > > robocopy > > > to only recursively set permissions? Robocopy can do this without > > > transferring data? > > > I haven't finished reading all about it yet, but have started with: > > > http://en.wikipedia.org/wiki/Robocopy > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > I have synced terabytes of data across DSL connections using robocopy > > > > with no problem. Robocopy is just as fast as rsync on whole files > > > > and I find > > > > > > it > > > > > > > to be even faster on folders with large numbers of small files > > > > (though I hear the next release of rsync is supposed to speed that > > > > up). > > > > > > > > However, if you must use rsync, you can still use the robocopy that I > > > > specified earlier. Rsync would be responsible for all the file > > copying > > > > and > > > > > > > robocopy would be responsible for only the attributes and > > > > permissions. Since rsync is a *nix utility, I doubt much effort will > > > > be put into compatibility with windows permissions. > > > > > > > > _____________________________ > > > > Stephen Zemlicka > > > > Integrated Computer Technologies > > > > PH. 608-558-5926 > > > > E-Mail stevezemlicka@gmail.com > > > > > > > > -----Original Message----- > > > > From: rsync-bounces+stevezemlicka=gmail.com@lists.samba.org > > > > [mailto:rsync-bounces+stevezemlicka=gmail.com@lists.samba.org] On > > > > Behalf > > > > > > Of > > > > > > > havoc > > > > Sent: Monday, October 01, 2007 11:00 AM > > > > To: rsync@lists.samba.org > > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > > > Unfortunately I don't think it will work. > > > > We have two offices in the same corporate park connected by an > > > > unreliable > > > > > > radio backhaul, and several terabytes of data to sync daily, hence my > > > > desire > > > > > > > > to get rsync working :( > > > > > > > > PS: I will definitely check out robocopy for other uses, thank you :) > > > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > > Robocopy does copy only the new or changed files. However it does > > > > copy > > > > > > the > > > > > > > > > whole files (similar to the -W switch in rsync). I use robocopy > > > > > > whenever > > > > > > > I > > > > > > > > > already have a secure connection (VPN) or when my backups don't > > > > include > > > > > > > large (multi GB) database files. To see if robocopy will work by > > > > > itself for you, add the -W switch and see if that's acceptable. > > > > > It'll take a bit longer for changed files but will be just as fast > > > > > for new files. > > > > > > > > > > _____________________________ > > > > > Stephen Zemlicka > > > > > Integrated Computer Technologies > > > > > PH. 608-558-5926 > > > > > E-Mail stevezemlicka@gmail.com > > > > > -----Original Message----- > > > > > From: rsync-bounces+stevezemlicka=gmail.com@lists.samba.org > > > > > [mailto:rsync-bounces+stevezemlicka=gmail.com@lists.samba.org] On > > > > > Behalf > > > > > > > > Of > > > > > > > > > havoc > > > > > Sent: Monday, October 01, 2007 10:50 AM > > > > > To: rsync@lists.samba.org > > > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > > > > > Does robocopy handle partial transfers, and backups of changed > > > > > deleted files? > > > > > My reason for wanting rsync is to maintain a mirror, and accomplish > > > > > incremental backups via --backup --backup-dir=<blah> with rsync. > > > > > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > > > I have also noticed that permissions aren't always copied under > > > > > > windows. I've heard you can use robocopy to do it. I have not > > > > > > because it hasn't been critical to my operation but supposedly, > > you > > > > > > > can use something like > > > > > > > > > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > > > > > > > > > After the backup script. This should not copy any files and just > > > > > > copy the file permissions and attributes. Let me know if that > > > > helps. > > > > > > > > BTW, robocopy is part of the windows 2003 resource kit. > > > > > > > > > > > > _____________________________ > > > > > > Stephen Zemlicka > > > > > > Integrated Computer Technologies > > > > > > PH. 608-558-5926 > > > > > > E-Mail stevezemlicka@gmail.com > > > > > > -----Original Message----- > > > > > > From: rsync-bounces+stevezemlicka=gmail.com@lists.samba.org > > > > > > [mailto:rsync-bounces+stevezemlicka=gmail.com@lists.samba.org] On > > > > > > Behalf > > > > > > > > > > Of > > > > > > > > > > > havoc > > > > > > Sent: Monday, October 01, 2007 9:59 AM > > > > > > To: rsync@lists.samba.org > > > > > > Subject: cygwin rsync windows to windows ACL problem > > > > > > > > > > > > I am having problems using rsync on cygwin to properly copy the > > > > > > ownership of files from windows to windows. > > > > > > I am running: rsync -avPA //src_addr/some/path /local/dst/path/ > > > > > > > > > > > > Based on: > > > > > > http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html > > > > > > and: > > http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t2462647. > > > > > > >h tml > > > > > > > > > > > > ENV: CYGWIN=ntsec tty > > > > > > I am running this on Windows Server 2003 R2 SP2 (a DC), the SRC > > > > > > is a Windows XP SP2 domain member. > > > > > > I have tried patching the cygwin rsync source to enable ACL > > > > > > support, and had this confirmed by rsync --version > > > > > > This didn't work so I got rsync-acl-2.6.9.tar.bz2 from: > > > > > > http://mattmccutchen.net/myrsync/ > > > > > > and configured with --enable-acl-support > > > > > > This still does not work. Is what I am trying to do not > > > > > > possible, or am I just doing something wrong? > > > > > > > > > > > > Thanks for any input. > > > > > > > > > > > > -- > > > > > > > > > > > > - havoc > > > > > > > > > > -- > > > > > > > > > > - havoc > > > > > > > > -- > > > > > > > > - havoc > > > > > > -- > > > > > > - havoc > > > > -- > > > > - havoc-- - havoc