rsync - Oct 2009 - rsync file corruption when destination is a SAN LUN (Solaris 9 & 10)

I have run into a problem using 'rsync' to copy files from local disk  
to a SAN mounted LUN / file-system.
The 'rsync' seems to run fine and it reports no errors, but some  
files are corrupted (check-sums don't match originals,
and file data is changed).

So far, I have found this problem on both Solaris 9 and Solaris 10  
OSes and on several different models of
Sparc systems using different versions of 'rsync' (2.6.8, 3.0.2, and  
3.0.6).  All of these systems are using
QLogic HBAs and connect to QLogic FC switches and the SAN storage is  
on Sun/StorageTek arrays.

My quick example of the problem:

	SAN mounted LUN / file-system == /apps
	local disk has OS & system files  == /

		mkdir /apps/junk

		rsync -avcHS /sbin/. /apps/junk/.
			<no errors reported>
			<no errors reported in system logs>

	then immediately do the same 'rsync' again

		rsync -avcHS /sbin/. /apps/junk/.

	it finds 2-3 files where the check-sums don't match and it re-copies
	them.  And if I do a 3rd 'rsync', it re-copies the same 2-3 files.

If I don't use the "sparse files" option, "-S", the
copies are
successful and the data matches
between the original files and the 'rsync'-ed copies.  But I need to  
use the sparse files processing for the
files that I need to copy.

I do not see this problem if the 'rsync'-s are from:
	-	local-disk to local-disk
	-	local-disk to NFS file-system
	-	NFS file-system to local-disk

What other data would be useful to debug this problem?


====Terry Countryman
terry.countryman at oit.gatech.edu

rsync definitely works on sans with Solaris 9/10. I've used it that
way very intensively, both remotely to and from the san via ssh and
also local disks to san and san to local disks.

Are you sure something else isn't modifying your files in the mean time?

Run something like:
find /path/to/files -ls > /tmp/post_first
immediately after the first rsync run and immediately before the second:
find /path/to/files -ls > /tmp/pre_second

diff /tmp/{post_first,pre_second}

Get any output?


Cheers,
Dave

2009/10/2 Terry Countryman <terry.countryman at
oit.gatech.edu>:
> I have run into a problem using 'rsync' to copy files from local
disk to a
> SAN mounted LUN / file-system.
> The 'rsync' seems to run fine and it reports no errors, but some
files are
> corrupted (check-sums don't match originals,
> and file data is changed).
>
> So far, I have found this problem on both Solaris 9 and Solaris 10 OSes and
> on several different models of
> Sparc systems using different versions of 'rsync' (2.6.8, 3.0.2,
and 3.0.6).
> ?All of these systems are using
> QLogic HBAs and connect to QLogic FC switches and the SAN storage is on
> Sun/StorageTek arrays.
>
> My quick example of the problem:
>
> ? ? ? ?SAN mounted LUN / file-system == /apps
> ? ? ? ?local disk has OS & system files ?== /
>
> ? ? ? ? ? ? ? ?mkdir /apps/junk
>
> ? ? ? ? ? ? ? ?rsync -avcHS /sbin/. /apps/junk/.
> ? ? ? ? ? ? ? ? ? ? ? ?<no errors reported>
> ? ? ? ? ? ? ? ? ? ? ? ?<no errors reported in system logs>
>
> ? ? ? ?then immediately do the same 'rsync' again
>
> ? ? ? ? ? ? ? ?rsync -avcHS /sbin/. /apps/junk/.
>
> ? ? ? ?it finds 2-3 files where the check-sums don't match and it
re-copies
> ? ? ? ?them. ?And if I do a 3rd 'rsync', it re-copies the same 2-3
files.
>
> If I don't use the "sparse files" option, "-S", the
copies are successful
> and the data matches
> between the original files and the 'rsync'-ed copies. ?But I need
to use the
> sparse files processing for the
> files that I need to copy.
>
> I do not see this problem if the 'rsync'-s are from:
> ? ? ? ?- ? ? ? local-disk to local-disk
> ? ? ? ?- ? ? ? local-disk to NFS file-system
> ? ? ? ?- ? ? ? NFS file-system to local-disk
>
> What other data would be useful to debug this problem?
>
>
> ====> Terry Countryman
> terry.countryman at oit.gatech.edu
> --
> Please use reply-all for most replies to avoid omitting the mailing list.
> To unsubscribe or change options:
> https://lists.samba.org/mailman/listinfo/rsync
> Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
>