samba-bugs at samba.org
2010-Jul-12 20:02 UTC
DO NOT REPLY [Bug 2094] Keep the last-sync time for better two-way synchronization
https://bugzilla.samba.org/show_bug.cgi?id=2094 matt at mattmccutchen.net changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |baya at rodovid.org ------- Comment #2 from matt at mattmccutchen.net 2010-07-12 15:02 CST ------- *** Bug 7565 has been marked as a duplicate of this bug. *** -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are the QA contact for the bug, or are watching the QA contact.
samba-bugs at samba.org
2010-Jul-13 13:26 UTC
DO NOT REPLY [Bug 2094] Keep the last-sync time for better two-way synchronization
https://bugzilla.samba.org/show_bug.cgi?id=2094 ------- Comment #3 from baya at rodovid.org 2010-07-13 08:26 CST ------- (In reply to comment #2)> *** Bug 7565 has been marked as a duplicate of this bug. *** >sorry, I missed this request (( as concerns unison. At least "the Unix owner and group ids are not propagated" by Unison. So Unison can't be used for master-master replication of the whole slices or directories by root. As concerns Wayne Davison comment. Of course, full replication in real time using events between two servers would be the best choice (maybe in the future it will become possible with rsync ;) ). But when we set the last-sync-time===check-point just before the synchronization process we do not depend on the "updates made during the transfer time". These new updates will be synchronized the next time. Modifying the same file on both _master_ sides can occur very rarely and even in this case we mostly need only a new version, so a simple overriding will be enough (of course this should be "a note" for users). currently just with --check-point and small bash script (I will attach it to bug 7565) I use it for bidirectional synchronization with small disadvantage - the old directories are deleted within 2 or 3 runs (depends on which side its deleted initially). PS. of course adding comparison of the item with check-point into rsync code directly in the procedure of the file list checking will avoid running rcync twice. It is not so easy for me to write it right now, since it needs changes the direction of transfer during the file list checking. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are the QA contact for the bug, or are watching the QA contact.
samba-bugs at samba.org
2010-Jul-14 04:17 UTC
DO NOT REPLY [Bug 2094] Keep the last-sync time for better two-way synchronization
https://bugzilla.samba.org/show_bug.cgi?id=2094 ------- Comment #4 from matt at mattmccutchen.net 2010-07-13 23:17 CST ------- Created an attachment (id=5844) --> (https://bugzilla.samba.org/attachment.cgi?id=5844&action=view) Original design document The link in comment #0 is long since broken. For reference, I'm attaching the design document that was previously there. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are the QA contact for the bug, or are watching the QA contact.
samba-bugs at samba.org
2010-Jul-14 11:16 UTC
DO NOT REPLY [Bug 2094] Keep the last-sync time for better two-way synchronization
https://bugzilla.samba.org/show_bug.cgi?id=2094 ------- Comment #5 from baya at rodovid.org 2010-07-14 06:16 CST ------- (In reply to comment #4)> Created an attachment (id=5844)--> (https://bugzilla.samba.org/attachment.cgi?id=5844&action=view) [details]> Original design document > > The link in comment #0 is long since broken. For reference, I'm attaching the > design document that was previously there. >Thank you, Matt, it is just more than my proposal ))) To the purpose: 1) the main point is that the last-sync-time===check-point must be created BEFORE the synchronization process. So the deletion during the update will be synchronized next time. In other cases we will have "mysteriously coming back" deletions (that occur during update). 2) --smart-orphans option is ambiguous and even dangerous: a) last-sync-time is equal check-point + dry-run b) last-sync-time + smart-orphans is equal check-point VERY IMPORTANT NOTE: never increase the check-point value during any dry-runs, never increase check-point value if synchronization is not finished without errors - many new files will be deleted instead of being added. For the details look at bash wrapper attached to bug 7565. Also see notes at my PS for avoiding running rcync twice. In my situation updating with small changes takes 3 - 5 minutes for 300MB. And this is just a testcase, I'm going to mirror ~10G. Additional check must be added before moving tmp file to the original position, because the file at the original position can be updated or deleted during the long receiving, so it will be newer than received or not needed already. By the way, at first run check_point can be 0 (zero), which means that no deletions occur. Just no-exists files will be added to another side. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are the QA contact for the bug, or are watching the QA contact.
Seemingly Similar Threads
- DO NOT REPLY [Bug 7565] New: --check-point=<TIME> +options.c.patch +generator.c.patch
- [Bug 2094] Keep the last-sync time for better two-way synchronization
- Best practice for sieve script synchronization
- two way synchronization with rsync?
- Implementing a conditional branch within rsync based on modified time of a file