I need to rsync 4 TB datafiles to remote server and clone to a new oracle database..I have about 40 drives that contains this 4 TB data. I would like to do rsync from a directory level by using --files-from=FILE option. But the problem is what will happen if the network connection fails the whole rsync will fail right. rsync -a srchost:/ / --files-from=dbf-list and dbf-list would contain this: p02/oradata/OSID/redo01.log p03/oradata/OSID/redo02.log p04/oradata/OSID/redo03.log p01/oradata/OSID/system01.dbf p04/oradata/OSID/undotbs01.dbf p03/oradata/OSID/sysaux01.dbf p03/oradata/OSID/users01.dbf p03/oradata/OSID/example01.dbf p03/oradata/OSID/data01.dbf p02/oradata/OSID/index01.dbf p01/oradata/OSID/control01.ctl p02/oradata/OSID/control02.ctl p03/oradata/OSID/control03.ctl s01/oracle/product/10.2.0/dbs/initOSID.ora One advantage that I have if do rsync file by file is if the network connection fails for a quite sometime and comes back alive the rsync will continue from the next file in the list while it will fail on the other files when connection is lost. rsync -vz /p02/oradata/OSID/redo01.log destser:/d02/oradata/OSID/redo01.log rsync -vz /p03/oradata/OSID/redo02.log destser:/d03/oradata/OSID/redo02.log rsync -vz /p04/oradata/OSID/redo03.log destser:/d04/oradata/OSID/redo03.log rsync -vz /p01/oradata/OSID/system01.dbf destser:/d01/oradata/OSID/system01.dbf rsync -vz /p04/oradata/OSID/undotbs01.dbf destser:/d04/oradata/OSID/undotbs01.dbf rsync -vz /p03/oradata/OSID/sysaux01.dbf destser:/d03/oradata/OSID/sysaux01.dbf rsync -vz /p03/oradata/OSID/users01.dbf destser:/d03/oradata/OSID/users01.dbf rsync -vz /p03/oradata/OSID/example01.dbf destser:/d03/oradata/OSID/example01.dbf rsync -vz /p03/oradata/OSID/data01.dbf destser:/d03/oradata/OSID/data01.dbf rsync -vz /p02/oradata/OSID/index01.dbf destser:/d02/oradata/OSID/index01.dbf rsync -vz /p01/oradata/OSID/control01.ctl destser:/d01/oradata/OSID/control01.ctl rsync -vz /p02/oradata/OSID/control02.ctl destser:/d02/oradata/OSID/control02.ctl rsync -vz /p03/oradata/OSID/control03.ctl destser:/d03/oradata/OSID/control03.ctl rsync -vz /s01/oracle/product/10.2.0/dbs/initOSID.ora destser:/d01/oracle/droduct/10.2.0/dbs/initOSID.ora I don't know how it would work if we do rsync with the files--from option ? Also rsync gurus would you suggest which is the fastest way to trasfer this 4 TB data ? Any suggestions...would be of great help. Thanks, lsk. -- View this message in context: http://www.nabble.com/Rsync-4TB-datafiles...--t1318624.html#a3516542 Sent from the Samba - rsync forum at Nabble.com.
On Tue 21 Mar 2006, lsk wrote:> I don't know how it would work if we do rsync with the files--from option ?I'm not sure how rsync behaves when confronted with a network problem during a session, so I won't give an answer to that. However, doing individual files sounds reasonable, so make it a loop: < dbf-list while read filename; do rsync -vz $filename destser:$filename done> Also rsync gurus would you suggest which is the fastest way to trasfer this > 4 TB data ? Any suggestions...would be of great help.I'd recommend doing --inplace, as chances are that data won't move within a file with oracle data files (so it's not useful to try to find moved data), and copying the 4TB to temp. files every time could become a big timewaster. Also the -t option could be handy, not all files change all the time IIRC. As always, get the latest version. Paul Slootman
Also I use the rsync version "rsync version 2.6.5 protocol version 29" does>this version include this patch "dynamic_hash.diff"" or do we need to >install it seperately. > >Sorry. You will need to get the 2.6.7 sources, and then apply the patch yourself and compile rsync. Please do report back here your results. This patch is a result of a lot of theoretical work, but we never got any actual feedback on it. Shachar -- ////***Hello Shachar...is 2.6.7 is the latest version of rsync. I could see in the http download site it says "rsync-2.6.8.tar.gz". Should I get this version 2.6.8 + the patch "dynamic_hash.diff". Also I am planning to install in only the sending machine...and first try out. Thanks for your feedback. lsk. -- View this message in context: http://www.nabble.com/Rsync-4TB-datafiles...--t1318624.html#a4180739 Sent from the Samba - rsync forum at Nabble.com.
On Tue, 2006-05-02 at 13:06 -0700, lsk wrote:> //***Shachar is "Dynamic_hash.diff" in built in 2.6.8 code version or still > I need to apply that as a seperate patch after I install rsync 2.6.8 ?You need to apply it as a separate patch _before you build_ rsync 2.6.8. Apply the patch by running patch -p1 <patches/dynamic_hash.diff in the source tree. Then configure, make, and install. Matt