aurfalien at gmail.com
2011-Jan-21 19:30 UTC
[CentOS] rsync via crontab spawns over 20 processes
Hi all, I've been running rsync via cron for a while now and all is well. However on one particular new 5.5 box, whenever its runs via crontab, the machine ends up with over 20 rsync processes and a load of ~14 and eventually the machine dies. But when running manually, I see it spawn 3 processes with a load of 1.5. My rsync command is simply; rsync --delete -avvH --progress source target Any thoughts? - aurf
On 1/21/2011 2:30 PM, aurfalien at gmail.com wrote:> Hi all, > > I've been running rsync via cron for a while now and all is well. > > However on one particular new 5.5 box, whenever its runs via crontab, > the machine ends up with over 20 rsync processes and a load of ~14 and > eventually the machine dies. > > But when running manually, I see it spawn 3 processes with a load of > 1.5. > > My rsync command is simply; > > rsync --delete -avvH --progress source target > > Any thoughts?How long does the rsync take to complete when you run it manually? How often does cron run the command? -- Bowie
On 1/21/2011 1:30 PM, aurfalien at gmail.com wrote:> Hi all, > > I've been running rsync via cron for a while now and all is well. > > However on one particular new 5.5 box, whenever its runs via crontab, > the machine ends up with over 20 rsync processes and a load of ~14 and > eventually the machine dies. > > But when running manually, I see it spawn 3 processes with a load of > 1.5. > > My rsync command is simply; > > rsync --delete -avvH --progress source target > > Any thoughts?It sounds like it is not completing one run before the next one starts. If you have a lot of hardlinks, the -H option can make things slower than you would expect. -- Les Mikesell lesmikesell at gmail.com