Andrew Gideon
2010-May-20 23:38 UTC
Speeding rsync via externalities like file system choice
Using rsync --link-dest, I end up with a file system that has a relatively large number of directory entries but relatively small number of inodes. Copying this volume takes hours...far more than other volumes of similar size. I blame the much larger amount of directory traversal (and comparisons between source and destination) that are occurring. I'm using ext3, but I'm not wed to it. Is there a different file system that would speed the process? The one somewhat unusual requirement is that this must support ACLs. Is there anything else I could do to speed these rsync operations? Thanks... Andrew
Andrew Gideon
2010-May-21 18:51 UTC
Speeding rsync via externalities like file system choice
On Thu, 20 May 2010 23:38:24 +0000, Andrew Gideon wrote:> Copying this volume takes hours...far more than other volumes of similar > size. I blame the much larger amount of directory traversal (and > comparisons between source and destination) that are occurring.BTW, running a trace on this shows a huge amount of time spent on: lstat64(...)=ENOENT link(...)=0 for different files. It's not that these are slow, but there are so many of these! - Andrew
Maybe Matching Threads
- rsync --link-dest and --files-from lead by a "change list" from some file system audit tool (Was: Re: cut-off time for rsync ?)
- Problem with Share Size
- ogg123
- rsync --link-dest and --files-from lead by a "change list" from some file system audit tool (Was: Re: cut-off time for rsync ?)
- rsync --link-dest and --files-from lead by a "change list" from some file system audit tool (Was: Re: cut-off time for rsync ?)