Kenneth Porter
2021-Feb-05 00:41 UTC
[CentOS] Filesystem choice for BackupPC extrenal drive
I'm setting up a CentOS 7 box as a BackupPC 4 server to back up Windows boxes on my LAN. I'm using an external 1.5 TB USB drive for the "pool". BackupPC deduplicates by saving all files in a pool, a directory hiearchy with each file named for the checksum of the file, and the directories acting as a hash tree to reach each pool file. A backup for a specific workstation is a directory tree of checksums and metadata that point into the pool for the actual file data. Incremental backups are reverse deltas from periodic "filled" backups of all files. I'm using rsyncd to pull changed files from the workstations. I'm deciding which filesystem to use for my external drive. I'm thinking the main candidates are ext4 and xfs. What's the best filesystem for this application? <https://github.com/backuppc/backuppc> Repo for CentOS 7 users: <https://copr.fedorainfracloud.org/coprs/hobbes1069/BackupPC/>
Strahil Nikolov
2021-Feb-05 04:32 UTC
[CentOS] Filesystem choice for BackupPC extrenal drive
XFS is suitable for parallel workload, so I would pick ext4 for this case. Here is a quote from?https://access.redhat.com/articles/3129891 : Another way to characterize this is that the Ext4 file system variants tend to perform better on systems that have limited I/O capability. Ext3 and Ext4 perform better on limited bandwidth (<?200MB/s) and up to ~1,000 IOPS capability. For anything with higher capability, XFS tends to be faster.? Best Regards,Strahil Nikolov Sent from Yahoo Mail on Android On Fri, Feb 5, 2021 at 2:42, Kenneth Porter<shiva at sewingwitch.com> wrote: I'm setting up a CentOS 7 box as a BackupPC 4 server to back up Windows boxes on my LAN. I'm using an external 1.5 TB USB drive for the "pool". BackupPC deduplicates by saving all files in a pool, a directory hiearchy with each file named for the checksum of the file, and the directories acting as a hash tree to reach each pool file. A backup for a specific workstation is a directory tree of checksums and metadata that point into the pool for the actual file data. Incremental backups are reverse deltas from periodic "filled" backups of all files. I'm using rsyncd to pull changed files from the workstations. I'm deciding which filesystem to use for my external drive. I'm thinking the main candidates are ext4 and xfs. What's the best filesystem for this application? <https://github.com/backuppc/backuppc> Repo for CentOS 7 users: <https://copr.fedorainfracloud.org/coprs/hobbes1069/BackupPC/> _______________________________________________ CentOS mailing list CentOS at centos.org https://lists.centos.org/mailman/listinfo/centos
Gionatan Danti
2021-Feb-05 07:04 UTC
[CentOS] Filesystem choice for BackupPC extrenal drive
Il 2021-02-05 01:41 Kenneth Porter ha scritto:> I'm setting up a CentOS 7 box as a BackupPC 4 server to back up > Windows boxes on my LAN. I'm using an external 1.5 TB USB drive for > the "pool". BackupPC deduplicates by saving all files in a pool, a > directory hiearchy with each file named for the checksum of the file, > and the directories acting as a hash tree to reach each pool file. A > backup for a specific workstation is a directory tree of checksums and > metadata that point into the pool for the actual file data. > Incremental backups are reverse deltas from periodic "filled" backups > of all files. I'm using rsyncd to pull changed files from the > workstations. > > I'm deciding which filesystem to use for my external drive. I'm > thinking the main candidates are ext4 and xfs. What's the best > filesystem for this application?While being a fan of XFS, for an external drive I would use EXT4. My (anectodal) experience is that EXT3/4 is more resilient to flacky hardware/connection as the one provided my many USB adapters. Regards. -- Danti Gionatan Supporto Tecnico Assyoma S.r.l. - www.assyoma.it email: g.danti at assyoma.it - info at assyoma.it GPG public key ID: FF5F32A8