I've a small system that I use to support a number of churches. I provide web and email for them. My current server is running CentOS 6.3 with paired 1TB drives in a RAID1 configuration. It works well. One filesystem is very large, >500GB, and contains numerous large files: SQL, docs, church libraries in ebook and digital form, plus stored videos of church services. My problem is that I've found no means of backing up that file system. Dump and tar both error out as exceeding the maximum size. Neither will backup just the video directory (the largest) even with compression. Backup will be to an external (USB) removable HD. Can any suggest a prog or a method to back up this filesystem? mw -- -- "Lose not thy airspeed, lest the ground rises up and smites thee." -- William Kershner http://crucis-court.com http://www.crucis.net/1632search
On Mon, 27 May 2013 13:13:30 -0500 Mike Watson wrote:> Can any suggest a prog or a method to back up this filesystem?rsync -- MELVILLE THEATRE ~ Real D 3D Digital Cinema ~ www.melvilletheatre.com
On 27.05.2013 19:13, Mike Watson wrote:> I've a small system that I use to support a number of churches. I > provide web and email for them. My current server is running CentOS > 6.3 > with paired 1TB drives in a RAID1 configuration. It works well. One > filesystem is very large, >500GB, and contains numerous large files: > SQL, docs, church libraries in ebook and digital form, plus stored > videos of church services. > > My problem is that I've found no means of backing up that file system. > Dump and tar both error out as exceeding the maximum size. Neither > will > backup just the video directory (the largest) even with compression. > > Backup will be to an external (USB) removable HD. > > Can any suggest a prog or a method to back up this filesystem?Have you tried good old rsync? Or, if you want incremental backups, check rdiff-backup. I'm sure our list colleagues will come up with even more solutions. -- Sent from the Delta quadrant using Borg technology! Nux! www.nux.ro
On 05/27/2013 01:13 PM, Mike Watson wrote:> Backup will be to an external (USB) removable HD.What file system is on that external HD? FAT32 has a 4GB limit for file size. -- Bob Nichols "NOSPAM" is really part of my email address. Do NOT delete it.
On 2013-05-27, Mike Watson <mikew at crucis.net> wrote:> I've a small system that I use to support a number of churches. I > provide web and email for them. My current server is running CentOS 6.3 > with paired 1TB drives in a RAID1 configuration. It works well. One > filesystem is very large, >500GB, and contains numerous large files: > SQL, docs, church libraries in ebook and digital form, plus stored > videos of church services. > > Backup will be to an external (USB) removable HD. > > Can any suggest a prog or a method to back up this filesystem?People have already suggested rsync and rdiff-backup; there's also rsnapshot which is built on top of rsync. Another option could be mdadm if your RAID1 is already an mdadm array. You can add your USB drive to the array, wait for it to rebuild, then remove it from the array. I'd be wary of backing up an SQL database in that way, but I'd be wary of using rsync, dump, or tar too, so be sure to take a real backup (e.g., mysqldump, pg_dump) of your database first. --keith -- kkeller at wombat.san-francisco.ca.us
On 05/27/2013 02:13 PM, Mike Watson wrote:> I've a small system that I use to support a number of churches. I > provide web and email for them. My current server is running CentOS 6.3 > with paired 1TB drives in a RAID1 configuration. It works well. One > filesystem is very large, >500GB, and contains numerous large files: > SQL, docs, church libraries in ebook and digital form, plus stored > videos of church services. > > My problem is that I've found no means of backing up that file system. > Dump and tar both error out as exceeding the maximum size. Neither will > backup just the video directory (the largest) even with compression. > > Backup will be to an external (USB) removable HD. > > Can any suggest a prog or a method to back up this filesystem? > > mw >I use rsync to make a daily back up of my data on a second drive that is not normally mounted except when the backup is running. The drive is inside the same box so this backup is still subject to loss if the box is stolen or destroyed. I really should be backing up to an off site location. If you have a fire, flood, or other general disaster your local backup on an external drive isn't going to buy you anything unless you store the external drive off site. -- _ ?v? /(_)\ ^ ^ Mark LaPierre Registered Linux user No #267004 https://linuxcounter.net/ ****
On 5/27/2013 11:13 AM, Mike Watson wrote:> One > filesystem is very large, >500GB, and contains numerous large files: > SQL, docs, church libraries in ebook and digital form, plus stored > videos of church services.note that SQL database files generally can't be backed up safely while the SQL database server is active. either take a 'dump' or whatever backup of the database, and backup that dump rather than the raw SQL files, or stop the SQL service before making the backup, then restart it afterwards. Details vary per SQL server, of course. what would work really well for your general backup requirements, ignoring the above issue, is BackupPC. build an onsite backupPC server with a file system sufficiently large to hold all backups you want kept online (I generally do 2 weeks of incrementals), and setup BackupPC archiving to move copies of completed backups to an offsite repository for disaster recovery. -- john r pierce 37N 122W somewhere on the middle of the left coast