Displaying 20 results from an estimated 6000 matches similar to: "RSync with File Compression"
2003 Jul 28
2
compression and encryption
Hello folks!
I've been thinking about adding the capability to store files compressed
and/or encrypted on either side of the rsync transfer. Let's say there's
a storage space provider. I want to store my files on that server
compressed (so I don't use more paid space than I need), and encrypted
(so they can't read my data).
I don't know much about encryption, but I
2009 Jan 19
5
file compression on target side
Hello All,
I have been using rsync to backup several filesystems by using Mike
Rubel's hard link method
(http://www.mikerubel.org/computers/rsync_snapshots/).
The problem is, I am backing up a lot of ASCII .log, csv, and .txt
files. These files are large and can range anywhere from 1GB to 30GB.
I was wondering if on the target side (the backup side), if I can use
some sort of compression. I
2003 May 10
3
benchmarking rsync's -z compression utility
Hi,
Is there a way in which rsync's -z compression (zlib) utility can be
benchmarked?
I'm trying to compare the compression ratio between rsync and external
compression tools like gzip and bzip2.
Are there any advantages to using rsync's internal compression mechanism
specified with the -z option compared to solely applying external
compression i.e. bzip2 to the files and invoking
2015 Apr 09
3
rsync error: error allocating core memory buffers
Hi,
I've configured 'backuppc' to transfer files via rsyncd, with enabled
checksums. Whith one of the shares I get the error (in syslog):
---------------------------------------------------------------------
robbe rsyncd[2183]: ERROR: out of memory in receive_sums [sender]
robbe rsyncd[2183]: rsync error: error allocating core memory buffers
(code 22) at util2.c(106)
2005 Feb 13
2
Rsync friendly zlib/gzip compression - revisited
Hi, all -
I've been digging into the question of using rsync to sync up compressed data, and read with interest the conversations regarding the rsync friendly patch available for gzip (I belive Rusty provided this patch). For anyone interested, the message thread is archived at http://lists.samba.org/archive/rsync/2002-June/thread.html. The broad outline of this approach were mentioned in
2003 Aug 28
1
Fw: Re: GZIP, ZIP, ISO, RPM files and rsync, tar, cpio
On Thu, Aug 28, 2003 at 12:51:16PM +0300, Sviatoslav Sviridov/Lintec Project wrote:
>
> Sorry for direct reply, but mail server at samba.org blocks my messages.
Postmasters, Martin, For your consideration.
> Begin forwarded message:
>
> Date: Thu, 28 Aug 2003 12:43:54 +0300
> From: Sviatoslav Sviridov/Lintec Project <svd@lintec.minsk.by>
> To: rsync@lists.samba.org
2008 Mar 03
1
PST Rsync Issues
Hi All,
I have a 1.8GB PST file that is backed up every night from a cygwin install)
and every night rsync transfers about 1.8GB of data for that file. It
changes a bit, but for all intents and purposes the entire file is
transferred. There are other files on this system that rsync more typically,
so I'm fairly certain this isn't a switch or command error on the calling
end. I have also
2003 Mar 05
2
compressed archives
Suppose I have a particular version of a largish compressed archive,
most likely a .tgz or .tbz2, and that a remote machine has a newer,
and only slightly different, version of the same archive, where most
of the content hasn't actually changed much. I might attempt to obtain
a copy of the newer archive by first copying my local older copy to
the newer name as a file to update from.
My
2002 Aug 04
1
MD4 bug in rsync for lengths = 64 * n
I am the author of BackupPC (http://backuppc.sourceforge.net) and
I am working on adding rsync support to BackupPC.
I am implementing the server-side in perl, and the client will
run vanilla rsync. (BTW, is there the protocol documented? I've
answered all my questions by looking at the source, but it would
be great to check against any docs.)
I started with librsync 0.9.3 and the
2008 Jun 12
1
Rsync compression problem - sometimes ineffective?
Running rsync 2.6.9-1.el4.rf on CentOS 4.4 client and remote server.
Backing up user data from 2 different clients using following:
su - $HOSTID -c 'rsync -azr --timeout=600 --log-file=$DEBUGFILE
--log-file-format="%o %f %b %l %i" --stats --delete --bwlimit=$BANDWDT
--rsh="ssh -P ____" $STAGE $TARGET:$TARGETDIR'
Using "bytes sent"/"literal data"
2005 Feb 04
2
rsync huge tar files
Hi folks,
Are there any tricks known to let rsync operate on huge tar
files?
I've got a local tar file (e.g. 2GByte uncompressed) that is
rebuilt each night (with just some tiny changes, of course),
and I would like to update the remote copies of this file
without extracting the tar files into temporary directories.
Any ideas?
Regards
Harri
2015 Sep 26
2
Is this a bug in CentOS-7 BackupPC?
When I try to start BackupPC with "sudo systemctl restart backuppc"
on my CentOS-7 server (running kernel 3.10.0-229.14.1.el7.x86_64)
I get the following error in /var/log/BackupPC/LOG
2015-09-26 13:58:14 Reading hosts file
2015-09-26 13:58:14 unix bind() failed: No such file or directory
This message occurs in the Perl script /usr/share/BackupPC/bin/BackupPC :
my $sockFile
2015 Sep 20
2
Setting up BackupPC on CentOS-7
I'd be interested in any corrections or comments
on the following instructions (basically for myself):
We assume that BackupPC has been installed:
sudo yum install BackupPC
1. BackupPC must be run by the user backuppc.
Accordingly the lines
User apache
Group apache
in /etc/httpd/conf/httpd.conf should be changed to
User backuppc
Group backuppc
2. The user backuppc must be able to
2008 Jul 03
6
BackupPC won't fork after CentOS 5.2 upgrade
For some time now i have been running BackupPC 3.1.0 on CentOS 5.1
x86_64 however after upgrading to CentOS 5.2 BackupPC will not start.
"sudo /etc/init.d/backuppc start" return OK but there is no BackupPC
processes.
This fails also.
# sudo -u backuppc /usr/bin/BackupPC -d
# echo $?
0
This succeeds, but of course does not fork.
# sudo -u backuppc /usr/bin/BackupPC
So for some
2008 Apr 27
1
rsync and compression
I have a directory that I backup using rsync with --link-dest and hard
links, but I would like the files in that directory to be zipped to
conserve space. They are very large log text files (hundreds of megs)
that compress 90% or more.
Is there some way to do this so that all the files rsync backs up get
compressed?
The only thing I can think of is manually compressing the directories
2015 Sep 15
2
BackupPC is not easy to setup
On 09/13/2015 03:48 PM, Timothy Murphy wrote:
> Timothy Murphy wrote:
>
>> I thought I'd write a 1-page note to myself of the steps I took,
>> in preparation for CentOS-8...
>> I have a couple of questions that this raises.
>>
>> 1. Why exactly does backuppc want to ssh to root?
>> Is this just a way of running BackupPC as root?
>>
>> 2.
2015 Sep 08
3
BackupPC problem - wrong user
I recently moved BackupPC from CentOS-6 to CentOS-7.
But when I browse to localhost/BackupPC I'm told
Error: Wrong user: my userid is 48[apache], instead of 984(backuppc)
As far as I can tell, the BackupPC settings are exactly the same
as they were before the move.
It seems htttpd is running the program as user apache
rather than backuppc, as required.
Is there a simple setting in
2015 Sep 13
5
BackupPC is not easy to setup
I finally got BackupPC working under Centos-7.1
after several hours of pain.
I had been running it for several years under CentOS-6,
and probably CentOS-5, but there seem to me
to have been several new issues that arise with CentOS-7.
In my experience, the official documentation on this,
<http://backuppc.sourceforge.net/faq/BackupPC.html>,
is more or less useless unless you have a very long
2006 Apr 18
8
Backing up CentOS
Can anyone suggest a good open source/free backup software that works on
CentOS? I was reading through the manuals on how to back things up and it
said do 1 of 2 things. Buy a 3rd party software packages or make one from
source. Well I have no clue how to do the 2nd option and I don't want to
spend any money so I figured I would as you gurus. BTW I am newb so easier
the software the better.
2015 Sep 26
2
Is this a bug in CentOS-7 BackupPC?
Fabian Arrotin wrote:
>> This message occurs in the Perl script
>> /usr/share/BackupPC/bin/BackupPC :
>>
>> my $sockFile = "/var/run/BackupPC/BackupPC.sock";
>> unlink($sockFile); if ( !bind(SERVER_UNIX, sockaddr_un($sockFile))
>> ) { print(LOG $bpc->timeStamp, "unix bind() failed: $!\n");
>> exit(1); }
>>
>> As far as