Displaying 20 results from an estimated 30000 matches similar to: "multi-threaded rsync with gzip file"
2003 Mar 24
0
multi-threaded rsync for a single gzip file
Hi,
I'm transferring a huge gzip file approximately 6GB over the WAN. I was
wondering if there is a way which I can initiate a
multi-threaded(multi-connection) rsync for transferring one gzip file?
Could someone kindly show me how it should be done?
Thanks.
2002 Oct 27
3
rsync with large gzip files.
Hi,
I tried performing a complete copy of 17GB of filesystems over the WAN
(0.8GB/hr) with the speed of 16Mbps. The filesystem consists of several
large g-zipped files. These large g-zipped files have actually been zipped
out of other sub-filesystems and directories. I noticed that while
transferring a lists of large g-zipped files, rsync tends to take a much
longer time to transfer those files
2003 Mar 24
0
rsync with multiple threads for transferring huge file
HI,
I'm transferring a huge gzip file approximately 6GB over the WAN. I was
wondering if there is a way which I can initiate a
multi-threaded(multi-connection) rsync for transferring one gzip file? Could
someone kindly show me how it should be done?
Thanks.
2003 Mar 24
0
rsync Digest, Vol 3, Issue 23
Hi,
I'm transferring a huge gzip file approximately 6GB over the WAN. I was
wondering if there is a way which I can initiate a
multi-threaded(multi-connection) rsync for transferring one gzip file?
Could someone kindly show me how it should be done?
Thanks.
2003 May 10
3
benchmarking rsync's -z compression utility
Hi,
Is there a way in which rsync's -z compression (zlib) utility can be
benchmarked?
I'm trying to compare the compression ratio between rsync and external
compression tools like gzip and bzip2.
Are there any advantages to using rsync's internal compression mechanism
specified with the -z option compared to solely applying external
compression i.e. bzip2 to the files and invoking
2002 Aug 12
3
--include option
HI,
I'm trying to have files to be included during rsync. I have the filesystem
/stor/circuit_design/, with the following subdirectories as its contents:
clock_speed
fub_layout
test_simulations
pattern_flow
I would only like to rsync the following 2 subdirectories to the destination
machine:
clock_speed
fub_layout
and they're contained in the file called files_included:
# cat
2002 May 20
1
Numeric ids
HI,
I had read from the rsync man page on transferring files using the user's
numeric id and gid. I have a user which resides on 2 remote sites, having
the same user names, but different uid and gid on both sites. I'm
transferring the files as a root user.
site A site B
-----------------------------------------------
usr_A usr_A
uid = 100 uid = 200
file1(usr_A)
2003 Jul 14
2
Rebuilding rsync to define HAVE_OFFSET64_T
HI,
I'm currently using rsync version 2.4.4 protocol version 24 on a HP11.0, Solaris 8 and Redhat 7.1 platforms. In my earlier posting, I asked about the problem on "Value too large to be stored in data type" when transferring files which are >= 2GB in size., i.e.
building file list ... global/FCSI/WP_RLS05/rundir/wp_celtic_max_fullwarn.tcl.log: Value too large to be stored in
2018 May 09
0
Re: Multi-threaded virsh migrate
On Mon, May 07, 2018 at 11:55:14AM -0400, Shawn Q wrote:
> Hi folk, we are using 10gb NICs with multithreaded compression.
>
> We're finding that the standard `virsh migrate` gets at most ~1.2gbps,
> similar to a single scp session.
Hmm, I didn't actively measure the throughput when I tested, but looking
at the results and trying to infer bandwidth, I'm fairly sure I saw
2005 Jul 31
0
[patch] kbuild: build all targets in gzip
The gzip program had a few aliases - using ln to reach them.
Build these.
Also introduce gzip.stripped since it was present in the original
Makefile.
To support this a few new rules was added to scripts/Kbuild.klibc
Signed-off-by: Sam Ravnborg <sam@ravnborg.org>
---
commit e7daa9d72c3c7ea2cf23ff34bf601989ced7c6e1
tree 15adb0ed586e264a41fc4b419a71d903faa1a9ca
parent
2016 Jan 06
0
[klibc:master] gzip: Fix silent fallback to decompression
Commit-ID: 0016a343f734cfe002dd45ab97a67b857ffe2e6d
Gitweb: http://git.kernel.org/?p=libs/klibc/klibc.git;a=commit;h=0016a343f734cfe002dd45ab97a67b857ffe2e6d
Author: Ben Hutchings <ben at decadent.org.uk>
AuthorDate: Wed, 6 Jan 2016 01:21:27 +0000
Committer: H. Peter Anvin <hpa at linux.intel.com>
CommitDate: Tue, 5 Jan 2016 17:51:26 -0800
[klibc] gzip: Fix silent fallback
2005 Jun 09
0
FreeBSD Security Advisory FreeBSD-SA-05:11.gzip
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
=============================================================================
FreeBSD-SA-05:11.gzip Security Advisory
The FreeBSD Project
Topic: gzip directory traversal and permission race vulnerabilities
Category: contrib
Module:
2005 Jun 09
0
FreeBSD Security Advisory FreeBSD-SA-05:11.gzip
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
=============================================================================
FreeBSD-SA-05:11.gzip Security Advisory
The FreeBSD Project
Topic: gzip directory traversal and permission race vulnerabilities
Category: contrib
Module:
2006 Sep 19
0
FreeBSD Security Advisory FreeBSD-SA-06:21.gzip
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
=============================================================================
FreeBSD-SA-06:21.gzip Security Advisory
The FreeBSD Project
Topic: Multiple vulnerabilities in gzip
Category: contrib
Module: gzip
Announced:
2006 Sep 19
0
FreeBSD Security Advisory FreeBSD-SA-06:21.gzip
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
=============================================================================
FreeBSD-SA-06:21.gzip Security Advisory
The FreeBSD Project
Topic: Multiple vulnerabilities in gzip
Category: contrib
Module: gzip
Announced:
2006 Sep 19
0
FreeBSD Security Advisory FreeBSD-SA-06:21.gzip
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
=============================================================================
FreeBSD-SA-06:21.gzip Security Advisory
The FreeBSD Project
Topic: Multiple vulnerabilities in gzip
Category: contrib
Module: gzip
Announced:
2016 Jan 06
0
[PATCH klibc] gzip: Fix silent fallback to decompression
If the gzip utilities are built without support for compression,
they will always attempt to carry out decompression even if the
command name and options don't imply that. Instead they should
fail with an explicit error in this case.
Signed-off-by: Ben Hutchings <ben at decadent.org.uk>
---
usr/gzip/gzip.c | 29 ++++++++++++++++-------------
1 file changed, 16 insertions(+), 13
2013 Dec 03
0
[klibc:master] gzip: Fix typo CONFIG_KLIB_ZIP -> CONFIG_KLIBC_ZIP
Commit-ID: c6fc1a4b086a5d6504bc5e1048f039f7a644d73b
Gitweb: http://git.kernel.org/?p=libs/klibc/klibc.git;a=commit;h=c6fc1a4b086a5d6504bc5e1048f039f7a644d73b
Author: Anton Blanchard <anton at samba.org>
AuthorDate: Tue, 3 Dec 2013 18:15:58 +1100
Committer: H. Peter Anvin <hpa at zytor.com>
CommitDate: Tue, 3 Dec 2013 10:53:46 -0800
[klibc] gzip: Fix typo CONFIG_KLIB_ZIP
2013 Dec 03
0
[PATCH] gzip: Fix typo CONFIG_KLIB_ZIP -> CONFIG_KLIBC_ZIP
We were using CONFIG_KLIB_ZIP in a couple of places where we
meant to use CONFIG_KLIBC_ZIP. I also added the option to
the defconfig.
Signed-off-by: Anton Blanchard <anton at samba.org>
---
defconfig | 1 +
usr/gzip/Kbuild | 4 ++--
2 files changed, 3 insertions(+), 2 deletions(-)
diff --git a/defconfig b/defconfig
index c10a4f5..04b98e9 100644
--- a/defconfig
+++ b/defconfig
@@
2018 May 07
2
Multi-threaded virsh migrate
Hi folk, we are using 10gb NICs with multithreaded compression.
We're finding that the standard `virsh migrate` gets at most ~1.2gbps,
similar to a single scp session.
When we do a multipart upload with multiple scp connections we can squeeze
as high as 9.6gbps.
Is there was a way to get `virsh migrate` to perform multiple connections
as well when transferring?
Would be useful to be able