Displaying 20 results from an estimated 110 matches similar to: "Maximum zfs send/receive throughput"
2010 Jul 19
22
zfs send to remote any ideas for a faster way than ssh?
I''ve tried ssh blowfish and scp arcfour. both are CPU limited long before the 10g link is.
I''vw also tried mbuffer, but I get broken pipe errors part way through the transfer.
I''m open to ideas for faster ways to to either zfs send directly or through a compressed file of the zfs send output.
For the moment I;
zfs send > pigz
scp arcfour the file gz file to the
2012 Dec 14
12
any more efficient way to transfer snapshot between two hosts than ssh tunnel?
Assuming in a secure and trusted env, we want to get the maximum transfer speed without the overhead from ssh.
Thanks.
Fred
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20121213/654f543f/attachment-0001.html>
2008 Dec 08
5
How to use mbuffer with zfs send/recv
>> How do i compile mbuffer for our system,
Thanks to Mike Futerko for help with the compile, i now have it installed OK.
>> and what syntax to i use to invoke it within the zfs send recv?
Still looking for answers to this one? Any example syntax, gotchas
etc would be much appreciated.
--
Kind regards, Jules
free. open. honest. love. kindness. generosity. energy. frenetic.
2010 May 20
13
send/recv over ssh
I know i''m probably doing something REALLY stupid.....but for some reason i
can''t get send/recv to work over ssh. I just built a new media server and
i''d like to move a few filesystem from my old server to my new server but
for some reason i keep getting strange errors...
At first i''d see something like this:
pfexec: can''t get real path of
2010 Feb 02
7
Help needed with zfs send/receive
Hi folks,
I''m having (as the title suggests) a problem with zfs send/receive.
Command line is like this :
pfexec zfs send -Rp tank/tsm@snapshot | ssh remotehost pfexec zfs recv
-v -F -d tank
This works like a charm as long as the snapshot is small enough.
When it gets too big (meaning somewhere between 17G and 900G), I get
ssh errors (can''t read from remote host).
I tried
2008 Nov 06
45
''zfs recv'' is very slow
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
hi,
i have two systems, A (Solaris 10 update 5) and B (Solaris 10 update 6). i''m
using ''zfs send -i'' to replicate changes on A to B. however, the ''zfs recv'' on
B is running extremely slowly. if i run the zfs send on A and redirect output
to a file, it sends at 2MB/sec. but when i use ''zfs send
2009 Jan 07
9
''zfs recv'' is very slow
On Wed 07/01/09 20:31 , Carsten Aulbert carsten.aulbert at aei.mpg.de sent:
> Brent Jones wrote:
> >
> > Using mbuffer can speed it up dramatically, but
> > this seems like a hack> without addressing a real problem with zfs
> > send/recv.> Trying to send any meaningful sized snapshots
> > from say an X4540 takes> up to 24 hours, for as little as 300GB
2001 Dec 08
1
HTB Message Storm HTB Delay <large number> > 5 secs
Hello I''ve set up a simple system. It seems to work for a short while,
but now I''ve got batches of 100''s of these messages.
Also I can''t connect through that box any more. It''s as if forwarding
died.
Has anyone any advice?
Regards
John
2012 Jul 11
1
Decoding a continues stream
Hi,
I've trying to decode a FLAC audio stream. I have a reader which sends
raw byte data to my FLAC wrapper class. Only once the decode function
below returns, the reader will send new data.
Hence I want to decode until the stream is empty, but I will add new
data to the stream once it is empty.
*void **MyFlacCoder::**decode(char *data, int bytes)
{
mBuffer = input;
2009 Nov 20
2
ZFS Send Priority and Performance
I have several X4540 Thor systems with one large zpool that replicate
data to a backup host via zfs send/recv. The process works quite well
when there is little to no usage on the source systems. However when
the source systems are under usage replication slows down to a near
crawl. Without load replication streams along usually near 1 Gbps but
drops down to anywhere between 0 - 5000
2010 Oct 02
3
out of HDD space - zfs degraded
Overnight I was running a zfs send | zfs receive (both within the same
system / zpool). The system ran out of space, a drive went off line,
and the system is degraded.
This is a raidz2 array running on FreeBSD 8.1-STABLE #0: Sat Sep 18
23:43:48 EDT 2010.
The following logs are also available at
http://www.langille.org/tmp/zfs-space.txt <- no line wrapping
This is what was running:
#
2010 May 28
6
zfs send/recv reliability
After looking through the archives I haven''t been able to assess the reliability of a backup procedure which employs zfs send and recv. Currently I''m attempting to create a script that will allow me to write a zfs stream to a tape via tar like below.
# zfs send -R pool at something | tar -c > /dev/tape
I''m primarily concerned with in the possibility
2006 Aug 02
10
[PATCH 0/6] htb: cleanup
The HTB scheduler code is a mess, this patch set does some basic
house cleaning. The first four should cause no code change, but the
last two need more testing.
--
Stephen Hemminger <shemminger@osdl.org>
"And in the Packet there writ down that doome"
-
To unsubscribe from this list: send the line "unsubscribe netdev" in
the body of a message to
2011 Mar 11
1
UDP Perfomance tuning
Hi,
We are running on 5.5 on a HP ProLiant DL360 G6.
Kernel version is 2.6.18-194.17.1.el5 (we had also tested with the latest
available kernel kernel-2.6.18-238.1.1.el5.x86_64)
We running some performance tests using the "iperf" utility.
We are seeing very bad and inconsistent performance on the UDP testing.
The maximum we could get, was 440 Mbits/sec, and it varies from 250 to 440
2007 Sep 02
4
Performance Issues
My apology for cross posting
We have a DELL6850 with 8Gbytes of memory, four 3.2Ghz CPU's , perc 4
raid controller, with fourteen 300Gbyte 10Krpm disk on a powervault
220s, And a powervault 124T LTO-3 tape systems on a separate
160Mbyte/sec adaptec SCSI card.
The disks are configured as two 2Tbyte raid 0 partitions using the perc
4 hardware.
The problem is - reading from the disk, and
2010 Oct 14
0
AMD/Supermicro machine - AS-2022G-URF
Sorry for the long post but I know trying to decide on hardware often want to
see details about what people are using.
I have the following AS-2022G-URF machine running OpenGaryIndiana[1] that I am
starting to use.
I successfully transferred a deduped zpool with 1.x TB of files and 60 or so
zfs filesystems using mbuffer from an old 134 system with 6 drives - it ran at
about 50MB/s or
2013 May 27
1
Empty buffer on encoder write byte
Hi,
I've been trying to encode a live audio input from the microphone on iOS
device using opus.
Uncompressed audio recording works fine with
http://theamazingaudioengine.com/
Then, when I tried to do encoding, I'm stuck at figuring out why the buffer
is empty:
static int ec_write_byte(ec_enc *_this,unsigned _value){
if(_this->offs+_this->end_offs>=_this->storage)return
2004 Feb 07
0
OS X
Hello,
has anyone experience with "CoreAudio" and "Vorbis" ?
I try to decode a file with ov_read(...).
It works for some (mili)seconds and then the Output get into trouble... .
You need some infos?
char buffer[4096];
OSStatus Render(...) {
bytes_read = ov_read(&vf, buffer, sizeof(buffer), 0, 2, 1,
¤t_section);
memcpy(ioData->mBuffers[0].mData,
2012 Sep 30
0
Speex (in ios) really poor quality (and robotic) sound
Hi everyone,
I'm trying to encode/decode with speex, when I do not, the audio is loud and clear, but when I encode/decode to test audio quality, I get a really poor audio quality and a robotic sound.
Here's my init audio method :
#define AUDIO_QUALITY 10
- (void) initAudio {
try {
//SPEEX CONFIG
speex_bits_init(&bits_in);
2008 Sep 23
0
答复: Re: 答复: RE: 答复:RE:
Hi all,
I have started stubdom, thank all of you. But I still met a problem, that is I found stubdom block when it run 107s. the message in "xm li" :
Domain-0 0 1719 2 r----- 171.9
hvmachine 1 256 1 -b---- 110.6
hvmachine-dm