similar to: Maximum zfs send/receive throughput

Displaying 20 results from an estimated 110 matches similar to: "Maximum zfs send/receive throughput"

2010 Jul 19
22
zfs send to remote any ideas for a faster way than ssh?
I''ve tried ssh blowfish and scp arcfour. both are CPU limited long before the 10g link is. I''vw also tried mbuffer, but I get broken pipe errors part way through the transfer. I''m open to ideas for faster ways to to either zfs send directly or through a compressed file of the zfs send output. For the moment I; zfs send > pigz scp arcfour the file gz file to the
2012 Dec 14
12
any more efficient way to transfer snapshot between two hosts than ssh tunnel?
Assuming in a secure and trusted env, we want to get the maximum transfer speed without the overhead from ssh. Thanks. Fred -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20121213/654f543f/attachment-0001.html>
2008 Dec 08
5
How to use mbuffer with zfs send/recv
>> How do i compile mbuffer for our system, Thanks to Mike Futerko for help with the compile, i now have it installed OK. >> and what syntax to i use to invoke it within the zfs send recv? Still looking for answers to this one? Any example syntax, gotchas etc would be much appreciated. -- Kind regards, Jules free. open. honest. love. kindness. generosity. energy. frenetic.
2010 May 20
13
send/recv over ssh
I know i''m probably doing something REALLY stupid.....but for some reason i can''t get send/recv to work over ssh. I just built a new media server and i''d like to move a few filesystem from my old server to my new server but for some reason i keep getting strange errors... At first i''d see something like this: pfexec: can''t get real path of
2010 Feb 02
7
Help needed with zfs send/receive
Hi folks, I''m having (as the title suggests) a problem with zfs send/receive. Command line is like this : pfexec zfs send -Rp tank/tsm@snapshot | ssh remotehost pfexec zfs recv -v -F -d tank This works like a charm as long as the snapshot is small enough. When it gets too big (meaning somewhere between 17G and 900G), I get ssh errors (can''t read from remote host). I tried
2008 Nov 06
45
''zfs recv'' is very slow
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 hi, i have two systems, A (Solaris 10 update 5) and B (Solaris 10 update 6). i''m using ''zfs send -i'' to replicate changes on A to B. however, the ''zfs recv'' on B is running extremely slowly. if i run the zfs send on A and redirect output to a file, it sends at 2MB/sec. but when i use ''zfs send
2009 Jan 07
9
''zfs recv'' is very slow
On Wed 07/01/09 20:31 , Carsten Aulbert carsten.aulbert at aei.mpg.de sent: > Brent Jones wrote: > > > > Using mbuffer can speed it up dramatically, but > > this seems like a hack> without addressing a real problem with zfs > > send/recv.> Trying to send any meaningful sized snapshots > > from say an X4540 takes> up to 24 hours, for as little as 300GB
2001 Dec 08
1
HTB Message Storm HTB Delay <large number> > 5 secs
Hello I''ve set up a simple system. It seems to work for a short while, but now I''ve got batches of 100''s of these messages. Also I can''t connect through that box any more. It''s as if forwarding died. Has anyone any advice? Regards John
2012 Jul 11
1
Decoding a continues stream
Hi, I've trying to decode a FLAC audio stream. I have a reader which sends raw byte data to my FLAC wrapper class. Only once the decode function below returns, the reader will send new data. Hence I want to decode until the stream is empty, but I will add new data to the stream once it is empty. *void **MyFlacCoder::**decode(char *data, int bytes) { mBuffer = input;
2009 Nov 20
2
ZFS Send Priority and Performance
I have several X4540 Thor systems with one large zpool that replicate data to a backup host via zfs send/recv. The process works quite well when there is little to no usage on the source systems. However when the source systems are under usage replication slows down to a near crawl. Without load replication streams along usually near 1 Gbps but drops down to anywhere between 0 - 5000
2010 Oct 02
3
out of HDD space - zfs degraded
Overnight I was running a zfs send | zfs receive (both within the same system / zpool). The system ran out of space, a drive went off line, and the system is degraded. This is a raidz2 array running on FreeBSD 8.1-STABLE #0: Sat Sep 18 23:43:48 EDT 2010. The following logs are also available at http://www.langille.org/tmp/zfs-space.txt <- no line wrapping This is what was running: #
2010 May 28
6
zfs send/recv reliability
After looking through the archives I haven''t been able to assess the reliability of a backup procedure which employs zfs send and recv. Currently I''m attempting to create a script that will allow me to write a zfs stream to a tape via tar like below. # zfs send -R pool at something | tar -c > /dev/tape I''m primarily concerned with in the possibility
2006 Aug 02
10
[PATCH 0/6] htb: cleanup
The HTB scheduler code is a mess, this patch set does some basic house cleaning. The first four should cause no code change, but the last two need more testing. -- Stephen Hemminger <shemminger@osdl.org> "And in the Packet there writ down that doome" - To unsubscribe from this list: send the line "unsubscribe netdev" in the body of a message to
2011 Mar 11
1
UDP Perfomance tuning
Hi, We are running on 5.5 on a HP ProLiant DL360 G6. Kernel version is 2.6.18-194.17.1.el5 (we had also tested with the latest available kernel kernel-2.6.18-238.1.1.el5.x86_64) We running some performance tests using the "iperf" utility. We are seeing very bad and inconsistent performance on the UDP testing. The maximum we could get, was 440 Mbits/sec, and it varies from 250 to 440
2007 Sep 02
4
Performance Issues
My apology for cross posting We have a DELL6850 with 8Gbytes of memory, four 3.2Ghz CPU's , perc 4 raid controller, with fourteen 300Gbyte 10Krpm disk on a powervault 220s, And a powervault 124T LTO-3 tape systems on a separate 160Mbyte/sec adaptec SCSI card. The disks are configured as two 2Tbyte raid 0 partitions using the perc 4 hardware. The problem is - reading from the disk, and
2010 Oct 14
0
AMD/Supermicro machine - AS-2022G-URF
Sorry for the long post but I know trying to decide on hardware often want to see details about what people are using. I have the following AS-2022G-URF machine running OpenGaryIndiana[1] that I am starting to use. I successfully transferred a deduped zpool with 1.x TB of files and 60 or so zfs filesystems using mbuffer from an old 134 system with 6 drives - it ran at about 50MB/s or
2013 May 27
1
Empty buffer on encoder write byte
Hi, I've been trying to encode a live audio input from the microphone on iOS device using opus. Uncompressed audio recording works fine with http://theamazingaudioengine.com/ Then, when I tried to do encoding, I'm stuck at figuring out why the buffer is empty: static int ec_write_byte(ec_enc *_this,unsigned _value){ if(_this->offs+_this->end_offs>=_this->storage)return
2004 Feb 07
0
OS X
Hello, has anyone experience with "CoreAudio" and "Vorbis" ? I try to decode a file with ov_read(...). It works for some (mili)seconds and then the Output get into trouble... . You need some infos? char buffer[4096]; OSStatus Render(...) { bytes_read = ov_read(&vf, buffer, sizeof(buffer), 0, 2, 1, &current_section); memcpy(ioData->mBuffers[0].mData,
2012 Sep 30
0
Speex (in ios) really poor quality (and robotic) sound
Hi everyone, I'm trying to encode/decode with speex, when I do not, the audio is loud and clear, but when I encode/decode to test audio quality, I get a really poor audio quality and a robotic sound. Here's my init audio method : #define AUDIO_QUALITY 10 - (void) initAudio { try { //SPEEX CONFIG speex_bits_init(&bits_in);
2008 Sep 23
0
答复: Re: 答复: RE: 答复:RE:
Hi all, I have started stubdom, thank all of you. But I still met a problem, that is I found stubdom block when it run 107s. the message in "xm li" : Domain-0 0 1719 2 r----- 171.9 hvmachine 1 256 1 -b---- 110.6 hvmachine-dm