search for: mbuffer

I''ve tried ssh blowfish and scp arcfour. both are CPU limited long before the 10g link is. I''vw also tried mbuffer, but I get broken pipe errors part way through the transfer. I''m open to ideas for faster ways to to either zfs send directly or through a compressed file of the zfs send output. For the moment I; zfs send > pigz scp arcfour the file gz file to the remote host gunzip < to zfs rece...

Assuming in a secure and trusted env, we want to get the maximum transfer speed without the overhead from ssh. Thanks. Fred -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20121213/654f543f/attachment-0001.html>

>> How do i compile mbuffer for our system, Thanks to Mike Futerko for help with the compile, i now have it installed OK. >> and what syntax to i use to invoke it within the zfs send recv? Still looking for answers to this one? Any example syntax, gotchas etc would be much appreciated. -- Kind regards, Jules fre...

I know i''m probably doing something REALLY stupid.....but for some reason i can''t get send/recv to work over ssh. I just built a new media server and i''d like to move a few filesystem from my old server to my new server but for some reason i keep getting strange errors... At first i''d see something like this: pfexec: can''t get real path of

...n 17G and 900G), I get ssh errors (can''t read from remote host). I tried various encryption options (the fastest being in my case arcfour) with no better results. I tried to setup a script to insert dd on the sending and receiving side to buffer the flow, still read errors. I tried with mbuffer (which gives better performance), it didn''t get better. Today I tried with netcat (and mbuffer) and I got better throughput, but it failed at 269GB transferred. The two machines are connected to the switch with 2x1GbE (Intel) joined together with LACP. The switch logs show no errors on...

...ich sends raw byte data to my FLAC wrapper class. Only once the decode function below returns, the reader will send new data. Hence I want to decode until the stream is empty, but I will add new data to the stream once it is empty. *void **MyFlacCoder::**decode(char *data, int bytes) { mBuffer = input; mBufferBytes = bytes; FLAC__stream_decoder_process_until_end_of_stream(mDecoder); } * My read callback looks as follows: * FLAC__StreamDecoderReadStatus flacReadDecode(const FLAC__StreamDecoder *decoder, FLAC__byte buffer[], size_t *bytes, void *client) { MyFlacCoder *coder...

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 hi, i have two systems, A (Solaris 10 update 5) and B (Solaris 10 update 6). i''m using ''zfs send -i'' to replicate changes on A to B. however, the ''zfs recv'' on B is running extremely slowly. if i run the zfs send on A and redirect output to a file, it sends at 2MB/sec. but when i use ''zfs send

On Wed 07/01/09 20:31 , Carsten Aulbert carsten.aulbert at aei.mpg.de sent: > Brent Jones wrote: > > > > Using mbuffer can speed it up dramatically, but > > this seems like a hack> without addressing a real problem with zfs > > send/recv.> Trying to send any meaningful sized snapshots > > from say an X4540 takes> up to 24 hours, for as little as 300GB > > changerate. > I have no...

...hould be able to perform much faster. Unfortunately the data on these systems is in the form of hundreds of millions (maybe even into the billion mark now) of very small files, could this be a factor even with the block level replication occurring? The process is currently: zfs_send -> mbuffer -> LAN -> mbuffer -> zfs_recv -- Adam

It seems we are hitting a boundary with zfs send/receive over a network link (10Gb/s). We can see peak values of up to 150MB/s, but on average about 40-50MB/s are replicated. This is far away from the bandwidth that a 10Gb link can offer. Is it possible, that ZFS is giving replication a too low priority/throttling it too much?

Hello I''ve set up a simple system. It seems to work for a short while, but now I''ve got batches of 100''s of these messages. Also I can''t connect through that box any more. It''s as if forwarding died. Has anyone any advice? Regards John

...ne, and the system is degraded. This is a raidz2 array running on FreeBSD 8.1-STABLE #0: Sat Sep 18 23:43:48 EDT 2010. The following logs are also available at http://www.langille.org/tmp/zfs-space.txt <- no line wrapping This is what was running: # time zfs send storage/bacula@transfer | mbuffer | zfs receive storage/compressed/bacula-mbuffer in @ 0.0 kB/s, out @ 0.0 kB/s, 3670 GB total, buffer 100% fullcannot receive new filesystem stream: out of space mbuffer: error: outputThread: error writing to <stdout> at offset 0x395917c4000: Broken pipe summary: 3670 GByte in 10 h 40 mi...

...ot; ? I try to decode a file with ov_read(...). It works for some (mili)seconds and then the Output get into trouble... . You need some infos? char buffer[4096]; OSStatus Render(...) { bytes_read = ov_read(&vf, buffer, sizeof(buffer), 0, 2, 1, &current_section); memcpy(ioData->mBuffers[0].mData, buffer, bytes_read); ioData->mBuffers[0].mDataByteSize = bytes_read; return noErr; } SomewhereThePlay Function(...){ ... AURenderCallbackStruct in; in.inputProc = Render; in.inputProcRefCon = NULL; ... AudioStreamBasicDescription sFormat; sFormat.m...

After looking through the archives I haven''t been able to assess the reliability of a backup procedure which employs zfs send and recv. Currently I''m attempting to create a script that will allow me to write a zfs stream to a tape via tar like below. # zfs send -R pool at something | tar -c > /dev/tape I''m primarily concerned with in the possibility

...lock:^(void *source, const AudioTimeStamp *time, UInt32 frames, AudioBufferList *bufferList) { UInt32 numberOfBuffers = bufferList->mNumberBuffers; for (int bufferIndex = 0; bufferIndex < numberOfBuffers ; ++bufferIndex) { AudioBuffer audioBuffer = bufferList->mBuffers[bufferIndex]; int frameSize = (samplingRate/1000) * sampleDuration; // sampling rate is 8000, sample duration is 20ms size_t count = frameSize*channels / sizeof(opus_int16); __block opus_int16 *pcmInput = calloc(count, sizeof(opus_int16)); memcpy(pc...

The HTB scheduler code is a mess, this patch set does some basic house cleaning. The first four should cause no code change, but the last two need more testing. -- Stephen Hemminger <shemminger@osdl.org> "And in the Packet there writ down that doome" - To unsubscribe from this list: send the line "unsubscribe netdev" in the body of a message to

...post but I know trying to decide on hardware often want to see details about what people are using. I have the following AS-2022G-URF machine running OpenGaryIndiana[1] that I am starting to use. I successfully transferred a deduped zpool with 1.x TB of files and 60 or so zfs filesystems using mbuffer from an old 134 system with 6 drives - it ran at about 50MB/s or slightly more for much of the process and mbuffer worked great. I am wondering what commands people would recommend running to retrieve/save config info, logs, history, etc to document and save important files _before_ any problem...

Hi, We are running on 5.5 on a HP ProLiant DL360 G6. Kernel version is 2.6.18-194.17.1.el5 (we had also tested with the latest available kernel kernel-2.6.18-238.1.1.el5.x86_64) We running some performance tests using the "iperf" utility. We are seeing very bad and inconsistent performance on the UDP testing. The maximum we could get, was 440 Mbits/sec, and it varies from 250 to 440

...bits_out, outTemp); return outTemp; } And at last, the function that call speex encode & decode and copy it to the buffer that will be playback by the specific callback : - (void) processAudio: (AudioBufferList*) bufferList { AudioBuffer sourceBuffer = bufferList->mBuffers[0]; NSLog(@"Origin size: %lu", sourceBuffer.mDataByteSize); int size = 0; char *encodedAudio = encodeSpeex((spx_int16_t*) sourceBuffer.mData, sourceBuffer.mDataByteSize, &size); NSLog(@"Encoded size: %i", size); short* decode...

...passwd. ^Msocket -> 7 ^Mcan''t store dev null name for domid 1 in /monitor from a stub domain ^Mcan''t store dev vc name for domid 1 in /parallel/0 from a stub domain ^Mqemu_map_cache_init nr_buckets = 4000 size 196608 ^Mshared page at pfn fffe ^Mxc_map_foreign_range(fffe, 4096) ^Mbuffered io page at pfn fffc ^Mxc_map_foreign_range(fffc, 4096) ^MTime offset set 0 ^Mevtchn_open() -> 8 ^Mxc_evtchn_bind_interdomain(1, 4) = 0 ^M******************* PCIFRONT for device/pci/0 ********** ^M ^M ^MFailed to read device/pci/0/backend-id. ^Mno backend ^Mpcilib: minios_init open failed ^MReg...