Displaying 20 results from an estimated 900 matches similar to: "ZFS Send Priority and Performance"
2008 Nov 06
45
''zfs recv'' is very slow
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
hi,
i have two systems, A (Solaris 10 update 5) and B (Solaris 10 update 6). i''m
using ''zfs send -i'' to replicate changes on A to B. however, the ''zfs recv'' on
B is running extremely slowly. if i run the zfs send on A and redirect output
to a file, it sends at 2MB/sec. but when i use ''zfs send
2012 Jul 11
1
Decoding a continues stream
Hi,
I've trying to decode a FLAC audio stream. I have a reader which sends
raw byte data to my FLAC wrapper class. Only once the decode function
below returns, the reader will send new data.
Hence I want to decode until the stream is empty, but I will add new
data to the stream once it is empty.
*void **MyFlacCoder::**decode(char *data, int bytes)
{
mBuffer = input;
2009 Jan 07
9
''zfs recv'' is very slow
On Wed 07/01/09 20:31 , Carsten Aulbert carsten.aulbert at aei.mpg.de sent:
> Brent Jones wrote:
> >
> > Using mbuffer can speed it up dramatically, but
> > this seems like a hack> without addressing a real problem with zfs
> > send/recv.> Trying to send any meaningful sized snapshots
> > from say an X4540 takes> up to 24 hours, for as little as 300GB
2008 Dec 08
5
How to use mbuffer with zfs send/recv
>> How do i compile mbuffer for our system,
Thanks to Mike Futerko for help with the compile, i now have it installed OK.
>> and what syntax to i use to invoke it within the zfs send recv?
Still looking for answers to this one? Any example syntax, gotchas
etc would be much appreciated.
--
Kind regards, Jules
free. open. honest. love. kindness. generosity. energy. frenetic.
2010 Feb 02
7
Help needed with zfs send/receive
Hi folks,
I''m having (as the title suggests) a problem with zfs send/receive.
Command line is like this :
pfexec zfs send -Rp tank/tsm@snapshot | ssh remotehost pfexec zfs recv
-v -F -d tank
This works like a charm as long as the snapshot is small enough.
When it gets too big (meaning somewhere between 17G and 900G), I get
ssh errors (can''t read from remote host).
I tried
2010 Jul 19
22
zfs send to remote any ideas for a faster way than ssh?
I''ve tried ssh blowfish and scp arcfour. both are CPU limited long before the 10g link is.
I''vw also tried mbuffer, but I get broken pipe errors part way through the transfer.
I''m open to ideas for faster ways to to either zfs send directly or through a compressed file of the zfs send output.
For the moment I;
zfs send > pigz
scp arcfour the file gz file to the
2010 Oct 02
3
out of HDD space - zfs degraded
Overnight I was running a zfs send | zfs receive (both within the same
system / zpool). The system ran out of space, a drive went off line,
and the system is degraded.
This is a raidz2 array running on FreeBSD 8.1-STABLE #0: Sat Sep 18
23:43:48 EDT 2010.
The following logs are also available at
http://www.langille.org/tmp/zfs-space.txt <- no line wrapping
This is what was running:
#
2012 Dec 14
12
any more efficient way to transfer snapshot between two hosts than ssh tunnel?
Assuming in a secure and trusted env, we want to get the maximum transfer speed without the overhead from ssh.
Thanks.
Fred
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20121213/654f543f/attachment-0001.html>
2012 Oct 17
24
[zfs] portable zfs send streams (preview webrev)
We have finished a beta version of the feature. A webrev for it
can be found here:
http://cr.illumos.org/~webrev/sensille/fits-send/
It adds a command ''zfs fits-send''. The resulting streams can
currently only be received on btrfs, but more receivers will
follow.
It would be great if anyone interested could give it some testing
and/or review. If there are no objections,
2010 May 20
13
send/recv over ssh
I know i''m probably doing something REALLY stupid.....but for some reason i
can''t get send/recv to work over ssh. I just built a new media server and
i''d like to move a few filesystem from my old server to my new server but
for some reason i keep getting strange errors...
At first i''d see something like this:
pfexec: can''t get real path of
2011 Apr 07
40
X4540 no next-gen product?
While I understand everything at Oracle is "top secret" these days.
Does anyone have any insight into a next-gen X4500 / X4540? Does some
other Oracle / Sun partner make a comparable system that is fully
supported by Oracle / Sun?
http://www.oracle.com/us/products/servers-storage/servers/previous-products/index.html
What do X4500 / X4540 owners use if they''d like more
2010 Jun 25
11
Maximum zfs send/receive throughput
It seems we are hitting a boundary with zfs send/receive over a network
link (10Gb/s). We can see peak values of up to 150MB/s, but on average
about 40-50MB/s are replicated. This is far away from the bandwidth that
a 10Gb link can offer.
Is it possible, that ZFS is giving replication a too low
priority/throttling it too much?
2001 Dec 08
1
HTB Message Storm HTB Delay <large number> > 5 secs
Hello I''ve set up a simple system. It seems to work for a short while,
but now I''ve got batches of 100''s of these messages.
Also I can''t connect through that box any more. It''s as if forwarding
died.
Has anyone any advice?
Regards
John
2011 Dec 12
2
Sun X4540 disk replacement
Sorry for the off-topic question.
I''m needing to replace a disk in a x4540 zfs file system. I have replacement ST31000NSSUN disks, but it''s not obvious to me how to separate the original disk from its drive sled, it seems to be attached by more than the usual 4 screws. Is it meant to be separated? I''ve looked the x4540 user guide but it does not say anything about it.
2009 Jun 01
7
Does zpool clear delete corrupted files
Hi list,
First off:
# cat /etc/release
Solaris 10 6/06 s10x_u2wos_09a X86
Copyright 2006 Sun Microsystems, Inc. All Rights Reserved.
Use is subject to license terms.
Assembled 09 June 2006
Here''s an (almost) disaster scenario that came to life over the past
week. We have a very large zpool
2010 Nov 01
6
Excruciatingly slow resilvering on X4540 (build 134)
Hello,
I''m working with someone who replaced a failed 1TB drive (50% utilized),
on an X4540 running OS build 134, and I think something must be wrong.
Last Tuesday afternoon, zpool status reported:
scrub: resilver in progress for 306h0m, 63.87% done, 173h7m to go
and a week being 168 hours, that put completion at sometime tomorrow night.
However, he just reported zpool status shows:
2009 Feb 11
8
Write caches on X4540
We''re using some X4540s, with OpenSolaris 2008.11.
According to my testing, to optimize our systems for our specific
workload, I''ve determined that we get the best performance with the
write cache disabled on every disk, and with zfs:zfs_nocacheflush=1 set
in /etc/system.
The only issue is setting the write cache permanently, or at least quickly.
Right now, as it is,
2010 Jun 07
20
Homegrown Hybrid Storage
Hi,
I''m looking to build a virtualized web hosting server environment accessing
files on a hybrid storage SAN. I was looking at using the Sun X-Fire x4540
with the following configuration:
- 6 RAID-Z vdevs with one hot spare each (all 500GB 7200RPM SATA drives)
- 2 Intel X-25 32GB SSD''s as a mirrored ZIL
- 4 Intel X-25 64GB SSD''s as the L2ARC.
-
2010 Jan 12
6
x4500/x4540 does the internal controllers have a bbu?
Has anyone worked with a x4500/x4540 and know if the internal raid controllers have a bbu? I''m concern that we won''t be able to turn off the write-cache on the internal hds and SSDs to prevent data corruption in case of a power failure.
--
This message posted from opensolaris.org
2011 Jul 07
8
Replacement disks for Sun X4500
I am bumping this thread because I too have the same question ... can I put modern 3TB disks (hitachi deskstars) into an old x4500 ?
If not, would the x4540 accept them ?
--
This message posted from opensolaris.org