hi ! i think i have read somewhere that zfs gzip compression doesn`t scale well since the in-kernel compression isn`t done multi-threaded. is this true - and if so - will this be fixed ? what about default lzjb compression - is it different regarding this "issue" ? thanks roland This message posted from opensolaris.org
:n 16 June, 2007 - roland sent me these 0,5K bytes:> hi ! > > i think i have read somewhere that zfs gzip compression doesn`t scale > well since the in-kernel compression isn`t done multi-threaded. > > is this true - and if so - will this be fixed ? > > what about default lzjb compression - is it different regarding this > "issue" ?I believe the compression thingie is single threaded up until nevada build 55-60 something.. Doesn''t matter which algorithm is used.. /Tomas -- Tomas ?gren, stric at acc.umu.se, http://www.acc.umu.se/~stric/ |- Student at Computing Science, University of Ume? `- Sysadmin at {cs,acc}.umu.se
Where can you find the timeframe on that Tomas? Thanks! On 6/16/07, Tomas ?gren <stric at acc.umu.se> wrote:> :n 16 June, 2007 - roland sent me these 0,5K bytes: > > > hi ! > > > > i think i have read somewhere that zfs gzip compression doesn`t scale > > well since the in-kernel compression isn`t done multi-threaded. > > > > is this true - and if so - will this be fixed ? > > > > what about default lzjb compression - is it different regarding this > > "issue" ? > > I believe the compression thingie is single threaded up until nevada > build 55-60 something.. Doesn''t matter which algorithm is used.. > > /Tomas > -- > Tomas ?gren, stric at acc.umu.se, http://www.acc.umu.se/~stric/ > |- Student at Computing Science, University of Ume? > `- Sysadmin at {cs,acc}.umu.se > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss >
On 16 June, 2007 - George sent me these 1,1K bytes:> Where can you find the timeframe on that Tomas?http://bugs.opensolaris.org/bugdatabase/view_bug.do?bug_id=6460622 /Tomas -- Tomas ?gren, stric at acc.umu.se, http://www.acc.umu.se/~stric/ |- Student at Computing Science, University of Ume? `- Sysadmin at {cs,acc}.umu.se
Jürgen Keil
2007-Jun-18 10:17 UTC
[zfs-discuss] Re: zfs compression - scale to multiple cpu ?
> i think i have read somewhere that zfs gzip > compression doesn`t scale well since the in-kernel > compression isn`t done multi-threaded. > > is this true - and if so - will this be fixed ?If you''re writing lots of data, zfs gzip compression might not be a good idea for a desktop machine, because it completely kills interactive performance. See this thread: http://www.opensolaris.org/jive/thread.jspa?messageID=118116𜵤 http://mail.opensolaris.org/pipermail/zfs-discuss/2007-May/thread.html#27841 It does compress (scale) on up-to 8 cpu cores, though. See "zio_taskq_threads" in usr/src/uts/common/fs/zfs/spa.c> what about default lzjb compression - is it different > regarding this "issue" ?lzjb doesn''t consume that much kernel cpu time (compared to gzip), so the machine remains more or less usable for interactive usage. This message posted from opensolaris.org