Hi, I have merged ZFS version 28 to 8-STABLE (revision 222741) New major features: - data deduplication - triple parity RAIDZ (RAIDZ3) - zfs diff - zpool split - snapshot holds - zpool import -F. Allows to rewind corrupted pool to earlier transaction group - possibility to import pool in read-only mode For updating, there is a compatibility layer so that in the update phase most functionality of the new zfs binaries can be used with the old kernel module and old zfs binaries with the new kernel module. If upgrading your boot pool to version 28, please don't forget to read UPDATING and properly update your boot code. Thanks to everyone working on the ZFS port, especially to Pawel Jakub Dawidek (pjd) for doing most of the work! -- Martin Matuska FreeBSD committer http://blog.vx.sk
On Mon, Jun 06, 2011 at 12:53:11PM +0200, Martin Matuska wrote:> Hi, > > I have merged ZFS version 28 to 8-STABLE (revision 222741) > > New major features: > > - data deduplication > - triple parity RAIDZ (RAIDZ3) > - zfs diff > - zpool split > - snapshot holds > - zpool import -F. Allows to rewind corrupted pool to earlier > transaction group > - possibility to import pool in read-only mode > > For updating, there is a compatibility layer so that in the update phase > most functionality of the new zfs binaries can be used with the old > kernel module and old zfs binaries with the new kernel module. > > If upgrading your boot pool to version 28, please don't forget to read > UPDATING and properly update your boot code. > > Thanks to everyone working on the ZFS port, especially to > Pawel Jakub Dawidek (pjd) for doing most of the work!Thanks for the work on this, guys! I've already managed to find something odd. This message only appears on console, not via pty/tty. icarus# zpool create backups ada2 Solaris(cont): !created version 28 pool backups using 28 src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/spa_history.c contains: 490 void 491 spa_history_log_version(spa_t *spa, history_internal_events_t event) 492 { 493 #ifdef _KERNEL 494 uint64_t current_vers = spa_version(spa); 495 496 if (current_vers >= SPA_VERSION_ZPOOL_HISTORY) { 497 spa_history_log_internal(event, spa, NULL, 498 "pool spa %llu; zfs spa %llu; zpl %d; uts %s %s %s %s", 499 (u_longlong_t)current_vers, SPA_VERSION, ZPL_VERSION, 500 utsname.nodename, utsname.release, utsname.version, 501 utsname.machine); 502 } 503 cmn_err(CE_CONT, "!%s version %llu pool %s using %llu", 504 event == LOG_POOL_IMPORT ? "imported" : 505 event == LOG_POOL_CREATE ? "created" : "accessed", 506 (u_longlong_t)current_vers, spa_name(spa), SPA_VERSION); 507 #endif 508 } A "zpool destroy", etc. does not print any similar message. It only happens on pool creation. Is this intentional behaviour? What does "Solaris(cont)" represent in the context of FreeBSD? -- | Jeremy Chadwick jdc@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, US | | Making life hard for others since 1977. PGP 4BD6C0CB |
On 06/06/11 06:53, Martin Matuska wrote:> Hi, > > I have merged ZFS version 28 to 8-STABLE (revision 222741) > > New major features: > > - data deduplication > - triple parity RAIDZ (RAIDZ3) > - zfs diff > - zpool split > - snapshot holds > - zpool import -F. Allows to rewind corrupted pool to earlier > transaction group > - possibility to import pool in read-only mode > > For updating, there is a compatibility layer so that in the update phase > most functionality of the new zfs binaries can be used with the old > kernel module and old zfs binaries with the new kernel module. > > If upgrading your boot pool to version 28, please don't forget to read > UPDATING and properly update your boot code. > > Thanks to everyone working on the ZFS port, especially to > Pawel Jakub Dawidek (pjd) for doing most of the work! >Thanks for everyone's hard work (and the __FreeBSD_version bump!). -Boris
Hello, Martin Matuska! On Mon, Jun 06, 2011 at 12:53:11PM +0200 mm@FreeBSD.org wrote about "HEADS UP: ZFS v28 merged to 8-STABLE":> Hi, > > I have merged ZFS version 28 to 8-STABLE (revision 222741)finally! Thanks! My home server works ok with this update. -- Lystopad Olexandr
Thanks. Everything works fine. 2011/6/6 Lystopad Olexandr <laa@laa.zp.ua>:> ?Hello, Martin Matuska! > > On Mon, Jun 06, 2011 at 12:53:11PM +0200 > mm@FreeBSD.org wrote about "HEADS UP: ZFS v28 merged to 8-STABLE": >> Hi, >> >> I have merged ZFS version 28 to 8-STABLE (revision 222741) > > finally! Thanks! > > My home server works ok with this update. > > -- > ?Lystopad Olexandr > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >-- Zhihao Yuan, nickname lichray The best way to predict the future is to invent it. ___________________________________________________ 4BSD -- http://4bsd.biz/
On Mon, Jun 06, 2011 at 12:53:11PM +0200, Martin Matuska wrote:> Hi, > > I have merged ZFS version 28 to 8-STABLE (revision 222741) > > New major features: > > - data deduplication > - triple parity RAIDZ (RAIDZ3) > - zfs diff > - zpool split > - snapshot holds > - zpool import -F. Allows to rewind corrupted pool to earlier > transaction group > - possibility to import pool in read-only mode > > For updating, there is a compatibility layer so that in the update phase > most functionality of the new zfs binaries can be used with the old > kernel module and old zfs binaries with the new kernel module.Beware that the compatibility layer is known broken on big-endian architectures, i.e. powerpc64 and sparc64.> > If upgrading your boot pool to version 28, please don't forget to read > UPDATING and properly update your boot code. > > Thanks to everyone working on the ZFS port, especially to > Pawel Jakub Dawidek (pjd) for doing most of the work! >Marius
On Mon, Jun 06, 2011 at 12:53:11PM +0200, Martin Matuska wrote:> I have merged ZFS version 28 to 8-STABLE (revision 222741)Follow-up, since we're gradually upgrading our ZFS-based RELENG_8 servers to ZFSv28. Committers/those involved should see my very last paragraph. First, server upgrades: We've upgraded 2 of the 4 (including updating zfs and zpools), and so far things are working wonderfully. One of those 2 boxes is our NFS filer (which also does backups via rsync/rsnapshot), so that one's been a big worry-point of mine. The next rsync/rsnapshot runs tonight, so I'll be awake watching intently. All these systems are graphed via bsnmpd (memory, CPU, disk I/O, etc.). Second, performance tweaks: We're testing changing to our tweaks; the following directives have been commented out in our /boot/loader.conf files (e.g. we're now using prefetching): # vfs.zfs.prefetch_disable="1" And the following tunable has been removed completely, because it's now the default in ZFSv28 (see cvsweb, look at line 40 of the relevant commit for src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/txg.c): vfs.zfs.txg.timeout="5" Finally, talking a bit about dedup: In the ZFSv28 commit, did the zfs.8 man page get updated? I find no mention of the dedup property in the zfs(8) man page, and yes I did remove the old /usr/share/man/cat8/zfs.8.gz file. We tried using dedup on one of our systems, but within 10-15 minutes turned it off. I believe the added CPU overhead of dedup was causing the system to act "bursty" in other non-ZFS-related tasks; e.g. turn on dedup, then in a SSH window hold down the letter "q" indefinitely, then in another window do some ZFS I/O. The "q" would stall for 1-2 seconds at times (SSH connectivity was via direct private LAN, so network latency was not what we seen). Without dedup this behaviour wasn't seen at all. I'm happy to try any advice/patches on a locally-accessible box (e.g. private LAN, VGA console is right behind me, etc.). I have not tried tinkering with the following settings to find out what may relieve this issue. I'm referring to the sections titled "Trust or verify" and "Selecting a checksum" on Jeff's blog here: http://blogs.oracle.com/bonwick/entry/zfs_dedup All in all, thank you everyone for the work that's gone in to MFC'ing this to RELENG_8. I really do mean that. I'm a harsh bastard on the mailing lists, no question about it. But I always appreciate people doing the grunt work that I myself cannot do (over my head). I state this seriously: if any of you folks who participated in this MFC have donation links (PayPal, etc.), please give them to me. You absolutely will see some worthwhile kick-backs for your efforts, with no strings attached. Just my way of saying "thank you". -- | Jeremy Chadwick jdc@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, US | | Making life hard for others since 1977. PGP 4BD6C0CB |
06.06.2011 13:53, Martin Matuska ???????(??):> Hi, > > I have merged ZFS version 28 to 8-STABLE (revision 222741) > > New major features: > > - data deduplicationAm I missing something? How about using fletcher[24] for dedup? -- Sphinx of black quartz judge my vow.