The pool was originally created on 2008.11 then upgraded to 2009.06 and again upgraded to snv-134. Originally I was using Intel x25e''s as the zil but recently purchased a zeusRAM and when trying to remove the Intel I issue the zpool remove command and it appears to work. Yet when I do a zpool status the Intel device is still a pool member. Any thoughts? -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20110327/f6257995/attachment.html>
On 3/27/2011 7:48 AM, Jordan McQuown wrote:> The pool was originally created on 2008.11 then upgraded to 2009.06 > and again upgraded to snv-134. Originally I was using Intel x25e''s as > the zil but recently purchased a zeusRAM and when trying to remove the > Intel I issue the zpool remove command and it appears to work. Yet > when I do a zpool status the Intel device is still a pool member. Any > thoughts? > > > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discussDid you remember to upgrade the pool itself? Not just the OS, but the pool, too, need to be upgraded. You''ll need to run a ''zpool upgrade'' on the pool with the log device. Only later versions of ZFS supported removal of the ZIL. IIRC, the zpool version supported by 2008.11 definitely didn''t, and I''m pretty sure the 2009.06 version didn''t either, but b134 definitely does. -- Erik Trimble Java System Support Mailstop: usca22-123 Phone: x17195 Santa Clara, CA -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20110327/0a991fda/attachment.html>
From: Erik Trimble [mailto:erik.trimble at oracle.com] Sent: Sunday, March 27, 2011 12:53 PM To: Jordan McQuown Cc: ''zfs-discuss at opensolaris.org'' Subject: Re: [zfs-discuss] Cannot remove zil device On 3/27/2011 7:48 AM, Jordan McQuown wrote: The pool was originally created on 2008.11 then upgraded to 2009.06 and again upgraded to snv-134. Originally I was using Intel x25e''s as the zil but recently purchased a zeusRAM and when trying to remove the Intel I issue the zpool remove command and it appears to work. Yet when I do a zpool status the Intel device is still a pool member. Any thoughts? _______________________________________________ zfs-discuss mailing list zfs-discuss at opensolaris.org<mailto:zfs-discuss at opensolaris.org> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss Did you remember to upgrade the pool itself? Not just the OS, but the pool, too, need to be upgraded. You''ll need to run a ''zpool upgrade'' on the pool with the log device. Only later versions of ZFS supported removal of the ZIL. IIRC, the zpool version supported by 2008.11 definitely didn''t, and I''m pretty sure the 2009.06 version didn''t either, but b134 definitely does. -- Erik Trimble Java System Support Mailstop: usca22-123 Phone: x17195 Santa Clara, CA I''ve tried on pool version 22 and 26 at this point under openindiana. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20110327/6a017251/attachment.html>
-----Original Message----- From: Phillip Steinbachs [mailto:phil at steinbachs.org] Sent: Sunday, March 27, 2011 4:01 PM To: Jordan McQuown Cc: ''zfs-discuss at opensolaris.org'' Subject: Re: [zfs-discuss] Cannot remove zil device On Sun, 27 Mar 2011, Jordan McQuown wrote:> The pool was originally created on 2008.11 then upgraded to 2009.06 and again upgraded to snv-134. Originally I was using Intel x25e''s as the zil but recently purchased a zeusRAM and when trying to remove the Intel I issue the zpool remove command and it appears to work. Yet when I do a zpool status the Intel device is still a pool member. Any thoughts? >I have a pool that is experiencing the same problem (currently at version 26). I''ve been able to remove zil devices from it before but at some point they become "stuck". The zpool remove command completes with no error, but the device is never really removed and remains in the pool. zpool iostat will show no activity to the device however, and the alloc column shows 16.0E. It is possible to do a zpool replace on the device, but the replacing device will end up in the same state (unusable and unable to be removed). -phillip I''ve also tried replacing and removing the replacing device with no luck. I''m able to remove the zeusRAM without issue which seems rather puzzling.
> I have a pool that is experiencing the same problem (currently at > version 26). I''ve been able to remove zil devices from it before but > at some point they become "stuck". The zpool remove command completes > with no error, but the device is never really removed and remains in > the pool. > zpool iostat will show no activity to the device however, and the > alloc column shows 16.0E. It is possible to do a zpool replace on the > device, but the replacing device will end up in the same state > (unusable and unable to be removed).I had a similar problem that turned out to be a PEBKAC - I tried to remove devices in a mirror, not the mirror with the devices... Can you paste the command(s) you''re using for this? Btw, log device removal is in from zpool v19, so the one you''re using should work. Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 roy at karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et element?rt imperativ for alle pedagoger ? unng? eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer p? norsk.
-----Original Message----- From: Roy Sigurd Karlsbakk [mailto:roy at karlsbakk.net] Sent: Thursday, March 31, 2011 1:14 PM To: Jordan McQuown Cc: zfs-discuss at opensolaris.org; Phillip Steinbachs Subject: Re: [zfs-discuss] Cannot remove zil device> I have a pool that is experiencing the same problem (currently at > version 26). I''ve been able to remove zil devices from it before but > at some point they become "stuck". The zpool remove command completes > with no error, but the device is never really removed and remains in > the pool. > zpool iostat will show no activity to the device however, and the > alloc column shows 16.0E. It is possible to do a zpool replace on the > device, but the replacing device will end up in the same state > (unusable and unable to be removed).I had a similar problem that turned out to be a PEBKAC - I tried to remove devices in a mirror, not the mirror with the devices... Can you paste the command(s) you''re using for this? Btw, log device removal is in from zpool v19, so the one you''re using should work. Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 roy at karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et element?rt imperativ for alle pedagoger ? unng? eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer p? norsk. zpool remove storage c4t11d0
> zpool remove storage c4t11d0Can you pastebin ''zpool status'' as well? PS: Get a decent email client - your quoting is severely broken :P Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 roy at karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et element?rt imperativ for alle pedagoger ? unng? eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer p? norsk.
> -----Original Message----- > From: Roy Sigurd Karlsbakk [mailto:roy at karlsbakk.net] > Sent: Thursday, March 31, 2011 1:41 PM > To: Jordan McQuown > Cc: zfs-discuss at opensolaris.org > Subject: Re: [zfs-discuss] Cannot remove zil device > > > zpool remove storage c4t11d0 > > Can you pastebin ''zpool status'' as well? > > PS: Get a decent email client - your quoting is severely broken :P > > Vennlige hilsener / Best regards > > roy > -- > Roy Sigurd Karlsbakk > (+47) 97542685 > roy at karlsbakk.net > http://blogg.karlsbakk.net/ > -- > I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er > et element?rt imperativ for alle pedagoger ? unng? eksessiv anvendelse av > idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate > og relevante synonymer p? norsk.http://pastebin.com/nD2r2qmh Here is zpool status and zpool version Thanks, Jordan
> http://pastebin.com/nD2r2qmh > > > Here is zpool status and zpool versionThe only thing I wonder about here, is why you have two striped log devices. I didn''t even know that was supported. Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 roy at karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et element?rt imperativ for alle pedagoger ? unng? eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer p? norsk.
On 03/31/11 12:28, Roy Sigurd Karlsbakk wrote:>> http://pastebin.com/nD2r2qmh >> >> >> Here is zpool status and zpool version >> > > The only thing I wonder about here, is why you have two striped log devices. I didn''t even know that was supported. >Yes it''s supported. ZFS will round robin writes to the log devices. Neil. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20110331/bf7ed3c6/attachment.html>
You can add and remove mirrored or non-mirrored log devices. Jordan is probably running into CR 7000154: cannot remove log device Thanks, Cindy On 03/31/11 12:28, Roy Sigurd Karlsbakk wrote:>> http://pastebin.com/nD2r2qmh >> >> >> Here is zpool status and zpool version > > The only thing I wonder about here, is why you have two striped log devices. I didn''t even know that was supported. > > Vennlige hilsener / Best regards > > roy > -- > Roy Sigurd Karlsbakk > (+47) 97542685 > roy at karlsbakk.net > http://blogg.karlsbakk.net/ > -- > I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et element?rt imperativ for alle pedagoger ? unng? eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer p? norsk. > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
> You can add and remove mirrored or non-mirrored log devices. > > Jordan is probably running into CR 7000154: > > cannot remove log deviceI tried to google that, but couldn''t find anything but this thread. Got a link to that bug? Roy Sigurd Karlsbakk (+47) 97542685 roy at karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et element?rt imperativ for alle pedagoger ? unng? eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer p? norsk.
Do you have any details on that CR? Either my Google-fu is failing or Oracle has moved the CR database private. I haven''t encountered this problem but would like to know if there are certain behaviors to avoid to not risk this. Has it been fixed in Sol10 or OpenSolaris? Thanks, Andrew ________________________________________ From: Cindy Swearingen [cindy.swearingen at oracle.com] Sent: Thursday, March 31, 2011 1:55 PM To: Roy Sigurd Karlsbakk Cc: zfs-discuss at opensolaris.org Subject: Re: [zfs-discuss] Cannot remove zil device You can add and remove mirrored or non-mirrored log devices. Jordan is probably running into CR 7000154: cannot remove log device Thanks, Cindy