Giovanni
2010-May-08 04:38 UTC
[zfs-discuss] Plugging in a hard drive after Solaris has booted up?
Hi guys, I have a quick question, I am playing around with ZFS and here''s what I did. I created a storage pool with several drives. I unplugged 3 out of 5 drives from the array, currently: NAME STATE READ WRITE CKSUM gpool UNAVAIL 0 0 0 insufficient replicas raidz1 UNAVAIL 0 0 0 insufficient replicas c8t2d0 UNAVAIL 0 0 0 cannot open c8t4d0 UNAVAIL 0 0 0 cannot open c8t0d0 UNAVAIL 0 0 0 cannot open These drives had power all the time, the SATA cable however was disconnected. Now, after I logged into Solaris and opened firefox, I plugged them back in to sit and watch if the storage pool suddenly becomes "available" This did not happen, so my question is, do I need to make Solaris re-detect the hard drives and if so how? I tried format -e but it did not seem to detect the 3 drives I just plugged back in. Is this a BIOS issue? Does hot-swap hard drives only work when you replace current hard drives (previously detected by BIOS) with others but not when you have ZFS/Solaris running and want to add more storage without shutting down? It all boils down to, say the scenario is that I will need to purchase more hard drives as my array grows, I would like to be able to (without shutting down) add the drives to the storage pool (zpool) Thanks -- This message posted from opensolaris.org
Ian Collins
2010-May-08 04:45 UTC
[zfs-discuss] Plugging in a hard drive after Solaris has booted up?
On 05/ 8/10 04:38 PM, Giovanni wrote:> Hi guys, > > I have a quick question, I am playing around with ZFS and here''s what I did. > > I created a storage pool with several drives. I unplugged 3 out of 5 drives from the array, currently: > > NAME STATE READ WRITE CKSUM > gpool UNAVAIL 0 0 0 insufficient replicas > raidz1 UNAVAIL 0 0 0 insufficient replicas > c8t2d0 UNAVAIL 0 0 0 cannot open > c8t4d0 UNAVAIL 0 0 0 cannot open > c8t0d0 UNAVAIL 0 0 0 cannot open > > These drives had power all the time, the SATA cable however was disconnected. Now, after I logged into Solaris and opened firefox, I plugged them back in to sit and watch if the storage pool suddenly becomes "available" > > This did not happen, so my question is, do I need to make Solaris re-detect the hard drives and if so how? I tried format -e but it did not seem to detect the 3 drives I just plugged back in. Is this a BIOS issue? > >Assuming hot-swap is supported on your system, what does cfgadm report? -- Ian.
Ben Rockwood
2010-May-08 04:55 UTC
[zfs-discuss] Plugging in a hard drive after Solaris has booted up?
On 5/7/10 9:38 PM, Giovanni wrote:> Hi guys, > > I have a quick question, I am playing around with ZFS and here''s what I did. > > I created a storage pool with several drives. I unplugged 3 out of 5 drives from the array, currently: > > NAME STATE READ WRITE CKSUM > gpool UNAVAIL 0 0 0 insufficient replicas > raidz1 UNAVAIL 0 0 0 insufficient replicas > c8t2d0 UNAVAIL 0 0 0 cannot open > c8t4d0 UNAVAIL 0 0 0 cannot open > c8t0d0 UNAVAIL 0 0 0 cannot open > > These drives had power all the time, the SATA cable however was disconnected. Now, after I logged into Solaris and opened firefox, I plugged them back in to sit and watch if the storage pool suddenly becomes "available" > > This did not happen, so my question is, do I need to make Solaris re-detect the hard drives and if so how? I tried format -e but it did not seem to detect the 3 drives I just plugged back in. Is this a BIOS issue? > > Does hot-swap hard drives only work when you replace current hard drives (previously detected by BIOS) with others but not when you have ZFS/Solaris running and want to add more storage without shutting down? > > It all boils down to, say the scenario is that I will need to purchase more hard drives as my array grows, I would like to be able to (without shutting down) add the drives to the storage pool (zpool) >There are lots of different things you can look at and do, but it comes down to just one command: "devfsadm -vC". This will cleanup (-C for cleanup, -v for verbose) the device tree if it gets into a funky state. Then run "format" or "iostat -En" to verify that the device(s) are there. Then re-import the zpool or add the device or whatever you wish to do. Even if device locations change, ZFS will do the right thing on import. If you wish to dig deeper... normally when you attach a new device hot-plug will do the right thing and you''ll see the connection messages in "dmesg". If you want to explicitly check the state of dynamic reconfiguration, checkout the "cfgadm" command. Normally, however, on modern version of Solaris there is no reason to resort to that, its just something fun if you wish to dig. benr.
Giovanni Mazzeo
2010-May-08 18:54 UTC
[zfs-discuss] Plugging in a hard drive after Solaris has booted up?
Giovanni at server:~# cfgadm Ap_Id Type Receptacle Occupant Condition sata1/0 disk connected unconfigured unknown sata1/1::dsk/c8t1d0 disk connected configured ok sata1/2 sata-port empty unconfigured ok sata1/3::dsk/c8t3d0 disk connected configured ok sata1/4 disk connected unconfigured unknown sata1/5::dsk/c8t5d0 disk connected configured ok usb5/1 unknown empty unconfigured ok usb5/2 unknown empty unconfigured ok usb6/1 unknown empty unconfigured ok usb6/2 unknown empty unconfigured ok usb7/1 unknown empty unconfigured ok usb7/2 unknown empty unconfigured ok usb8/1 unknown empty unconfigured ok usb8/2 usb-cdrom connected configured ok usb8/3 unknown empty unconfigured ok usb8/4 unknown empty unconfigured ok usb8/5 unknown empty unconfigured ok usb8/6 unknown empty unconfigured ok usb9/1 usb-hub connected configured ok usb9/1.1 usb-device connected configured ok usb9/1.2 usb-device connected configured ok usb9/1.3 unknown empty unconfigured ok usb9/1.4 unknown empty unconfigured ok usb9/2 unknown empty unconfigured ok usb10/1 unknown empty unconfigured ok usb10/2 unknown empty unconfigured ok usb11/1 unknown empty unconfigured ok usb11/2 unknown empty unconfigured ok usb12/1 unknown empty unconfigured ok usb12/2 unknown empty unconfigured ok usb12/3 unknown empty unconfigured ok usb12/4 unknown empty unconfigured ok usb12/5 unknown empty unconfigured ok usb12/6 unknown empty unconfigured ok Giovanni at server:~# Shows unconfigured, but I do not know what to do next to bring them online or set them back as "configured" any help is appreciated. Thanks On Fri, May 7, 2010 at 9:45 PM, Ian Collins <ian at ianshome.com> wrote:> On 05/ 8/10 04:38 PM, Giovanni wrote: > >> Hi guys, >> >> I have a quick question, I am playing around with ZFS and here''s what I >> did. >> >> I created a storage pool with several drives. I unplugged 3 out of 5 >> drives from the array, currently: >> >> NAME STATE READ WRITE CKSUM >> gpool UNAVAIL 0 0 0 insufficient replicas >> raidz1 UNAVAIL 0 0 0 insufficient replicas >> c8t2d0 UNAVAIL 0 0 0 cannot open >> c8t4d0 UNAVAIL 0 0 0 cannot open >> c8t0d0 UNAVAIL 0 0 0 cannot open >> >> These drives had power all the time, the SATA cable however was >> disconnected. Now, after I logged into Solaris and opened firefox, I plugged >> them back in to sit and watch if the storage pool suddenly becomes >> "available" >> >> This did not happen, so my question is, do I need to make Solaris >> re-detect the hard drives and if so how? I tried format -e but it did not >> seem to detect the 3 drives I just plugged back in. Is this a BIOS issue? >> >> >> > Assuming hot-swap is supported on your system, what does cfgadm report? > > -- > Ian. > >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100508/b9d5ddb2/attachment.html>
Ian Collins
2010-May-08 20:56 UTC
[zfs-discuss] Plugging in a hard drive after Solaris has booted up?
On 05/ 9/10 06:54 AM, Giovanni Mazzeo wrote:> Giovanni at server:~# cfgadm > Ap_Id Type Receptacle Occupant > Condition > sata1/0 disk connected unconfigured > unknown > sata1/1::dsk/c8t1d0 disk connected configured ok > sata1/2 sata-port empty unconfigured ok > sata1/3::dsk/c8t3d0 disk connected configured ok > sata1/4 disk connected unconfigured > unknown > sata1/5::dsk/c8t5d0 disk connected configured ok > > Shows unconfigured, but I do not know what to do next to bring them > online or set them back as "configured" any help is appreciated. Thanks >Run |cfgadm -cconfigure |on the unconfigured Ids|, see the man page for the gory details.| -- Ian.
Joerg Schilling
2010-May-10 14:31 UTC
[zfs-discuss] Plugging in a hard drive after Solaris has booted up?
Ian Collins <ian at ianshome.com> wrote:> Run |cfgadm -cconfigure |on the unconfigured Ids|, see the man page for > the gory details.|IF the BIOS is OK ;-) I have a problem with a DELL PC: If I disable the other SATA ports, Solaris is unable to detect new drives (linux does). If I enable other SATA ports, the DELL BIOS will stop and ask me whether I like to continue, so this is not an option that would survive a remote system crash/reboot. J?rg -- EMail:joerg at schily.isdn.cs.tu-berlin.de (home) J?rg Schilling D-13353 Berlin js at cs.tu-berlin.de (uni) joerg.schilling at fokus.fraunhofer.de (work) Blog: http://schily.blogspot.com/ URL: http://cdrecord.berlios.de/private/ ftp://ftp.berlios.de/pub/schily