I have 6 zfs pools and after rebooting init 6 the vpath device path names have changed for some unknown reason. But I can''t detach, remove and reattach to the new device names....ANY HELP! please pjde43m01 - - - - FAULTED - pjde43m02 - - - - FAULTED - pjde43m03 - - - - FAULTED - poas43m01 - - - - FAULTED - poas43m02 - - - - FAULTED - poas43m03 - - - - FAULTED - One pool listed below as example pool: poas43m01 state: UNAVAIL status: One or more devices could not be opened. There are insufficient replicas for the pool to continue functioning. action: Attach the missing device and online it using ''zpool online''. see: http://www.sun.com/msg/ZFS-8000-3C scrub: none requested config: NAME STATE READ WRITE CKSUM poas43m01 UNAVAIL 0 0 0 insufficient replicas vpath4c UNAVAIL 0 0 0 cannot open before 30. vpath1a <IBM-2145-0000 cyl 8190 alt 2 hd 64 sec 256> /pseudo/vpathdd at 1:1 31. vpath2a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> /pseudo/vpathdd at 2:2 32. vpath3a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> /pseudo/vpathdd at 3:3 33. vpath4a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> /pseudo/vpathdd at 4:4 34. vpath5a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> /pseudo/vpathdd at 5:5 35. vpath6a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> /pseudo/vpathdd at 6:6 36. vpath7a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> /pseudo/vpathdd at 7:7 after 30. vpath1a <IBM-2145-0000 cyl 8190 alt 2 hd 64 sec 256> /pseudo/vpathdd at 1:1 31. vpath8a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> /pseudo/vpathdd at 8:8 32. vpath9a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> /pseudo/vpathdd at 9:9 33. vpath10a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> /pseudo/vpathdd at 10:10 34. vpath11a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> /pseudo/vpathdd at 11:11 35. vpath12a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> /pseudo/vpathdd at 12:12 36. vpath13a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> /pseudo/vpathdd at 13:13 {usbderp430 at root} zpool detach poas43m03 vpath2c cannot open ''poas43m03'': pool is unavailable -- This message posted from opensolaris.org
On 30 maj 2010, at 01.53, morris hooten wrote:> I have 6 zfs pools and after rebooting init 6 the vpath device path names have changed for some unknown reason. But I can''t detach, remove and reattach to the new device names....ANY HELP! please > > pjde43m01 - - - - FAULTED - > pjde43m02 - - - - FAULTED - > pjde43m03 - - - - FAULTED - > poas43m01 - - - - FAULTED - > poas43m02 - - - - FAULTED - > poas43m03 - - - - FAULTED - > > > One pool listed below as example > > pool: poas43m01 > state: UNAVAIL > status: One or more devices could not be opened. There are insufficient > replicas for the pool to continue functioning. > action: Attach the missing device and online it using ''zpool online''. > see: http://www.sun.com/msg/ZFS-8000-3C > scrub: none requested > config: > > NAME STATE READ WRITE CKSUM > poas43m01 UNAVAIL 0 0 0 insufficient replicas > vpath4c UNAVAIL 0 0 0 cannot open > > > > before > > 30. vpath1a <IBM-2145-0000 cyl 8190 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 1:1 > 31. vpath2a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 2:2 > 32. vpath3a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 3:3 > 33. vpath4a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 4:4 > 34. vpath5a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 5:5 > 35. vpath6a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 6:6 > 36. vpath7a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 7:7 > > > after > > 30. vpath1a <IBM-2145-0000 cyl 8190 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 1:1 > 31. vpath8a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 8:8 > 32. vpath9a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 9:9 > 33. vpath10a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 10:10 > 34. vpath11a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 11:11 > 35. vpath12a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 12:12 > 36. vpath13a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 13:13 >I have never seen "/pseudo" devices, is this veritas or what is it? Is it even solaris? Just i wild guess: If the disk devices are in a directory (file system?) called "/pseudo", zpool won''t find them there, as it will only look in /dev/dsk by default. You could try "zpool import -d /pseudo" to have it look there instead. /ragge
Can you find the devices in /dev/rdsk? I see there is a path in /pseudo at least, but the zpool import command only looks in /dev. One thing you can try is doing this: # mkdir /tmpdev # ln -s /pseudo/vpathdd at 1:1 /tmpdev/vpath1a And then see if ''zpool import -d /tmpdev'' finds the pool. On 29 May, 2010, at 19.53, morris hooten wrote:> I have 6 zfs pools and after rebooting init 6 the vpath device path names have changed for some unknown reason. But I can''t detach, remove and reattach to the new device names....ANY HELP! please > > pjde43m01 - - - - FAULTED - > pjde43m02 - - - - FAULTED - > pjde43m03 - - - - FAULTED - > poas43m01 - - - - FAULTED - > poas43m02 - - - - FAULTED - > poas43m03 - - - - FAULTED - > > > One pool listed below as example > > pool: poas43m01 > state: UNAVAIL > status: One or more devices could not be opened. There are insufficient > replicas for the pool to continue functioning. > action: Attach the missing device and online it using ''zpool online''. > see: http://www.sun.com/msg/ZFS-8000-3C > scrub: none requested > config: > > NAME STATE READ WRITE CKSUM > poas43m01 UNAVAIL 0 0 0 insufficient replicas > vpath4c UNAVAIL 0 0 0 cannot open > > > > before > > 30. vpath1a <IBM-2145-0000 cyl 8190 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 1:1 > 31. vpath2a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 2:2 > 32. vpath3a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 3:3 > 33. vpath4a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 4:4 > 34. vpath5a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 5:5 > 35. vpath6a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 6:6 > 36. vpath7a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 7:7 > > > after > > 30. vpath1a <IBM-2145-0000 cyl 8190 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 1:1 > 31. vpath8a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 8:8 > 32. vpath9a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 9:9 > 33. vpath10a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 10:10 > 34. vpath11a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 11:11 > 35. vpath12a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 12:12 > 36. vpath13a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 13:13 > > > > > {usbderp430 at root} zpool detach poas43m03 vpath2c > cannot open ''poas43m03'': pool is unavailable > -- > This message posted from opensolaris.org > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Also, the zpool.cache may be out of date. To clear its entries, zpool export poas43m01 and ignore any errors. Then zpool import and see if the pool is shown as importable, perhaps with new device names. If not, then try the zpool import -d option that Mark described. -- richard On May 29, 2010, at 4:53 PM, morris hooten wrote:> I have 6 zfs pools and after rebooting init 6 the vpath device path names have changed for some unknown reason. But I can''t detach, remove and reattach to the new device names....ANY HELP! please > > pjde43m01 - - - - FAULTED - > pjde43m02 - - - - FAULTED - > pjde43m03 - - - - FAULTED - > poas43m01 - - - - FAULTED - > poas43m02 - - - - FAULTED - > poas43m03 - - - - FAULTED - > > > One pool listed below as example > > pool: poas43m01 > state: UNAVAIL > status: One or more devices could not be opened. There are insufficient > replicas for the pool to continue functioning. > action: Attach the missing device and online it using ''zpool online''. > see: http://www.sun.com/msg/ZFS-8000-3C > scrub: none requested > config: > > NAME STATE READ WRITE CKSUM > poas43m01 UNAVAIL 0 0 0 insufficient replicas > vpath4c UNAVAIL 0 0 0 cannot open > > > > before > > 30. vpath1a <IBM-2145-0000 cyl 8190 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 1:1 > 31. vpath2a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 2:2 > 32. vpath3a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 3:3 > 33. vpath4a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 4:4 > 34. vpath5a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 5:5 > 35. vpath6a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 6:6 > 36. vpath7a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 7:7 > > > after > > 30. vpath1a <IBM-2145-0000 cyl 8190 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 1:1 > 31. vpath8a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 8:8 > 32. vpath9a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 9:9 > 33. vpath10a <IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 10:10 > 34. vpath11a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 11:11 > 35. vpath12a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 12:12 > 36. vpath13a <IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 13:13 > > > > > {usbderp430 at root} zpool detach poas43m03 vpath2c > cannot open ''poas43m03'': pool is unavailable > -- > This message posted from opensolaris.org > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss-- Richard Elling richard at nexenta.com +1-760-896-4422 ZFS and NexentaStor training, Rotterdam, July 13-15, 2010 http://nexenta-rotterdam.eventbrite.com/
Are the indicated devices actually under /pseudo or are they really under /devices/pseudo ? Also, have you tried a ''devfsadm -C'' to re-configure the /dev links? this might allow you to recognize the new vpath devices... -Erik On 5/29/2010 4:53 PM, morris hooten wrote:> I have 6 zfs pools and after rebooting init 6 the vpath device path names have changed for some unknown reason. But I can''t detach, remove and reattach to the new device names....ANY HELP! please > > pjde43m01 - - - - FAULTED - > pjde43m02 - - - - FAULTED - > pjde43m03 - - - - FAULTED - > poas43m01 - - - - FAULTED - > poas43m02 - - - - FAULTED - > poas43m03 - - - - FAULTED - > > > One pool listed below as example > > pool: poas43m01 > state: UNAVAIL > status: One or more devices could not be opened. There are insufficient > replicas for the pool to continue functioning. > action: Attach the missing device and online it using ''zpool online''. > see: http://www.sun.com/msg/ZFS-8000-3C > scrub: none requested > config: > > NAME STATE READ WRITE CKSUM > poas43m01 UNAVAIL 0 0 0 insufficient replicas > vpath4c UNAVAIL 0 0 0 cannot open > > > > before > > 30. vpath1a<IBM-2145-0000 cyl 8190 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 1:1 > 31. vpath2a<IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 2:2 > 32. vpath3a<IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 3:3 > 33. vpath4a<IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 4:4 > 34. vpath5a<IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 5:5 > 35. vpath6a<IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 6:6 > 36. vpath7a<IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 7:7 > > > after > > 30. vpath1a<IBM-2145-0000 cyl 8190 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 1:1 > 31. vpath8a<IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 8:8 > 32. vpath9a<IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 9:9 > 33. vpath10a<IBM-2145-0000 cyl 13822 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 10:10 > 34. vpath11a<IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 11:11 > 35. vpath12a<IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 12:12 > 36. vpath13a<IBM-2145-0000 cyl 27646 alt 2 hd 64 sec 256> > /pseudo/vpathdd at 13:13 > > > > > {usbderp430 at root} zpool detach poas43m03 vpath2c > cannot open ''poas43m03'': pool is unavailable >-- Erik Trimble Java System Support Mailstop: usca22-123 Phone: x17195 Santa Clara, CA