zfs discuss - Jan 2012 - unable to access the zpool after issue a reboot

Hi all,


I am new to Solaris & I am facing an issue with the dynapath [multipath
s/w] for Solaris10u10 x86 .

I am facing an issue with the zpool.

Whats my problem is unable to access the zpool after issue a reboot.

I am pasting the zpool status below.

=========================================================bash-3.2# zpool status
  pool: test
 state: UNAVAIL
 status: One or more devices could not be opened.  There are insufficient
        replicas for the pool to continue functioning.
 action: Attach the missing device and online it using ''zpool
online''.
   see: http://www.sun.com/msg/ZFS-8000-3C
 scan: none requested
 config:

        NAME                     STATE     READ WRITE CKSUM
        test                     UNAVAIL      0     0     0  insufficient
replicas
============================================================
But all my devices are online & I am able to access them.
when I export & import the zpool , the zpool comes to back
to available state.

I am not getting whats the problem with the reboot.

Any suggestions regarding this was very helpful.
*
*
*Thanks& Regards,*
*Sudheer.*
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20120124/c3b65fa9/attachment.html>

> From: zfs-discuss-bounces at opensolaris.org [mailto:zfs-discuss-
> bounces at opensolaris.org] On Behalf Of sureshkumar
> 
> Whats my problem is unable to access the zpool after issue a reboot.
> 
> =========================================================> bash-3.2#
zpool status
> ? pool: test
> ? ? ? ? NAME ? ? ? ? ? ? ? ? ? ? STATE ? ? READ WRITE CKSUM
> ? ? ? ? test ? ? ? ? ? ? ? ? ? ? UNAVAIL ? ? ?0 ? ? 0 ? ? 0 ?insufficient
replicas

Can you do a "history" and tell us what your "zpool create"
command was?

how did you issue " reboot", try 
shutdown -i6  -y -g0 

Sent from my iPad

On Jan 24, 2012, at 7:03, sureshkumar <sachinnsuresh at gmail.com> wrote:
> Hi all,
> 
> 
> I am new to Solaris & I am facing an issue with the dynapath [multipath
s/w] for Solaris10u10 x86 .
> 
> I am facing an issue with the zpool.
> 
> Whats my problem is unable to access the zpool after issue a reboot.
> 
> I am pasting the zpool status below.
> 
> =========================================================> bash-3.2#
zpool status
>   pool: test
>  state: UNAVAIL
>  status: One or more devices could not be opened.  There are insufficient
>         replicas for the pool to continue functioning.
>  action: Attach the missing device and online it using ''zpool
online''.
>    see: http://www.sun.com/msg/ZFS-8000-3C
>  scan: none requested
>  config:
> 
>         NAME                     STATE     READ WRITE CKSUM
>         test                     UNAVAIL      0     0     0  insufficient
replicas
> =============================================================
> But all my devices are online & I am able to access them.
> when I export & import the zpool , the zpool comes to back to available
state.
> 
> I am not getting whats the problem with the reboot.
> 
> Any suggestions regarding this was very helpful.
> 
> Thanks& Regards,
> Sudheer.
> _______________________________________________
> zfs-discuss mailing list
> zfs-discuss at opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20120124/8683f355/attachment.html>

On Tue, Jan 24, 2012 at 05:33:39PM +0530, sureshkumar
wrote:
> 
>    I am new to Solaris & I am facing an issue with the dynapath
[multipath
>    s/w] for Solaris10u10 x86 .
> 
>    I am facing an issue with the zpool.
> 
>    Whats my problem is unable to access the zpool after issue a reboot.
I''ve seen this happen when the zpool was built on an Iscsi LUN.  At
reboot time, the ZFS import was done before the Iscsi driver was able
to connect to its target.  After the system was up, an export and
import was successful.  The solution was to add a new service that
imported the zpool later during the reboot.

-- 
-Gary Mills-		-refurb-		-Winnipeg, Manitoba, Canada-

On Tue, 24 Jan 2012, sureshkumar wrote:
> 
> ? ? ? ? NAME ? ? ? ? ? ? ? ? ? ? STATE ? ? READ WRITE CKSUM
> ? ? ? ? test ? ? ? ? ? ? ? ? ? ? UNAVAIL ? ? ?0 ? ? 0 ? ? 0 ?insufficient
replicas
> ============================================================= ? ? ? ? ? ? ?
? ? ? ? ? ? ? ? ? ? ? ? ??
> But all my devices are online & I am able to access them.
> when I export & import the zpool , the zpool comes to back
to?available?state.
> 
> I am not getting whats the problem with the reboot.
The LUN on which this pool is based was not available within a 
reasonable time after when zfs tried to import it.  It was available 
later.

What storage technology is this LUN based on (local SAS/SATA, iSCSI, 
FC)?

Bob
-- 
Bob Friesenhahn
bfriesen at simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/
GraphicsMagick Maintainer,    http://www.GraphicsMagick.org/

Sudheer,


I don''t know what the module name is for dynapath, but you may want to
include a forceload statement in /etc/system.? This will cause the driver to
load during initialization.? Usually all the modules in the stack should be
included, such as the sd driver.


example:

forceload:? drv/sd
forceload:? drv/XXXX



HTH

Dave


________________________________
 From: sureshkumar <sachinnsuresh at gmail.com>
To: zfs-discuss at opensolaris.org 
Sent: Tuesday, January 24, 2012 6:03 AM
Subject: [zfs-discuss] unable to access the zpool after issue a reboot
 

Hi all,


I am new to Solaris & I am facing an issue with the dynapath [multipath s/w]
for Solaris10u10 x86 .

I am facing an issue with the zpool.

Whats my problem is unable to access the zpool after issue a reboot.

I am pasting the zpool status below.

=========================================================bash-3.2# zpool status
? pool: test
?state: UNAVAIL
?status: One or more devices could not be opened. ?There are insufficient
? ? ? ? replicas for the pool to continue functioning.
?action: Attach the missing device and online it using ''zpool
online''.
? ?see: http://www.sun.com/msg/ZFS-8000-3C
?scan: none requested
?config:

? ? ? ? NAME ? ? ? ? ? ? ? ? ? ? STATE ? ? READ WRITE CKSUM
? ? ? ? test ? ? ? ? ? ? ? ? ? ? UNAVAIL ? ? ?0 ? ? 0 ? ? 0 ?insufficient
replicas
============================================================= ? ? ? ? ? ? ? ? ?
? ? ? ? ? ? ? ? ? ? ??
But all my devices are online & I am able to access them.
when I export & import the zpool , the zpool comes to back
to?available?state.

I am not getting whats the problem with the reboot.

Any suggestions regarding this was very helpful.

Thanks& Regards,
Sudheer.
_______________________________________________
zfs-discuss mailing list
zfs-discuss at opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20120124/5491a8c6/attachment-0001.html>

Hi all,

Thanks for your response.

1) I am using zpool create -f pool name devid ---> for creating the zpool.
2) I am using reboot -- -r,shutdown -i6  -y -g0 both to reboot the machine.
3) I already force loaded my drivers in etc/system
4) and finally I am using the FC Luns for creation of zpools.

Please advice.

*Thanks & regards,*
*Sudheer.*
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20120126/fa18736d/attachment.html>

Hi
>
> 1) I am using zpool create -f pool name devid ---> for creating the
zpool.
> 2) I am using reboot -- -r,shutdown -i6  -y -g0 both to reboot the
> machine.
> 3) I already force loaded my drivers in etc/system
> 4) and finally I am using the FC Luns for creation of zpools.
please provide more information.

- are the FC luns available after the reboot?
- which OS-Level are you useing
- after zpool create, zpool is available ? zpool status "poolname"
- after reboot is the pool available for import? zpool import?

thank you
Christian

Hi Christian ,

1)The FC Luns are available after reboot.
2) The Os level of the machine : Oracle Solaris 10 8/11 s10x_u10wos_17b X86.


3)bash-3.2# zpool status
  pool: pool name
 state: UNAVAIL
status: One or more devices could not be opened.  There are insufficient
        replicas for the pool to continue functioning.
action: Attach the missing device and online it using ''zpool
online''.
   see: http://www.sun.com/msg/ZFS-8000-3C
 scan: none requested
config:NAME        STATE     READ WRITE CKSUM
        pool name      UNAVAIL      0     0     0  insufficient replicas
          c5t1d1    UNAVAIL      0     0     0  cannot open


4) at the time of reboot the machine itself imports the zpool & no need to
import it again.
bash-3.2# zpool import pool name
cannot import ''pool name'': a pool with that name is already
created/imported,
and no additional pools with that name were found.



And the important thing is when I export & import the zpool, then I was
able to access it.


*Thanks , *
*Sudheer.*
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20120126/b3298351/attachment.html>

Hi Sudheer
>
> 1)The FC Luns are available after reboot.
ok, you are using FC Luns and do not enable MPXIO?
> 2) The Os level of the machine : Oracle Solaris 10 8/11
> s10x_u10wos_17b X86.
>
>
> 3)bash-3.2# zpool status
>   pool: pool name
>  state: UNAVAIL
> status: One or more devices could not be opened.  There are insufficient
>         replicas for the pool to continue functioning.
> action: Attach the missing device and online it using ''zpool
online''.
>    see: http://www.sun.com/msg/ZFS-8000-3C
>  scan: none requested
> config:NAME        STATE     READ WRITE CKSUM
>         pool name      UNAVAIL      0     0     0  insufficient replicas
>           c5t1d1    UNAVAIL      0     0     0  cannot open
>
>
> 4) at the time of reboot the machine itself imports the zpool & no
> need to import it again.
> bash-3.2# zpool import pool name
> cannot import ''pool name'': a pool with that name is
already
> created/imported,
> and no additional pools with that name were found.
>
>
> And the important thing is when I export & import the zpool, then I
> was able to access it.
As Gary and Bob mentioned, I saw this Issue with ISCSI Devices.
Instead of export / import is a zpool clear also working?

mpathadm list LU
mpathadm show LU /dev/rdsk/c5t1d1s2

Regards
Christian

On Thu, Jan 26, 2012 at 04:36:58PM +0100, Christian Meier
wrote:
> Hi Sudheer
> >
> > 3)bash-3.2# zpool status
> >   pool: pool name
> >  state: UNAVAIL
> > status: One or more devices could not be opened.  There are
insufficient
> >         replicas for the pool to continue functioning.
> > action: Attach the missing device and online it using ''zpool
online''.
> >    see: http://www.sun.com/msg/ZFS-8000-3C
> >  scan: none requested
> > config:NAME        STATE     READ WRITE CKSUM
> >         pool name      UNAVAIL      0     0     0  insufficient
replicas
> >           c5t1d1    UNAVAIL      0     0     0  cannot open
This means that, at the time of that import, device c5t1d1 was not
available.  What does `ls -l /dev/rdsk/c5t1d1s0'' show for the physical
path?
> > And the important thing is when I export & import the zpool, then
I
> > was able to access it.
Yes, later the device became available.  After the boot, `svcs'' will
show you the services listed in order of their completion times.  The
ZFS mount is done by this service:

    svc:/system/filesystem/local:default

The zpool import (without the mount) is done earlier.  Check to see
if any of the FC services run too late during the boot.
> As Gary and Bob mentioned, I saw this Issue with ISCSI Devices.
> Instead of export / import is a zpool clear also working?
> 
> mpathadm list LU
> mpathadm show LU /dev/rdsk/c5t1d1s2
-- 
-Gary Mills-		-refurb-		-Winnipeg, Manitoba, Canada-

Hi Sudheer,

     As suggested by Christian, check if zpool clear brings the pool 
online. There
     was a bug which recently got fixed, which will take care of this 
problem. Your
     Solaris version is on the lower side.

Thanks,
Deepak.
On 01/26/12 09:06 PM, Christian Meier wrote:
> Hi Sudheer
>> 1)The FC Luns are available after reboot.
> ok, you are using FC Luns and do not enable MPXIO?
>> 2) The Os level of the machine : Oracle Solaris 10 8/11
>> s10x_u10wos_17b X86.
>>
>>
>> 3)bash-3.2# zpool status
>>    pool: pool name
>>   state: UNAVAIL
>> status: One or more devices could not be opened.  There are
insufficient
>>          replicas for the pool to continue functioning.
>> action: Attach the missing device and online it using ''zpool
online''.
>>     see: http://www.sun.com/msg/ZFS-8000-3C
>>   scan: none requested
>> config:NAME        STATE     READ WRITE CKSUM
>>          pool name      UNAVAIL      0     0     0  insufficient
replicas
>>            c5t1d1    UNAVAIL      0     0     0  cannot open
>>
>>
>> 4) at the time of reboot the machine itself imports the zpool&  no
>> need to import it again.
>> bash-3.2# zpool import pool name
>> cannot import ''pool name'': a pool with that name is
already
>> created/imported,
>> and no additional pools with that name were found.
>>
>>
>> And the important thing is when I export&  import the zpool, then I
>> was able to access it.
> As Gary and Bob mentioned, I saw this Issue with ISCSI Devices.
> Instead of export / import is a zpool clear also working?
>
> mpathadm list LU
> mpathadm show LU /dev/rdsk/c5t1d1s2
>
> Regards
> Christian
>
> _______________________________________________
> zfs-discuss mailing list
> zfs-discuss at opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Hi Christian ,

I was disabled the MPXIO  & zpool clear is working for some times & its
failed in few iterations.

I am using one Sparc machine [with the same OS level of x-86 ]& I
didn''t
faced any issue with the Sparc architecture.
Is it was the problem with booting sequence?

Please help me.

*Thanks,*
*Sudheer.*
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20120127/2a65dac6/attachment.html>

it seems that you will need to work  with oracle support:-(

Sent from my iPad

On Jan 27, 2012, at 3:49, sureshkumar <sachinnsuresh at gmail.com> wrote:
> Hi Christian ,
> 
> I was disabled the MPXIO  & zpool clear is working for some times &
its failed in few iterations.
> 
> I am using one Sparc machine [with the same OS level of x-86 ]& I
didn''t faced any issue with the Sparc architecture.
> Is it was the problem with booting sequence?
> 
> Please help me.
> 
> Thanks,
> Sudheer.
> _______________________________________________
> zfs-discuss mailing list
> zfs-discuss at opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20120127/2ff28367/attachment-0001.html>

Hi Friends thank you so much for your help.

I will try with Solaris11 & I ''ll inform the status.

*Thanks & Regards,*
*Sudheer.*
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20120127/9a7c07fa/attachment.html>