Did a search, but could not find the info I am looking for.
I built out my OSOL system about a month ago and have been gradually making
changes before I move it into production. I have setup a mirrored rpool and a 6
drive raidz2 pool for data. In my system I have 2 8-port SAS cards and 6 ports
on the motherboard. I was short on SAS to SATA cables so I originally built the
system out using the 6 ports on the motherboard and one SAS to SATA breakout
cable. My new cables came and I reran all the cables to spread out the drives
between controllers...
Rebooted and my raidz2 pool is unavailable:
pool: tank
state: UNAVAIL
status: One or more devices could not be opened. There are insufficient
replicas for the pool to continue functioning.
action: Attach the missing device and online it using ''zpool
online''.
see: http://www.sun.com/msg/ZFS-8000-3C
scrub: none requested
config:
NAME STATE READ WRITE CKSUM
tank UNAVAIL 0 0 0 insufficient replicas
raidz2-0 UNAVAIL 0 0 0 insufficient replicas
c4t16d0 UNAVAIL 0 0 0 cannot open
c4t17d0 ONLINE 0 0 0
c10t0d0 ONLINE 0 0 0
c10t2d0 ONLINE 0 0 0
c10t3d0 UNAVAIL 0 0 0 cannot open
c10t5d0 FAULTED 0 0 0 corrupted data
However,
when I look at format I see all my disks -- but the labels don''t seem
to match up:
AVAILABLE DISK SELECTIONS:
0. c4t17d0 <ATA-SAMSUNG HD103SJ-0001-931.51GB>
/pci at 0,0/pci1002,5979 at 3/pci1014,394 at 0/sd at 11,0
1. c4t18d0 <ATA-SAMSUNG HD103SJ-0001-931.51GB>
/pci at 0,0/pci1002,5979 at 3/pci1014,394 at 0/sd at 12,0
2. c6t4d0 <DEFAULT cyl 19454 alt 2 hd 255 sec 63>
/pci at 0,0/pci1002,5978 at 2/pci1014,394 at 0/sd at 4,0
3. c6t9d0 <ATA-SAMSUNG HD103SJ-0001-931.51GB>
/pci at 0,0/pci1002,5978 at 2/pci1014,394 at 0/sd at 9,0
4. c10t1d0 <ATA-SAMSUNG HD103SJ-0001-931.51GB>
/pci at 0,0/pci1462,7550 at 11/disk at 1,0
5. c10t2d0 <ATA-SAMSUNG HD103SJ-0001-931.51GB>
/pci at 0,0/pci1462,7550 at 11/disk at 2,0
6. c10t4d0 <DEFAULT cyl 19454 alt 2 hd 255 sec 63>
/pci at 0,0/pci1462,7550 at 11/disk at 4,0
7. c10t5d0 <ATA-SAMSUNG HD103SJ-0001-931.51GB>
/pci at 0,0/pci1462,7550 at 11/disk at 5,0
How, do I recover my raidz2 pool?
Is what I did wrong? I was under the impression that zfs wrote a label to each
disk so you can move it around between controllers...?
--
This message posted from opensolaris.org
On Tue, 22 Jun 2010, Brian wrote:> > Is what I did wrong? I was under the impression that zfs wrote a > label to each disk so you can move it around between controllers...?You are correct. Normally exporting and importing the pool should cause zfs to import the pool correctly. Moving disks around without first exporting the pool is something which is best avoided. Bob -- Bob Friesenhahn bfriesen at simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer, http://www.GraphicsMagick.org/
On Tue, June 22, 2010 17:32, Bob Friesenhahn wrote:> On Tue, 22 Jun 2010, Brian wrote: >> >> Is what I did wrong? I was under the impression that zfs wrote a >> label to each disk so you can move it around between controllers...? > > You are correct. Normally exporting and importing the pool should > cause zfs to import the pool correctly. Moving disks around without > first exporting the pool is something which is best avoided.Perhaps an issue with stale data in "/etc/zfs/zpool.cache"?
Did some more reading.. Should have exported first... gulp... So, I powered down and moved the drives around until the system came back up and zpool status is clean.. However, now I can''t seem to boot. During boot it finds all 17 ZFS filesystems and starts mounting them. I have several file systems under /media. I have media/TV, media/Movies, media/Music, media/HomeVideos. During boot, I get an error message that states cannot mount /media directory is not empty and drops me into the recovery console. Now, when I go into /media, I have all the filesystems there and can go into each and the directories contain my contents.. If I unmount each filesystem under /media the directories each one mounts under stays there.. as expected.. And I don''t see any other files in there besides the mountpoints.. Any advice on how to correct the mounting /media problem? I am not even sure where to look since the /media directory appears empty. -- This message posted from opensolaris.org
Ok - So I unmounted all the directories, and then deleted them from /media, then I rebooted and everything remounted correctly and the system is functioning again.. Ok. time for a zpool scrub, then I will try my export and import.. whew :-) -- This message posted from opensolaris.org
I ran into the same thing where I had to manually delete directories. Once you export the pool you can plug in the drives anywhere else. Reimport the pool and the file systems come right up ? as long as the drives can be seen by the system. -- This message posted from opensolaris.org