I have a ZFS raid and wonder if it is possible to move the ZFS raid around from SATA port to another? Ive heard that someone assembled the SATA connections differently and the ZFS raid wouldnt work. Say that I have 8 SATA port controller card with 4 drives in a ZFS raid. Sata ports 0-3 are occupied and Sata ports 4-7 are empty. Could I move SATA connection nr 0 to the SATA port nr 4? -- This message posted from opensolaris.org
On Wed, Dec 24, 2008 at 2:50 PM, Orvar Korvar <knatte_fnatte_tjatte at yahoo.com> wrote:> I have a ZFS raid and wonder if it is possible to move the ZFS raid around from SATA port to another? Ive heard that someone assembled the SATA connections differently and the ZFS raid wouldnt work. > > Say that I have 8 SATA port controller card with 4 drives in a ZFS raid. Sata ports 0-3 are occupied and Sata ports 4-7 are empty. Could I move SATA connection nr 0 to the SATA port nr 4?Orvar, You should be able to move/shuffle your disks freely as long as they (disks) are still visible to the OS. ZFS ultimately uses device GUID to assemble the pool back, rather than the physical path to the device. That said having a spare system to test on before experimenting with a production environment is always a good idea :) -- Regards, Cyril
On Wed, Dec 24, 2008 at 3:51 PM, Cyril Plisko <cyril.plisko at mountall.com> wrote:> On Wed, Dec 24, 2008 at 2:50 PM, Orvar Korvar > <knatte_fnatte_tjatte at yahoo.com> wrote: >> I have a ZFS raid and wonder if it is possible to move the ZFS raid around from SATA port to another? Ive heard that someone assembled the SATA connections differently and the ZFS raid wouldnt work. >> >> Say that I have 8 SATA port controller card with 4 drives in a ZFS raid. Sata ports 0-3 are occupied and Sata ports 4-7 are empty. Could I move SATA connection nr 0 to the SATA port nr 4? > > Orvar, > > You should be able to move/shuffle your disks freely as long as they > (disks) are still visible to the OS. ZFS ultimately uses device GUID > to assemble the pool back, rather than the physical path to the > device. That said having a spare system to test on before > experimenting with a production environment is always a good idea :)I just tried that with VirtualBox - it has AHCI SATA controller with plenty of ports. Worked pretty nice - as expected. -- Regards, Cyril
The problem is this. I have 8 SATA port card. 4 of the slots (0-3) are occupied with 500 GB drives in a ZFS raid, it is named "ZFSraid1". I now want to buy 5 terabyte drives to create a new ZFS raid, which will have the name "ZFSraid2". How can I move the data from ZFSraid1 to ZFSraid2 so I can discard the old discs? I was thinking of this plan: Unconnect one 500 GB drive from ZFSraid1. Now it only has 3 drives (slots: 0-2), but that doesnt matter because I can still read the data, because it is configured as raidz1. There are 5 empty SATA slots on the SATA card now. Slot 3 is now emptied. Connect 5 terabyte drives to the empty slots, and create a ZFS raid. copy all data from the 3 drives unto these 5 drives. Done. Is this possible to do? What happens when slot 3 gets a terabyte drive? Will ZFS try to repair ZFSraid1 with the terabyte drive because it was inserted into slot 3? Will I be able to create ZFSraid2 with slots 3-7? -- This message posted from opensolaris.org
On Wed, Dec 24, 2008 at 5:47 PM, Orvar Korvar < knatte_fnatte_tjatte at yahoo.com> wrote:> The problem is this. I have 8 SATA port card. 4 of the slots (0-3) are > occupied with 500 GB drives in a ZFS raid, it is named "ZFSraid1". I now > want to buy 5 terabyte drives to create a new ZFS raid, which will have the > name "ZFSraid2". How can I move the data from ZFSraid1 to ZFSraid2 so I can > discard the old discs? > > > > I was thinking of this plan: > > Unconnect one 500 GB drive from ZFSraid1. Now it only has 3 drives (slots: > 0-2), but that doesnt matter because I can still read the data, because it > is configured as raidz1. There are 5 empty SATA slots on the SATA card now. > Slot 3 is now emptied. > > Connect 5 terabyte drives to the empty slots, and create a ZFS raid. copy > all data from the 3 drives unto these 5 drives. Done.This should work. Just realize that you''re putting your data at extreme risk since you''ll have no raid protection. Should one of the remaining drives fail, you''re done.> > > > Is this possible to do? What happens when slot 3 gets a terabyte drive? > Will ZFS try to repair ZFSraid1 with the terabyte drive because it was > inserted into slot 3? Will I be able to create ZFSraid2 with slots 3-7? >Not unless you told zfs that one of the TB drives was a hot spare for raid1. Just a thought/question, but don''t you have any onboard SATA ports? You could temporarily attach a 1TB drive there, and move it to the card when you''re done. --Tim -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20081224/0bb5bf2b/attachment.html>
On Wed, 24 Dec 2008, Orvar Korvar wrote:> I was thinking of this plan: > > Unconnect one 500 GB drive from ZFSraid1. Now it only has 3 drives > (slots: 0-2), but that doesnt matter because I can still read the data, > because it is configured as raidz1. There are 5 empty SATA slots on the > SATA card now. Slot 3 is now emptied. > > Connect 5 terabyte drives to the empty slots, and create a ZFS raid. > copy all data from the 3 drives unto these 5 drives. Done.Why not plug one new drive into slot 4, partition it in 2 halves. Fill the other 3 slots with 3 new drives. create a raidz with the 5 new vdevs. ZFS send from the old to the new. Remove the old drives entirely. Add the final new drives, replace one of the halves of slot 4 with the new disk. I''m not sure if you can get away with a replace of a slice to a device for the last step, but if you can''t you sacrifice one of the old drives at this point, replace the slice with the other device, then replace back to the new full disk. If this last replace step works, then you never need to fiddle with the old drives, so you''re well protected against failures while configuring the new drives. Even if it doesn''t, you don''t destroy any of the old data until it is in a new configuration than can withstand the loss of any one device -- Dave
another comment below... David Finberg wrote:> On Wed, 24 Dec 2008, Orvar Korvar wrote: > >> I was thinking of this plan: >> >> Unconnect one 500 GB drive from ZFSraid1. Now it only has 3 drives >> (slots: 0-2), but that doesnt matter because I can still read the data, >> because it is configured as raidz1. There are 5 empty SATA slots on the >> SATA card now. Slot 3 is now emptied. >> >> Connect 5 terabyte drives to the empty slots, and create a ZFS raid. >> copy all data from the 3 drives unto these 5 drives. Done. >> > > Why not plug one new drive into slot 4, partition it in 2 halves. Fill > the other 3 slots with 3 new drives. create a raidz with the 5 new vdevs. > ZFS send from the old to the new. Remove the old drives entirely. >> Add the final new drives, replace one of the halves of slot 4 with the new > disk. I''m not sure if you can get away with a replace of a slice to a > device for the last step, but if you can''t you sacrifice one of the old > drives at this point, replace the slice with the other device, then > replace back to the new full disk. > > If this last replace step works, then you never need to fiddle with the > old drives, so you''re well protected against failures while > configuring the new drives. Even if it doesn''t, you don''t destroy any of > the old data until it is in a new configuration than can withstand the > loss of any one device >This is what I would do :-) But it really depends on the size of the data, not the size of the disks. -- richard
On Wed, Dec 24, 2008 at 2:50 PM, Orvar Korvar < knatte_fnatte_tjatte at yahoo.com> wrote:> I have a ZFS raid and wonder if it is possible to move the ZFS raid around > from SATA port to another? Ive heard that someone assembled the SATA > connections differently and the ZFS raid wouldnt work. > > Say that I have 8 SATA port controller card with 4 drives in a ZFS raid. > Sata ports 0-3 are occupied and Sata ports 4-7 are empty. Could I move SATA > connection nr 0 to the SATA port nr 4? > -- >Best would be if you could find another SATA port, or even an exernal USB enclosure, to use temporarily, even on any other controller. Then you can create the raidz 5x1TB drives, zfs send the data, and then get rid of the old drives without damaging the old pool. If anything does go wrong during the process, your old pool would still be in tact. Once the data transfer is complete, shut down and remove the old disks and then connect the drive which was temporarily on another controller onto a SATA controller as its final configuration. -- Any sufficiently advanced technology is indistinguishable from magic. Arthur C. Clarke My blog: http://initialprogramload.blogspot.com -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20081225/cd468dce/attachment.html>
I dont understand. The other hard drive connected to the temporary SATA port, mustn''t it be very big? I copy the entire old zpool to the temp drive, disconnect old zpool and create a new one. Then I send from the temp drive to the new zpool? The temp drive must be very large to hold the entire old zpool? -- This message posted from opensolaris.org
Ok, so I could partition a drive into two parts, and treat each of the partitions as one drive? And then I exchange one partition at a time with a whole new drive? That sounds neat. I must format the drive into two zfs partitions? Or UFS partitions? ZFS doesnt have partitions? And another thing, is it better to do a "cp *" or do "zfs send" when copying data from old zpool to new zpool? What is the differences? -- This message posted from opensolaris.org
On Fri, Dec 26, 2008 at 1:26 PM, Orvar Korvar < knatte_fnatte_tjatte at yahoo.com> wrote:> Ok, so I could partition a drive into two parts, and treat each of the > partitions as one drive? And then I exchange one partition at a time with a > whole new drive? That sounds neat. I must format the drive into two zfs > partitions? Or UFS partitions? ZFS doesnt have partitions? > > And another thing, is it better to do a "cp *" or do "zfs send" when > copying data from old zpool to new zpool? What is the differences? > >No, my suggestion is to 1. Connect four of the five 1TB drives to the available SATA ports. 2. Put the 5th one in an external USB enclosure, or find another SATA controller. 3. Then create the new pool of 5x1TB drives. 4. Then ZFS-send the data from the old pool to the new pool 5. Export the old pool, shut down and remove the old disks. 6. Move the disk which is on eSATA, or External USB or wherever to one of the freed-up USB ports. 7. Start up. You are done. -- Any sufficiently advanced technology is indistinguishable from magic. Arthur C. Clarke My blog: http://initialprogramload.blogspot.com -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20081226/1e081fe4/attachment.html>