Hi gurus, Just wanted some input on this for the day when an upgrade is necessary. Lets say I have simple pool made up of 3 750gb SATA disks in raidz1, giving around 1.3tb usable space. If we wanted to upgrade the disks, what is the accepted procedure? There are 6 SATA ports in the machine in question, so we can just add the 3 upraded disks, but what is the recommended procedure to re-create or migrate the pool to the new disks? thanks Matt
On 28 June, 2008 - Matt Harrison sent me these 0,6K bytes:> Hi gurus, > > Just wanted some input on this for the day when an upgrade is necessary. > > Lets say I have simple pool made up of 3 750gb SATA disks in raidz1, > giving around 1.3tb usable space. If we wanted to upgrade the disks, > what is the accepted procedure? There are 6 SATA ports in the machine in > question, so we can just add the 3 upraded disks, but what is the > recommended procedure to re-create or migrate the pool to the new disks?Currently, you can either replace the individual disks to upgrade 3x750 to 3x2TB or whatever disks you buy next.. that requires no extra ports.. Or you can just add a 3x2TB raidz1 along with the 3x750.. Unless you want to rebuild it into a 6 disk raidz(1/2), there''s not much need to re-create the pool.. But that will require sufficient storage somewhere else during the time.. /Tomas -- Tomas ?gren, stric at acc.umu.se, http://www.acc.umu.se/~stric/ |- Student at Computing Science, University of Ume? `- Sysadmin at {cs,acc}.umu.se
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Tomas ?gren wrote: | On 28 June, 2008 - Matt Harrison sent me these 0,6K bytes: | |> Hi gurus, |> |> Just wanted some input on this for the day when an upgrade is necessary. |> |> Lets say I have simple pool made up of 3 750gb SATA disks in raidz1, |> giving around 1.3tb usable space. If we wanted to upgrade the disks, |> what is the accepted procedure? There are 6 SATA ports in the machine in |> question, so we can just add the 3 upraded disks, but what is the |> recommended procedure to re-create or migrate the pool to the new disks? | | Currently, you can either replace the individual disks to upgrade 3x750 | to 3x2TB or whatever disks you buy next.. that requires no extra ports.. | Or you can just add a 3x2TB raidz1 along with the 3x750.. Unless you | want to rebuild it into a 6 disk raidz(1/2), there''s not much need to | re-create the pool.. But that will require sufficient storage somewhere | else during the time.. Thanks for the reply, I''d rather keep the pool to 3 disks if possible, so I can keep the option of adding 3 more disks, whether it be for backup or recovery purposes later. If i were to add, for example a 3x2TB raidz1 alongside the 3x750GB, what is the best way to transfer things from one pool to the other? Minimising time expended and of course taking full advantage of the new capacities. thanks - -- Matt Harrison iwasinnamuknow at genestate.com http://mattharrison.org -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (MingW32) iEYEARECAAYFAkhmDwUACgkQxNZfa+YAUWEzJACaAqkgsL6lPXXIwup2glcFv33B rVYAn3wznTY4K0+oyiKs22s+I+n0J9ov =ejuw -----END PGP SIGNATURE-----
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Matt Harrison wrote: | Tomas ?gren wrote: | | On 28 June, 2008 - Matt Harrison sent me these 0,6K bytes: | | | |> Hi gurus, | |> | |> Just wanted some input on this for the day when an upgrade is necessary. | |> | |> Lets say I have simple pool made up of 3 750gb SATA disks in raidz1, | |> giving around 1.3tb usable space. If we wanted to upgrade the disks, | |> what is the accepted procedure? There are 6 SATA ports in the machine in | |> question, so we can just add the 3 upraded disks, but what is the | |> recommended procedure to re-create or migrate the pool to the new disks? | | | | Currently, you can either replace the individual disks to upgrade 3x750 | | to 3x2TB or whatever disks you buy next.. that requires no extra ports.. | | Or you can just add a 3x2TB raidz1 along with the 3x750.. Unless you | | want to rebuild it into a 6 disk raidz(1/2), there''s not much need to | | re-create the pool.. But that will require sufficient storage somewhere | | else during the time.. | | Thanks for the reply, | | I''d rather keep the pool to 3 disks if possible, so I can keep the | option of adding 3 more disks, whether it be for backup or recovery | purposes later. | | If i were to add, for example a 3x2TB raidz1 alongside the 3x750GB, what | is the best way to transfer things from one pool to the other? | Minimising time expended and of course taking full advantage of the new | capacities. I seem to have overlooked the first part of your reply, I can just replace the disks one at a time, and of course the pool would rebuild itself onto the new disk. Would this automatically extend the size of the pool once all 3 disks are replaced? thanks - -- Matt Harrison iwasinnamuknow at genestate.com http://mattharrison.org -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (MingW32) iEYEARECAAYFAkhmEUcACgkQxNZfa+YAUWFYewCfdA2Ax4fU2NUNK+mOtdI+pT2W cMsAnj0FSaQp7DNdTpU61IqCCjytY8T3 =k8aG -----END PGP SIGNATURE-----
Matt Harrison wrote: ....> I seem to have overlooked the first part of your reply, I can just > replace the disks one at a time, and of course the pool would rebuild > itself onto the new disk. Would this automatically extend the size of > the pool once all 3 disks are replaced?Yes - once the resilvering has finished on the final disk replacement. I used exactly this process to increase my poolsize from 2x200G to 2x320G disks last year. It was easy - so easy that I wondered what I had forgotten to do ... but nope, nothing - It Just Works(tm). James C. McPherson -- Senior Kernel Software Engineer, Solaris Sun Microsystems http://blogs.sun.com/jmcp http://www.jmcp.homeunix.com/blog
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 James C. McPherson wrote: | Matt Harrison wrote: | .... |> I seem to have overlooked the first part of your reply, I can just |> replace the disks one at a time, and of course the pool would rebuild |> itself onto the new disk. Would this automatically extend the size of |> the pool once all 3 disks are replaced? | | Yes - once the resilvering has finished on the final | disk replacement. I used exactly this process to increase | my poolsize from 2x200G to 2x320G disks last year. It | was easy - so easy that I wondered what I had forgotten | to do ... but nope, nothing - It Just Works(tm). Excellent that sounds great. I''m almost looking forward to an expansion in a year or so ;) thanks - -- Matt Harrison iwasinnamuknow at genestate.com http://mattharrison.org -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (MingW32) iEYEARECAAYFAkhmR0YACgkQxNZfa+YAUWEu+ACg8eGJzp3xRHN7FByzLUVc2q+b LBYAoMnmIH2naDBJfsYlzGENmYPc10qO =1jba -----END PGP SIGNATURE-----
James C. McPherson wrote:> Matt Harrison wrote: > .... >> I seem to have overlooked the first part of your reply, I can just >> replace the disks one at a time, and of course the pool would rebuild >> itself onto the new disk. Would this automatically extend the size of >> the pool once all 3 disks are replaced? > > Yes - once the resilvering has finished on the final > disk replacement. I used exactly this process to increase > my poolsize from 2x200G to 2x320G disks last year. It > was easy - so easy that I wondered what I had forgotten > to do ... but nope, nothing - It Just Works(tm).I''ve just done this procedure on a test server, just so I know what I''m playing with when the time comes. I''ve replaced all 3 disks in a raid1z set and waited for all the resilvering...the only problem is, my pool capacity is still exactly the same. Moving from 3x8Gb disks in raid1z giving ~16Gb space to 3x20Gb disks, and I still have ~16Gb usable space. I used the following commands to do the changes: zpool replace tank c1t1d0 c2t0d0 zpool replace tank c1t2d0 c2t1d0 zpool replace tank c1t3d0 c2t2d0 Where c1x are the old 8Gb disks and c2x are the new 20Gb disks. Is there something I missed? Thanks Matt
Matt Harrison schrieb:> James C. McPherson wrote: > >> Matt Harrison wrote: >> .... >> >>> I seem to have overlooked the first part of your reply, I can just >>> replace the disks one at a time, and of course the pool would rebuild >>> itself onto the new disk. Would this automatically extend the size of >>> the pool once all 3 disks are replaced? >>> >> Yes - once the resilvering has finished on the final >> disk replacement. I used exactly this process to increase >> my poolsize from 2x200G to 2x320G disks last year. It >> was easy - so easy that I wondered what I had forgotten >> to do ... but nope, nothing - It Just Works(tm). >> > > I''ve just done this procedure on a test server, just so I know what I''m > playing with when the time comes. > > I''ve replaced all 3 disks in a raid1z set and waited for all the > resilvering...the only problem is, my pool capacity is still exactly the > same. > > Moving from 3x8Gb disks in raid1z giving ~16Gb space to 3x20Gb disks, > and I still have ~16Gb usable space. > > I used the following commands to do the changes: > > zpool replace tank c1t1d0 c2t0d0 > zpool replace tank c1t2d0 c2t1d0 > zpool replace tank c1t3d0 c2t2d0 > > Where c1x are the old 8Gb disks and c2x are the new 20Gb disks. > >A time ago a zpool needed a export/import to get to the new capacity (or a reboot). I don''t know if this still holds true but it is worth a try. Arne
Arne Schwabe wrote:> A time ago a zpool needed a export/import to get to the new capacity (or > a reboot). I don''t know if this still holds true but it is worth a try. > > ArneAah, excellent, just did an export/import and its now showing the expected capacity increase. Thanks for that, I should''ve at least tried a reboot :) Thanks Matt
Matt Harrison <iwasinnamuknow <at> genestate.com> writes:> > Aah, excellent, just did an export/import and its now showing the > expected capacity increase. Thanks for that, I should''ve at least tried > a reboot :)More recent OpenSolaris builds don''t even need the export/import anymore when expanding a raidz this way (I tested with build 82). -marc