zfs discuss - Jan 2009 - zfs root, jumpstart and flash archives

I understand that currently, at least under Solaris 10u6, it is not 
possible to jumpstart a new system with a zfs root using a flash archive 
as a source.

Can anyone comment as to whether this restriction will pass in the near 
term, or if this is a while out (6+ months) before this will be possible?

Thanks,

Jerry

This is in the process of being resolved right now.  Stay tuned
for when it will be available.  It might be a patch to Update 6.

In the meantime, you might try this:

http://blogs.sun.com/scottdickson/entry/flashless_system_cloning_with_zfs

- Lori


On 01/09/09 12:28, Jerry K wrote:
> I understand that currently, at least under Solaris 10u6, it is not 
> possible to jumpstart a new system with a zfs root using a flash archive 
> as a source.
>
> Can anyone comment as to whether this restriction will pass in the near 
> term, or if this is a while out (6+ months) before this will be possible?
>
> Thanks,
>
> Jerry
> _______________________________________________
> zfs-discuss mailing list
> zfs-discuss at opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
>

Hello Lori,

Any update to this issue, and can you speculate as to if it will be a 
patch to Solaris 10u6, or part of 10u7?

Thanks again,

Jerry


Lori Alt wrote:
> 
> This is in the process of being resolved right now.  Stay tuned
> for when it will be available.  It might be a patch to Update 6.
> 
> In the meantime, you might try this:
> 
> http://blogs.sun.com/scottdickson/entry/flashless_system_cloning_with_zfs
> 
> - Lori
> 
> 
> On 01/09/09 12:28, Jerry K wrote:
>> I understand that currently, at least under Solaris 10u6, it is not 
>> possible to jumpstart a new system with a zfs root using a flash 
>> archive as a source.
>>
>> Can anyone comment as to whether this restriction will pass in the 
>> near term, or if this is a while out (6+ months) before this will be 
>> possible?
>>
>> Thanks,
>>
>> Jerry
>> _______________________________________________
>> zfs-discuss mailing list
>> zfs-discuss at opensolaris.org
>> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
>>

Latest is that this will go into an early build of Update 8
and be available as a patch shortly thereafter (shortly
after it''s putback, that is.  The patch doesn''t have to wait
for U8
to be released.)

I will update the CR with this information.

Lori


On 02/18/09 09:12, Jerry K wrote:
> Hello Lori,
>
> Any update to this issue, and can you speculate as to if it will be a 
> patch to Solaris 10u6, or part of 10u7?
>
> Thanks again,
>
> Jerry
>
>
> Lori Alt wrote:
>>
>> This is in the process of being resolved right now.  Stay tuned
>> for when it will be available.  It might be a patch to Update 6.
>>
>> In the meantime, you might try this:
>>
>>
http://blogs.sun.com/scottdickson/entry/flashless_system_cloning_with_zfs
>>
>>
>> - Lori
>>
>>
>> On 01/09/09 12:28, Jerry K wrote:
>>> I understand that currently, at least under Solaris 10u6, it is not
>>> possible to jumpstart a new system with a zfs root using a flash 
>>> archive as a source.
>>>
>>> Can anyone comment as to whether this restriction will pass in the 
>>> near term, or if this is a while out (6+ months) before this will
be
>>> possible?
>>>
>>> Thanks,
>>>
>>> Jerry
>>> _______________________________________________
>>> zfs-discuss mailing list
>>> zfs-discuss at opensolaris.org
>>> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
>>>

Hello Lori,

Thank you again for the quick reply.

Unfortunately, I had mistakenly anticipated a somewhat quicker 
integration than Solaris 10u8.

Approaching this from another angle, would it be possible for me to 
build a jumpstart server using a current Solaris Nevada b107/SXCE, and 
to ultimately jumpstart Solaris 10u6 clients with a ZFS root using a 
flash archive as a source?

thank you,

Jerry Kemp

On 02/18/09 10:40, Lori Alt wrote:
> Latest is that this will go into an early build of Update 8
> and be available as a patch shortly thereafter (shortly
> after it''s putback, that is.  The patch doesn''t have to
wait for U8
> to be released.)
> 
> I will update the CR with this information.
> 
> Lori
> 
> 
> On 02/18/09 09:12, Jerry K wrote:
>> Hello Lori,
>>
>> Any update to this issue, and can you speculate as to if it will be a 
>> patch to Solaris 10u6, or part of 10u7?
>>
>> Thanks again,
>>
>> Jerry
>>
>>
>> Lori Alt wrote:
>>>
>>> This is in the process of being resolved right now.  Stay tuned
>>> for when it will be available.  It might be a patch to Update 6.
>>>
>>> In the meantime, you might try this:
>>>
>>>
http://blogs.sun.com/scottdickson/entry/flashless_system_cloning_with_zfs
>>>
>>>
>>> - Lori
>>>
>>>
>>> On 01/09/09 12:28, Jerry K wrote:
>>>> I understand that currently, at least under Solaris 10u6, it is
not
>>>> possible to jumpstart a new system with a zfs root using a
flash
>>>> archive as a source.
>>>>
>>>> Can anyone comment as to whether this restriction will pass in
the
>>>> near term, or if this is a while out (6+ months) before this
will be
>>>> possible?
>>>>
>>>> Thanks,
>>>>

On 02/18/09 21:24, Jerry Kemp wrote:
> Hello Lori,
>
> Thank you again for the quick reply.
>
> Unfortunately, I had mistakenly anticipated a somewhat quicker 
> integration than Solaris 10u8.
>
> Approaching this from another angle, would it be possible for me to 
> build a jumpstart server using a current Solaris Nevada b107/SXCE, and 
> to ultimately jumpstart Solaris 10u6 clients with a ZFS root using a 
> flash archive as a source?
No, you need install software that has been modified
to understand how to unpack a flash archive onto
a system that has been created with a zfs pool.

There is this:

http://blogs.sun.com/scottdickson/entry/flashless_system_cloning_with_zfs

It''s not the same as flash archive support, but it accomplishes
some of the same goals.

- Lori
>
> thank you,
>
> Jerry Kemp
>
> On 02/18/09 10:40, Lori Alt wrote:
>> Latest is that this will go into an early build of Update 8
>> and be available as a patch shortly thereafter (shortly
>> after it''s putback, that is.  The patch doesn''t have
to wait for U8
>> to be released.)
>>
>> I will update the CR with this information.
>>
>> Lori
>>
>>
>> On 02/18/09 09:12, Jerry K wrote:
>>> Hello Lori,
>>>
>>> Any update to this issue, and can you speculate as to if it will be
>>> a patch to Solaris 10u6, or part of 10u7?
>>>
>>> Thanks again,
>>>
>>> Jerry
>>>
>>>
>>> Lori Alt wrote:
>>>>
>>>> This is in the process of being resolved right now.  Stay tuned
>>>> for when it will be available.  It might be a patch to Update
6.
>>>>
>>>> In the meantime, you might try this:
>>>>
>>>>
http://blogs.sun.com/scottdickson/entry/flashless_system_cloning_with_zfs
>>>>
>>>>
>>>> - Lori
>>>>
>>>>
>>>> On 01/09/09 12:28, Jerry K wrote:
>>>>> I understand that currently, at least under Solaris 10u6,
it is
>>>>> not possible to jumpstart a new system with a zfs root
using a
>>>>> flash archive as a source.
>>>>>
>>>>> Can anyone comment as to whether this restriction will pass
in the
>>>>> near term, or if this is a while out (6+ months) before
this will
>>>>> be possible?
>>>>>
>>>>> Thanks,
>>>>>

Hello Lori,

It has been a while since this has been discussed, and I am hoping that 
you can provide an update, or time estimate.  As we are several months 
into Update 7, is there any chance of an Update 7 patch, or are we still 
waiting for Update 8.

Also, can you share the CR # that you mentioned in your previous email 
(below), so I can read further into this?

thanks again,

Jerry Kemp


Lori Alt wrote:
> Latest is that this will go into an early build of Update 8
> and be available as a patch shortly thereafter (shortly
> after it''s putback, that is.  The patch doesn''t have to
wait for U8
> to be released.)
> 
> I will update the CR with this information.
> 
> Lori
> 
> 
> On 02/18/09 09:12, Jerry K wrote:
>> Hello Lori,
>>
>> Any update to this issue, and can you speculate as to if it will be a 
>> patch to Solaris 10u6, or part of 10u7?
>>
>> Thanks again,
>>
>> Jerry
>>
>>
>> Lori Alt wrote:
>>>
>>> This is in the process of being resolved right now.  Stay tuned
>>> for when it will be available.  It might be a patch to Update 6.
>>>
>>> In the meantime, you might try this:
>>>
>>>
http://blogs.sun.com/scottdickson/entry/flashless_system_cloning_with_zfs
>>>
>>>
>>> - Lori
>>>
>>>
>>> On 01/09/09 12:28, Jerry K wrote:
>>>> I understand that currently, at least under Solaris 10u6, it is
not
>>>> possible to jumpstart a new system with a zfs root using a
flash
>>>> archive as a source.
>>>>
>>>> Can anyone comment as to whether this restriction will pass in
the
>>>> near term, or if this is a while out (6+ months) before this
will be
>>>> possible?
>>>>
>>>> Thanks,
>>>>
>>>> Jerry
>>>> _______________________________________________
>>>> zfs-discuss mailing list
>>>> zfs-discuss at opensolaris.org
>>>> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
>>>>

On Wed, 8 Jul 2009, Jerry K wrote:
> It has been a while since this has been discussed, and I am hoping that you
> can provide an update, or time estimate.  As we are several months into 
> Update 7, is there any chance of an Update 7 patch, or are we still waiting
> for Update 8.
I saw that a Solaris 10 patch for supporting Flash archives on ZFS 
came out about a week ago.

Bob
--
Bob Friesenhahn
bfriesen at simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/
GraphicsMagick Maintainer,    http://www.GraphicsMagick.org/

Any idea what the Patch ID was?

fpsm

On Wed, Jul 8, 2009 at 3:43 PM, Bob
Friesenhahn<bfriesen at simple.dallas.tx.us>
wrote:
> On Wed, 8 Jul 2009, Jerry K wrote:
>
>> It has been a while since this has been discussed, and I am hoping that
>> you can provide an update, or time estimate. ?As we are several months
into
>> Update 7, is there any chance of an Update 7 patch, or are we still
waiting
>> for Update 8.
>
> I saw that a Solaris 10 patch for supporting Flash archives on ZFS came out
> about a week ago.
>
> Bob
> --
> Bob Friesenhahn
> bfriesen at simple.dallas.tx.us,
http://www.simplesystems.org/users/bfriesen/
> GraphicsMagick Maintainer, ? ?http://www.GraphicsMagick.org/
> _______________________________________________
> zfs-discuss mailing list
> zfs-discuss at opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
>

On Wed, 8 Jul 2009, Fredrich Maney wrote:
> Any idea what the Patch ID was?
x86:	119535-15
SPARC:	119534

Description of change "6690473 request to have flash support for ZFS 
root install".

Bob
--
Bob Friesenhahn
bfriesen at simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/
GraphicsMagick Maintainer,    http://www.GraphicsMagick.org/

On 07/08/09 13:43, Bob Friesenhahn wrote:
> On Wed, 8 Jul 2009, Jerry K wrote:
>
>> It has been a while since this has been discussed, and I am hoping 
>> that you can provide an update, or time estimate.  As we are several 
>> months into Update 7, is there any chance of an Update 7 patch, or 
>> are we still waiting for Update 8.
>
> I saw that a Solaris 10 patch for supporting Flash archives on ZFS 
> came out about a week ago.
Correct.  These are the patches:

sparc:
119534-15 : fixes to the /usr/sbin/flarcreate and /usr/sbin/flar command
124630-26: updates to the install software

x86:
119535-15 : fixes to the /usr/sbin/flarcreate and /usr/sbin/flar command
124631-27: updates to the install software


Lori
-------------- next part --------------
An embedded message was scrubbed...
From: Lori Alt <Lori.Alt at Sun.COM>
Subject: zfs flash archive patches now "release ready"
Date: Wed, 01 Jul 2009 04:07:05 -0600
Size: 4848
URL:
<http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20090708/c829aa9a/attachment.mht>

Bob,

Patches that allow the creation and installation of a flash archive on a 
zpool are available:

For SPARC:
119534-15 : fixes to the /usr/sbin/flarcreate and /usr/sbin/flar command
124630-26: updates to the install software

For x86:
119535-15 : fixes to the /usr/sbin/flarcreate and /usr/sbin/flar command
124631-27: updates to the install software

You''ll have to patch the miniroot of your network boot server in order 
to have it work 
(http://www.sun.com/bigadmin/features/hub_articles/patchmini.jsp).

Jnm.

--

Bob Friesenhahn a ?crit :
> On Wed, 8 Jul 2009, Jerry K wrote:
>
>> It has been a while since this has been discussed, and I am hoping 
>> that you can provide an update, or time estimate.  As we are several 
>> months into Update 7, is there any chance of an Update 7 patch, or 
>> are we still waiting for Update 8.
>
> I saw that a Solaris 10 patch for supporting Flash archives on ZFS 
> came out about a week ago.
>
> Bob
> -- 
> Bob Friesenhahn
> bfriesen at simple.dallas.tx.us, 
> http://www.simplesystems.org/users/bfriesen/
> GraphicsMagick Maintainer,    http://www.GraphicsMagick.org/
> _______________________________________________
> zfs-discuss mailing list
> zfs-discuss at opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Hi
for sparc
119534-15
124630-26


for x86
119535-15
124631-27

higher rev''s of these will also suffice.

Note these need to be applied to the miniroot of the jumpstart image so 
that it can then install zfs flash archive.
  please read the README notes in these for more specific instructions, 
including instructions on miniroot patching.

Enda

Fredrich Maney wrote:
> Any idea what the Patch ID was?
> 
> fpsm
> 
> On Wed, Jul 8, 2009 at 3:43 PM, Bob
> Friesenhahn<bfriesen at simple.dallas.tx.us> wrote:
>> On Wed, 8 Jul 2009, Jerry K wrote:
>>
>>> It has been a while since this has been discussed, and I am hoping
that
>>> you can provide an update, or time estimate.  As we are several
months into
>>> Update 7, is there any chance of an Update 7 patch, or are we still
waiting
>>> for Update 8.
>> I saw that a Solaris 10 patch for supporting Flash archives on ZFS came
out
>> about a week ago.
>>
>> Bob
>> --
>> Bob Friesenhahn
>> bfriesen at simple.dallas.tx.us,
http://www.simplesystems.org/users/bfriesen/
>> GraphicsMagick Maintainer,    http://www.GraphicsMagick.org/
>> _______________________________________________
>> zfs-discuss mailing list
>> zfs-discuss at opensolaris.org
>> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
>>
> _______________________________________________
> zfs-discuss mailing list
> zfs-discuss at opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Thanks everyone for the patch IDs.

On Wed, Jul 8, 2009 at 4:50 PM, Enda O''Connor<Enda.Oconnor at
sun.com> wrote:
> Hi
> for sparc
> 119534-15
> 124630-26
>
>
> for x86
> 119535-15
> 124631-27
>
> higher rev''s of these will also suffice.
>
> Note these need to be applied to the miniroot of the jumpstart image so
that
> it can then install zfs flash archive.
> ?please read the README notes in these for more specific instructions,
> including instructions on miniroot patching.
>
> Enda
>
> Fredrich Maney wrote:
>>
>> Any idea what the Patch ID was?
>>
>> fpsm
>>
>> On Wed, Jul 8, 2009 at 3:43 PM, Bob
>> Friesenhahn<bfriesen at simple.dallas.tx.us> wrote:
>>>
>>> On Wed, 8 Jul 2009, Jerry K wrote:
>>>
>>>> It has been a while since this has been discussed, and I am
hoping that
>>>> you can provide an update, or time estimate. ?As we are several
months
>>>> into
>>>> Update 7, is there any chance of an Update 7 patch, or are we
still
>>>> waiting
>>>> for Update 8.
>>>
>>> I saw that a Solaris 10 patch for supporting Flash archives on ZFS
came
>>> out
>>> about a week ago.
>>>
>>> Bob
>>> --
>>> Bob Friesenhahn
>>> bfriesen at simple.dallas.tx.us,
>>> http://www.simplesystems.org/users/bfriesen/
>>> GraphicsMagick Maintainer, ? ?http://www.GraphicsMagick.org/
>>> _______________________________________________
>>> zfs-discuss mailing list
>>> zfs-discuss at opensolaris.org
>>> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
>>>
>> _______________________________________________
>> zfs-discuss mailing list
>> zfs-discuss at opensolaris.org
>> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
>
>

I''ve been hoping to get my hands on patches that permit Sol10U7 to do a
luupgrade -f of a ZFS root-based ABE since Solaris 10 10/08.

Unfortunately, after applying patchids 119534-15 and 124630-26 to both the PBE
and the miniroot of the OS image, I''m still getting the same
"ERROR: Field 2 - Invalid disk name (insert_abe_name_here)".

The flarcreate command I used was simply 

  #  flarcreate -n root_var_no_snap /export/fssnap/flars/root_var

which created a flar file that was about 4 to 5 times the size of a UFS-based
flar file.

I then used the command

  # luupgrade -f -n be_d70 -s /export/fssnap/os_image \
  > -a /export/fssnap/flars/root_var

which then failed with the pfinstall diagnostic given above.

What am I still doing wrong?

ttfn
mm
mark.o.michael at boeing.com
mark.michael at es.bss.boeing.com
-- 
This message posted from opensolaris.org

Flash archive on zfs means archiving an entire root pool (minus any 
explicitly excluded datasets), not an individual BE.  These types of 
flash archives can only be installed using Jumpstart and are intended to 
install an entire system, not an individual BE.

Flash archives of a single BE could perhaps be implemented in the future.

Lori

On 07/09/09 09:56, Mark Michael wrote:
> I''ve been hoping to get my hands on patches that permit Sol10U7 to
do a luupgrade -f of a ZFS root-based ABE since Solaris 10 10/08.
>
> Unfortunately, after applying patchids 119534-15 and 124630-26 to both the
PBE and the miniroot of the OS image, I''m still getting the same
"ERROR: Field 2 - Invalid disk name (insert_abe_name_here)".
>
> The flarcreate command I used was simply 
>
>   #  flarcreate -n root_var_no_snap /export/fssnap/flars/root_var
>
> which created a flar file that was about 4 to 5 times the size of a
UFS-based flar file.
>
> I then used the command
>
>   # luupgrade -f -n be_d70 -s /export/fssnap/os_image \
>   > -a /export/fssnap/flars/root_var
>
> which then failed with the pfinstall diagnostic given above.
>
> What am I still doing wrong?
>
> ttfn
> mm
> mark.o.michael at boeing.com
> mark.michael at es.bss.boeing.com
>

Thanks for the info.  Hope that the pfinstall changes to support zfs root flash
jumpstarts can be extended to support luupgrade -f at some point soon.

BTW, where can I find an example profile?  do I just substitute in the 

  install_type flash_install
  archive_location ...

for

   install_type initial_install

??
-- 
This message posted from opensolaris.org

On 07/09/09 17:25, Mark Michael wrote:
> Thanks for the info.  Hope that the pfinstall changes to support zfs root
flash jumpstarts can be extended to support luupgrade -f at some point soon.
>
> BTW, where can I find an example profile?  do I just substitute in the 
>
>   install_type flash_install
>   archive_location ...
>
> for
>
>    install_type initial_install
>
> ??
>   
Here''s a sample:

install_type flash_install
archive_location nfs schubert:/export/home/lalt/mirror.flar
partitioning explicit
pool rpool auto auto auto mirror c0t1d0s0 c0t0d0s0

Worked great during test jumpstart, thanks!
-- 
This message posted from opensolaris.org

Hi.

First - Thanks very much for releasing this as a patch and not making us wait 
until U8. It''s very much appreciated. Things we put on hold can start
moving
again which is a good thing.



Is there further documentation on this yet? I haven''t been able to find
it, and
it looks like most of the interesting stuff is in ''pfinstall''
so I can''t just
go look and see how it works.. I have a couple of questions on how zfsroot 
interacts with flash install - I''m happy to go figure it out if you can
point
me at the docs.. Failing that, hopefully someone can help me answer the below 
questions.

on our zfs root systems, we like to keep /var as a separate dataset on servers 
so we can monitor it''s usage. We did that before with the line:
bootenv installbe bename zfsroot dataset /var

additional datasets I create in a finish script.

Can a zfsroot flash installed system have a separate dataset for /var?


It seems a little counter intuitive to me to say
partitioning explicit
when everything is going into a zfs pool with a single dataset - are there 
other profile tokens that make this.


One last thing - My flash installs are working, but I''m ending up with
/tmp as
a non tmpfs filesystem (no vfstab entry for it..) I can easily fix this in a 
postinstall/finish script, but if there is a reason it''s not happening
that can
be fixed in my JS profile, that would be better.


Thanks again.

Kris Kasner
Qualcomm Inc.

Jul 9 at 16:41, Lori Alt <Lori.Alt at Sun.COM> wrote:
> On 07/09/09 17:25, Mark Michael wrote:
>> Thanks for the info.  Hope that the pfinstall changes to support zfs
root flash jumpstarts can be extended to support luupgrade -f at some point
soon.
>>
>> BTW, where can I find an example profile?  do I just substitute in the
>>
>>   install_type flash_install
>>   archive_location ...
>>
>> for
>>
>>    install_type initial_install
>>
>> ??
>>
> Here''s a sample:
>
> install_type flash_install
> archive_location nfs schubert:/export/home/lalt/mirror.flar
> partitioning explicit
> pool rpool auto auto auto mirror c0t1d0s0 c0t0d0s0
>
>
>
> _______________________________________________
> zfs-discuss mailing list
> zfs-discuss at opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
>

On 08/19/09 14:57, Kris Kasner wrote:
>
> Hi.
>
> First - Thanks very much for releasing this as a patch and not making 
> us wait until U8. It''s very much appreciated. Things we put on
hold
> can start moving again which is a good thing.
>
>
>
> Is there further documentation on this yet? 
I just asked Cindy Swearingen, the tech writer for ZFS, about this and 
sadly, it appears that there isn''t any documentation for this available
outside of Sun yet.  The documentation for using flash archives to set 
up systems with zfs roots won''t be available until the release of U8. 
I
will give you the very short summary and Cindy is going to look into 
putting some more information out on the zfs-boot page of the 
opensolaris website (which doesn''t really make sense since this
isnt''
supported on OpenSolaris, but whatever).
> I haven''t been able to find it, and it looks like most of the 
> interesting stuff is in ''pfinstall'' so I can''t
just go look and see
> how it works.. I have a couple of questions on how zfsroot interacts 
> with flash install - I''m happy to go figure it out if you can
point me
> at the docs.. Failing that, hopefully someone can help me answer the 
> below questions.
>
> on our zfs root systems, we like to keep /var as a separate dataset on 
> servers so we can monitor it''s usage. We did that before with the
line:
> bootenv installbe bename zfsroot dataset /var
Bottom line: whatever the configuration is of the system that you use as 
the basis for generating the flash archive, that''s the configuration 
that will exist on systems installed using the flar.  If the original 
system has a separate /var, the systems created from it will have a 
separate  /var.
>
> additional datasets I create in a finish script.
>
> Can a zfsroot flash installed system have a separate dataset for /var?
>
>
> It seems a little counter intuitive to me to say
> partitioning explicit
> when everything is going into a zfs pool with a single dataset - are 
> there other profile tokens that make this.
Yes, I  know, but that''s the way flash archive support works (even 
before zfs was added to it).
>
>
> One last thing - My flash installs are working, but I''m ending up
with
> /tmp as a non tmpfs filesystem (no vfstab entry for it..) I can easily 
> fix this in a postinstall/finish script, but if there is a reason
it''s
> not happening that can be fixed in my JS profile, that would be better.
I don''t know why you wouldn''t have a separate /tmp.  If
you''re sure that
the system from which the flar is generated has a /tmp  file system, but 
the system that results from the install of the flash archive does not 
have a separate  /tmp, there might be a bug.  Get back to me on it  
later if you confirm this.

So here''s the quick summary of how to do flash archive installs of 
systems with zfs root file systems:

1.  Set up the system that you want to replicate or re-create.  I.e. 
install a system with a zfs root file system and add whatever 
customizations you want to it.  By default, ALL datasets in the root 
pool (except for swap and dump) are included in the flash archive, not 
just those that are part of the Solaris name space.

2.  Use flarcreate to create the flash archive on the system.  There is 
a new -D <dataset> option that can be used (repeatedly, if you wish) on 
the command to exclude datasets from the archive.

So an example command might be:

   # flarcreate -n ourU8 -D rpool/somedata /some-remote-directory/ourU8.flar

3.  Set up the system you want to install for jumpstart install (however 
you do that).  Use a profile something like this:

install_type flash_install
archive_location nfs schubert:/export/home/lalt/U8.flar
partitioning explicit
pool rpool auto auto auto mirror c0t1d0s0 c0t0d0s0

I think that covers the basics.

Lori
>
>
> Thanks again.
>
> Kris Kasner
> Qualcomm Inc.
>
> Jul 9 at 16:41, Lori Alt <Lori.Alt at Sun.COM> wrote:
>
>> On 07/09/09 17:25, Mark Michael wrote:
>>> Thanks for the info.  Hope that the pfinstall changes to support
zfs
>>> root flash jumpstarts can be extended to support luupgrade -f at 
>>> some point soon.
>>>
>>> BTW, where can I find an example profile?  do I just substitute in
the
>>>
>>>   install_type flash_install
>>>   archive_location ...
>>>
>>> for
>>>
>>>    install_type initial_install
>>>
>>> ??
>>>
>> Here''s a sample:
>>
>> install_type flash_install
>> archive_location nfs schubert:/export/home/lalt/mirror.flar
>> partitioning explicit
>> pool rpool auto auto auto mirror c0t1d0s0 c0t0d0s0
>>
>>
>>
>> _______________________________________________
>> zfs-discuss mailing list
>> zfs-discuss at opensolaris.org
>> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
>>
>

I added some preliminary ZFS/flash information here:

http://opensolaris.org/os/community/zfs/boot/flash/

This page includes extracts from the not-yet-released Solaris 10 ZFS
Admin Guide.

Let me know this if its not enough to get you rolling.

Whatever comments/corrections are provided will be added to the
upcoming Solaris 10 docs.

Thanks,

Cindy

On 08/19/09 16:13, Lori Alt wrote:
> 
> 
> On 08/19/09 14:57, Kris Kasner wrote:
> 
>>
>> Hi.
>>
>> First - Thanks very much for releasing this as a patch and not making 
>> us wait until U8. It''s very much appreciated. Things we put on
hold
>> can start moving again which is a good thing.
>>
>>
>>
>> Is there further documentation on this yet? 
> 
> 
> I just asked Cindy Swearingen, the tech writer for ZFS, about this and 
> sadly, it appears that there isn''t any documentation for this
available
> outside of Sun yet.  The documentation for using flash archives to set 
> up systems with zfs roots won''t be available until the release of
U8.  I
> will give you the very short summary and Cindy is going to look into 
> putting some more information out on the zfs-boot page of the 
> opensolaris website (which doesn''t really make sense since this
isnt''
> supported on OpenSolaris, but whatever).
> 
>> I haven''t been able to find it, and it looks like most of the 
>> interesting stuff is in ''pfinstall'' so I
can''t just go look and see
>> how it works.. I have a couple of questions on how zfsroot interacts 
>> with flash install - I''m happy to go figure it out if you can
point me
>> at the docs.. Failing that, hopefully someone can help me answer the 
>> below questions.
>>
>> on our zfs root systems, we like to keep /var as a separate dataset on 
>> servers so we can monitor it''s usage. We did that before with
the line:
>> bootenv installbe bename zfsroot dataset /var
> 
> Bottom line: whatever the configuration is of the system that you use as 
> the basis for generating the flash archive, that''s the
configuration
> that will exist on systems installed using the flar.  If the original 
> system has a separate /var, the systems created from it will have a 
> separate  /var.
> 
>>
>> additional datasets I create in a finish script.
>>
>> Can a zfsroot flash installed system have a separate dataset for /var?
>>
>>
>> It seems a little counter intuitive to me to say
>> partitioning explicit
>> when everything is going into a zfs pool with a single dataset - are 
>> there other profile tokens that make this.
> 
> Yes, I  know, but that''s the way flash archive support works (even
> before zfs was added to it).
> 
>>
>>
>> One last thing - My flash installs are working, but I''m ending
up with
>> /tmp as a non tmpfs filesystem (no vfstab entry for it..) I can easily 
>> fix this in a postinstall/finish script, but if there is a reason
it''s
>> not happening that can be fixed in my JS profile, that would be better.
> 
> I don''t know why you wouldn''t have a separate /tmp.  If
you''re sure that
> the system from which the flar is generated has a /tmp  file system, but 
> the system that results from the install of the flash archive does not 
> have a separate  /tmp, there might be a bug.  Get back to me on it  
> later if you confirm this.
> 
> So here''s the quick summary of how to do flash archive installs of
> systems with zfs root file systems:
> 
> 1.  Set up the system that you want to replicate or re-create.  I.e. 
> install a system with a zfs root file system and add whatever 
> customizations you want to it.  By default, ALL datasets in the root 
> pool (except for swap and dump) are included in the flash archive, not 
> just those that are part of the Solaris name space.
> 
> 2.  Use flarcreate to create the flash archive on the system.  There is 
> a new -D <dataset> option that can be used (repeatedly, if you wish)
on
> the command to exclude datasets from the archive.
> 
> So an example command might be:
> 
>    # flarcreate -n ourU8 -D rpool/somedata 
> /some-remote-directory/ourU8.flar
> 
> 3.  Set up the system you want to install for jumpstart install (however 
> you do that).  Use a profile something like this:
> 
> install_type flash_install
> archive_location nfs schubert:/export/home/lalt/U8.flar
> partitioning explicit
> pool rpool auto auto auto mirror c0t1d0s0 c0t0d0s0
> 
> I think that covers the basics.
> 
> Lori
> 
>>
>>
>> Thanks again.
>>
>> Kris Kasner
>> Qualcomm Inc.
>>
>> Jul 9 at 16:41, Lori Alt <Lori.Alt at Sun.COM> wrote:
>>
>>> On 07/09/09 17:25, Mark Michael wrote:
>>>
>>>> Thanks for the info.  Hope that the pfinstall changes to
support zfs
>>>> root flash jumpstarts can be extended to support luupgrade -f
at
>>>> some point soon.
>>>>
>>>> BTW, where can I find an example profile?  do I just substitute
in the
>>>>
>>>>   install_type flash_install
>>>>   archive_location ...
>>>>
>>>> for
>>>>
>>>>    install_type initial_install
>>>>
>>>> ??
>>>>
>>> Here''s a sample:
>>>
>>> install_type flash_install
>>> archive_location nfs schubert:/export/home/lalt/mirror.flar
>>> partitioning explicit
>>> pool rpool auto auto auto mirror c0t1d0s0 c0t0d0s0
>>>
>>>
>>>
>>> _______________________________________________
>>> zfs-discuss mailing list
>>> zfs-discuss at opensolaris.org
>>> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
>>>
>>
> 
> _______________________________________________
> zfs-discuss mailing list
> zfs-discuss at opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

> I added some preliminary ZFS/flash information here:
>
> http://opensolaris.org/os/community/zfs/boot/flash/
Cool.

Just a general comment:  Since the term "flash" is quite overloaded,
especially in the context of ZFS, I suggest that you use the
term "flash archive" together whenever possible, to avoid confusion.

Otherwise, you might hear IBM tell people "ZFS does not support
flash".


Regards -- Volker


PS: Just joking, I''m sure IBM sales would never say such a thing! :-)
-- 
------------------------------------------------------------------------
Volker A. Brandt                  Consulting and Support for Sun Solaris
Brandt & Brandt Computer GmbH                   WWW: http://www.bb-c.de/
Am Wiesenpfad 6, 53340 Meckenheim                     Email: vab at bb-c.de
Handelsregister: Amtsgericht Bonn, HRB 10513              Schuhgr??e: 45
Gesch?ftsf?hrer: Rainer J. H. Brandt und Volker A. Brandt

Thanks for the reply!


My /var issue was a problem with my process.. I did:
install UFS root, install extra stuff, create UFS flar.
lucreate ZFS root <- this is where my /var dissappeared
flar create zfs flar

In my straight zfsroot install profiles I have a seperate /var - I
didn''t even
think to check post lucreate. Easy enough to split /var back out into a dataset 
before I do the flar create. I''m trying to get my zfsroot flar and my
ufs flar
to be as similar as possible for the enterprise environment.

/tmp is still a mystery.. it''s tmpfs on the source system and the
vfstab entry
didn''t survive the zfsroot flash install. That''s super simple
to fix in a
finish script

Source system:
10:57:53 uigvbp234(5)> df -lk /tmp /
Filesystem            kbytes    used   avail capacity  Mounted on
swap                 6066328    2248 6064080     1%    /tmp
rpool/ROOT/s10-zfs   34836480 5905781 19547778    24%    /

zfsroot flash installed system:
10:57:39 uigvbp234v(8)> df -lk /tmp /
Filesystem            kbytes    used   avail capacity  Mounted on
rpool/ROOT/s10-zfs   70189056 6153504 49241246    12%    /
rpool/ROOT/s10-zfs   70189056 6153504 49241246    12%    /




Thanks again for all of the information, and for helping make zfs flash 
installs a reality!

--Kris

Yesterday at 15:13, Lori Alt <Lori.Alt at Sun.COM> wrote:
>
>
> On 08/19/09 14:57, Kris Kasner wrote:
>>
>> Hi.
>>
>> First - Thanks very much for releasing this as a patch and not making
>> us wait until U8. It''s very much appreciated. Things we put on
hold
>> can start moving again which is a good thing.
>>
>>
>>
>> Is there further documentation on this yet?
>
> I just asked Cindy Swearingen, the tech writer for ZFS, about this and
> sadly, it appears that there isn''t any documentation for this
available
> outside of Sun yet.  The documentation for using flash archives to set
> up systems with zfs roots won''t be available until the release of
U8.  I
> will give you the very short summary and Cindy is going to look into
> putting some more information out on the zfs-boot page of the
> opensolaris website (which doesn''t really make sense since this
isnt''
> supported on OpenSolaris, but whatever).
>
>> I haven''t been able to find it, and it looks like most of the
>> interesting stuff is in ''pfinstall'' so I
can''t just go look and see
>> how it works.. I have a couple of questions on how zfsroot interacts
>> with flash install - I''m happy to go figure it out if you can
point me
>> at the docs.. Failing that, hopefully someone can help me answer the
>> below questions.
>>
>> on our zfs root systems, we like to keep /var as a separate dataset on
>> servers so we can monitor it''s usage. We did that before with
the line:
>> bootenv installbe bename zfsroot dataset /var
> Bottom line: whatever the configuration is of the system that you use as
> the basis for generating the flash archive, that''s the
configuration
> that will exist on systems installed using the flar.  If the original
> system has a separate /var, the systems created from it will have a
> separate  /var.
>
>>
>> additional datasets I create in a finish script.
>>
>> Can a zfsroot flash installed system have a separate dataset for /var?
>>
>>
>> It seems a little counter intuitive to me to say
>> partitioning explicit
>> when everything is going into a zfs pool with a single dataset - are
>> there other profile tokens that make this.
> Yes, I  know, but that''s the way flash archive support works (even
> before zfs was added to it).
>
>>
>>
>> One last thing - My flash installs are working, but I''m ending
up with
>> /tmp as a non tmpfs filesystem (no vfstab entry for it..) I can easily
>> fix this in a postinstall/finish script, but if there is a reason
it''s
>> not happening that can be fixed in my JS profile, that would be better.
> I don''t know why you wouldn''t have a separate /tmp.  If
you''re sure that
> the system from which the flar is generated has a /tmp  file system, but
> the system that results from the install of the flash archive does not
> have a separate  /tmp, there might be a bug.  Get back to me on it
> later if you confirm this.
>
> So here''s the quick summary of how to do flash archive installs of
> systems with zfs root file systems:
>
> 1.  Set up the system that you want to replicate or re-create.  I.e.
> install a system with a zfs root file system and add whatever
> customizations you want to it.  By default, ALL datasets in the root
> pool (except for swap and dump) are included in the flash archive, not
> just those that are part of the Solaris name space.
>
> 2.  Use flarcreate to create the flash archive on the system.  There is
> a new -D <dataset> option that can be used (repeatedly, if you wish)
on
> the command to exclude datasets from the archive.
>
> So an example command might be:
>
>   # flarcreate -n ourU8 -D rpool/somedata /some-remote-directory/ourU8.flar
>
> 3.  Set up the system you want to install for jumpstart install (however
> you do that).  Use a profile something like this:
>
> install_type flash_install
> archive_location nfs schubert:/export/home/lalt/U8.flar
> partitioning explicit
> pool rpool auto auto auto mirror c0t1d0s0 c0t0d0s0
>
> I think that covers the basics.
>
> Lori
>
>>
>>
>> Thanks again.
>>
>> Kris Kasner
>> Qualcomm Inc.
>>
>> Jul 9 at 16:41, Lori Alt <Lori.Alt at Sun.COM> wrote:
>>
>>> On 07/09/09 17:25, Mark Michael wrote:
>>>> Thanks for the info.  Hope that the pfinstall changes to
support zfs
>>>> root flash jumpstarts can be extended to support luupgrade -f
at
>>>> some point soon.
>>>>
>>>> BTW, where can I find an example profile?  do I just substitute
in the
>>>>
>>>>   install_type flash_install
>>>>   archive_location ...
>>>>
>>>> for
>>>>
>>>>    install_type initial_install
>>>>
>>>> ??
>>>>
>>> Here''s a sample:
>>>
>>> install_type flash_install
>>> archive_location nfs schubert:/export/home/lalt/mirror.flar
>>> partitioning explicit
>>> pool rpool auto auto auto mirror c0t1d0s0 c0t0d0s0
>>>
>>>
>>>
>>> _______________________________________________
>>> zfs-discuss mailing list
>>> zfs-discuss at opensolaris.org
>>> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
>>>
>>
>
-- 

Thomas Kris Kasner
Qualcomm Inc.
5775 Morehouse Drive
San Diego, CA 92121
(858)658-4932


Don''t burn the day...
 					-- Dave Matthews "Pig"

Hi Kris,

The /tmp issue described below looks like a bug to me.

I will try to reproduce this and get back to you with either
a bug ID or a request for more info.

Thanks,

Cindy

On 08/20/09 12:00, Kris Kasner wrote:
> 
> Thanks for the reply!
> 
> 
> My /var issue was a problem with my process.. I did:
> install UFS root, install extra stuff, create UFS flar.
> lucreate ZFS root <- this is where my /var dissappeared
> flar create zfs flar
> 
> In my straight zfsroot install profiles I have a seperate /var - I 
> didn''t even think to check post lucreate. Easy enough to split
/var back
> out into a dataset before I do the flar create. I''m trying to get
my
> zfsroot flar and my ufs flar to be as similar as possible for the 
> enterprise environment.
> 
> /tmp is still a mystery.. it''s tmpfs on the source system and the
vfstab
> entry didn''t survive the zfsroot flash install. That''s
super simple to
> fix in a finish script
> 
> Source system:
> 10:57:53 uigvbp234(5)> df -lk /tmp /
> Filesystem            kbytes    used   avail capacity  Mounted on
> swap                 6066328    2248 6064080     1%    /tmp
> rpool/ROOT/s10-zfs   34836480 5905781 19547778    24%    /
> 
> zfsroot flash installed system:
> 10:57:39 uigvbp234v(8)> df -lk /tmp /
> Filesystem            kbytes    used   avail capacity  Mounted on
> rpool/ROOT/s10-zfs   70189056 6153504 49241246    12%    /
> rpool/ROOT/s10-zfs   70189056 6153504 49241246    12%    /
> 
> 
> 
> 
> Thanks again for all of the information, and for helping make zfs flash 
> installs a reality!
> 
> --Kris
> 
> Yesterday at 15:13, Lori Alt <Lori.Alt at Sun.COM> wrote:
> 
>>
>>
>> On 08/19/09 14:57, Kris Kasner wrote:
>>
>>>
>>> Hi.
>>>
>>> First - Thanks very much for releasing this as a patch and not
making
>>> us wait until U8. It''s very much appreciated. Things we
put on hold
>>> can start moving again which is a good thing.
>>>
>>>
>>>
>>> Is there further documentation on this yet?
>>
>>
>> I just asked Cindy Swearingen, the tech writer for ZFS, about this and
>> sadly, it appears that there isn''t any documentation for this
available
>> outside of Sun yet.  The documentation for using flash archives to set
>> up systems with zfs roots won''t be available until the release
of U8.  I
>> will give you the very short summary and Cindy is going to look into
>> putting some more information out on the zfs-boot page of the
>> opensolaris website (which doesn''t really make sense since
this isnt''
>> supported on OpenSolaris, but whatever).
>>
>>> I haven''t been able to find it, and it looks like most of
the
>>> interesting stuff is in ''pfinstall'' so I
can''t just go look and see
>>> how it works.. I have a couple of questions on how zfsroot
interacts
>>> with flash install - I''m happy to go figure it out if you
can point me
>>> at the docs.. Failing that, hopefully someone can help me answer
the
>>> below questions.
>>>
>>> on our zfs root systems, we like to keep /var as a separate dataset
on
>>> servers so we can monitor it''s usage. We did that before
with the line:
>>> bootenv installbe bename zfsroot dataset /var
>>
>> Bottom line: whatever the configuration is of the system that you use
as
>> the basis for generating the flash archive, that''s the
configuration
>> that will exist on systems installed using the flar.  If the original
>> system has a separate /var, the systems created from it will have a
>> separate  /var.
>>
>>>
>>> additional datasets I create in a finish script.
>>>
>>> Can a zfsroot flash installed system have a separate dataset for
/var?
>>>
>>>
>>> It seems a little counter intuitive to me to say
>>> partitioning explicit
>>> when everything is going into a zfs pool with a single dataset -
are
>>> there other profile tokens that make this.
>>
>> Yes, I  know, but that''s the way flash archive support works
(even
>> before zfs was added to it).
>>
>>>
>>>
>>> One last thing - My flash installs are working, but I''m
ending up with
>>> /tmp as a non tmpfs filesystem (no vfstab entry for it..) I can
easily
>>> fix this in a postinstall/finish script, but if there is a reason
it''s
>>> not happening that can be fixed in my JS profile, that would be
better.
>>
>> I don''t know why you wouldn''t have a separate /tmp. 
If you''re sure that
>> the system from which the flar is generated has a /tmp  file system,
but
>> the system that results from the install of the flash archive does not
>> have a separate  /tmp, there might be a bug.  Get back to me on it
>> later if you confirm this.
>>
>> So here''s the quick summary of how to do flash archive
installs of
>> systems with zfs root file systems:
>>
>> 1.  Set up the system that you want to replicate or re-create.  I.e.
>> install a system with a zfs root file system and add whatever
>> customizations you want to it.  By default, ALL datasets in the root
>> pool (except for swap and dump) are included in the flash archive, not
>> just those that are part of the Solaris name space.
>>
>> 2.  Use flarcreate to create the flash archive on the system.  There is
>> a new -D <dataset> option that can be used (repeatedly, if you
wish) on
>> the command to exclude datasets from the archive.
>>
>> So an example command might be:
>>
>>   # flarcreate -n ourU8 -D rpool/somedata 
>> /some-remote-directory/ourU8.flar
>>
>> 3.  Set up the system you want to install for jumpstart install
(however
>> you do that).  Use a profile something like this:
>>
>> install_type flash_install
>> archive_location nfs schubert:/export/home/lalt/U8.flar
>> partitioning explicit
>> pool rpool auto auto auto mirror c0t1d0s0 c0t0d0s0
>>
>> I think that covers the basics.
>>
>> Lori
>>
>>>
>>>
>>> Thanks again.
>>>
>>> Kris Kasner
>>> Qualcomm Inc.
>>>
>>> Jul 9 at 16:41, Lori Alt <Lori.Alt at Sun.COM> wrote:
>>>
>>>> On 07/09/09 17:25, Mark Michael wrote:
>>>>
>>>>> Thanks for the info.  Hope that the pfinstall changes to
support zfs
>>>>> root flash jumpstarts can be extended to support luupgrade
-f at
>>>>> some point soon.
>>>>>
>>>>> BTW, where can I find an example profile?  do I just
substitute in the
>>>>>
>>>>>   install_type flash_install
>>>>>   archive_location ...
>>>>>
>>>>> for
>>>>>
>>>>>    install_type initial_install
>>>>>
>>>>> ??
>>>>>
>>>> Here''s a sample:
>>>>
>>>> install_type flash_install
>>>> archive_location nfs schubert:/export/home/lalt/mirror.flar
>>>> partitioning explicit
>>>> pool rpool auto auto auto mirror c0t1d0s0 c0t0d0s0
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> zfs-discuss mailing list
>>>> zfs-discuss at opensolaris.org
>>>> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
>>>>
>>>
>>
>