zfs discuss - Apr 2010 - build a zfs continuous data replication in opensolaris

I have setup 2 servers with zfs pools I want to replicate continously to the
second server is there a way I can do it with zfs are there any examples I can
follow to build this setup. There are no good books on opensolaris explaining
this method.

Also are there a script repository for zfs stuff.

I dont find a lot of resources dedicated to zfs which I think is an amazing fs
system.
-- 
This message posted from opensolaris.org

In my earlier investigations of ZFS, I ran across a product called StorageTek
Availability Suite that sounds like it might do what you want.  If I recall
correctly, it would allow you to define devices that are actually hosted on
another server, and you could use ZFS to mirror those devices.  That,
unfortunately, is the extent of my knowledge on that product.

-
Cameron Hanover
chanover at umich.edu

"Necessity is the plea for every infringement of human freedom.  It is the
argument of tyrants; it is the creed of slaves."
--William Pitt, House of Commons, 11/18/1783

On Apr 21, 2010, at 6:16 AM, tranceash wrote:
> I have setup 2 servers with zfs pools I want to replicate continously to
the second server is there a way I can do it with zfs are there any examples I
can follow to build this setup. There are no good books on opensolaris
explaining this method.
> 
> Also are there a script repository for zfs stuff.
> 
> I dont find a lot of resources dedicated to zfs which I think is an amazing
fs system.
> -- 
> This message posted from opensolaris.org
> _______________________________________________
> zfs-discuss mailing list
> zfs-discuss at opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
> 
> 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 3682 bytes
Desc: not available
URL:
<http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100421/805e22e2/attachment.bin>

On Apr 21, 2010, at 6:32 AM, c.hanover wrote:
> In my earlier investigations of ZFS, I ran across a product called
StorageTek Availability Suite that sounds like it might do what you want.  If I
recall correctly, it would allow you to define devices that are actually hosted
on another server, and you could use ZFS to mirror those devices.  That,
unfortunately, is the extent of my knowledge on that product.
Yes.  In NexentaStor, this is the Auto-CDP plugin.  

For OpenSolaris, this was demonstrated by Jim Dunham a few years ago at:
	http:blogs.sun.com/AVS

However, that blog seems to be gone. You can google "zfs avs" for more
pointers, but be
aware of PSARC/2010/060 EOF of Availability Suite (AVS), which is not a public
case in
the ARC caselogs
	http://arc.opensolaris.org/caselog/PSARC/2010/

Finally, products which do block-device-level replication have a tendency to be
slow
because you are serializing a parallel activity.  Be sure to test with your
configuration
to ensure your performance goals are achievable. There are some architecture
choices
which can help somewhat, but Amdahl''s Law still applies.
 -- richard
> 
> -
> Cameron Hanover
> chanover at umich.edu
> 
> "Necessity is the plea for every infringement of human freedom.  It is
the argument of tyrants; it is the creed of slaves."
> --William Pitt, House of Commons, 11/18/1783
> 
> On Apr 21, 2010, at 6:16 AM, tranceash wrote:
> 
>> I have setup 2 servers with zfs pools I want to replicate continously
to the second server is there a way I can do it with zfs are there any examples
I can follow to build this setup. There are no good books on opensolaris
explaining this method.
>> 
>> Also are there a script repository for zfs stuff.
>> 
>> I dont find a lot of resources dedicated to zfs which I think is an
amazing fs system.
>> -- 
>> This message posted from opensolaris.org
>> _______________________________________________
>> zfs-discuss mailing list
>> zfs-discuss at opensolaris.org
>> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
>> 
>> 
> 
> _______________________________________________
> zfs-discuss mailing list
> zfs-discuss at opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
ZFS storage and performance consulting at http://www.RichardElling.com
ZFS training on deduplication, NexentaStor, and NAS performance
Las Vegas, April 29-30, 2010 http://nexenta-vegas.eventbrite.com

Hi Richard

I was looking at nexentastor developer edition and I see they have given it a
nice gui
but I cant configure auto-cdp plugin can I configure it through the shell.

Also if the performance is problem what other options are there for a high
availability zfs system across 2 systems.

In linux we have something called DRBD and it works very well unfortunately we
don''t have zfs native only through fuse which is not usable at all.

Also can you recommend me some example configuration or books that I can refer
to building this as I am from linux background and dont know much about solaris.
-- 
This message posted from opensolaris.org

On Apr 21, 2010, at 8:41 PM, tranceash wrote:
> Hi Richard
> 
> I was looking at nexentastor developer edition and I see they have given it
a nice gui
> but I cant configure auto-cdp plugin can I configure it through the shell.
The auto-cdp plugin is managed through nmc.  It is simple to manage
and well documented in the NexentaStor User''s Guide.
> Also if the performance is problem what other options are there for a high
availability zfs system across 2 systems.
It depends on the business requirements.  A mirror would be simple,
but doesn''t offer temporal protection. Snapshots offer temporal
protection,
but are not continuous.
> In linux we have something called DRBD and it works very well unfortunately
we don''t have zfs native only through fuse which is not usable at all.
drbd is like AVS or Nexenta''s auto-CDP.
> Also can you recommend me some example configuration or books that I can
refer to building this as I am from linux background and dont know much about
solaris.
The aforementioned ZFS+AVS blog was quite good. Complain to Oracle that
they deleted it.  Fortunately, it looks like the recording still works
http://hub.opensolaris.org/bin/view/Project+avs/AVS%2DZFS%2DDemo%2DV1
The AVS project page is http://hub.opensolaris.org/bin/view/Project+avs/
 -- richard

ZFS storage and performance consulting at http://www.RichardElling.com
ZFS training on deduplication, NexentaStor, and NAS performance
Las Vegas, April 29-30, 2010 http://nexenta-vegas.eventbrite.com

You may have a look in the whitepaper from Torsten Frueauf.
see here http://sun.systemnews.com/articles/137/4/OpenSolaris/22016

This should give you the functionality of a DRBD-Cluster.

Andreas
-- 
This message posted from opensolaris.org

Hi Richard

What do you mean by "A mirror would be simple" do you mean to use zfs
send and receive. Also is the auto-cdp plugin free with nexenstor developer.
Is there a detailed explaination of AVS where they explain all the companents
involved like what is bitmap for etc. If AVS is there around for some time where
are books explaining this technolgy, Does anyone use it in production as seems
to me it has a lot problems in terms of performance.
-- 
This message posted from opensolaris.org

Hi Andreas ,
The paper looks good are any basic examples on AVS or open-ha that explains the
componets throughly and guides. What books or resource you recommend I get more
information about this as I cant find any books
-- 
This message posted from opensolaris.org

If you read this
http://hub.opensolaris.org/bin/download/Project+colorado/files/Whitepaper-OpenHAClusterOnOpenSolaris-external.pdf
and especially starting at page 25 you will find a detailed explanation how to
implement a storage cluster with shared storage based on Comstar and ISCSI.
If you want to install on physical hardware just ignore the installation and
configuration of VirtualBox.
IMHO simpler than AVS.

Regards

Andreas
-- 
This message posted from opensolaris.org

Hi Andreas 
I will explain to you what I need . You say IMHO is simpler than AVS thats good
.
I have setup 2 nexentacore boxes with zfs pools and nfs on the first node. Now I
need to install the open-ha cluster software with non shared disks.
I now need to make zfs with nfs HA. I understand the concepts of HA where one
needs to have heartbeat, disks and failover configs created.
Is there examples on this setup I can work with. Dont get me wrong comstar is
good but not fast as nfs.
-- 
This message posted from opensolaris.org