zfs discuss - Jan 2011 - Question regarding incremental zfs send/recv for hundreds of zfs filesystems under one pool

There is only one pool and hundreds of zfs file systems under that
pool. New file systems are getting created on the fly.

Is it possible to automate zfs incremental send/recv in this scenario?

My assumption is negative as incremental send/recv needs a full
snapshot to be sent first before starting the incremental one. In our
case file systems are getting created on the fly while incremental
send/recv is active in parallel.

Thanks in advance,
--Rahul
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20110124/faca067d/attachment.html>

On 01/25/11 12:30 PM, Rahul Deb wrote:
> There is only one pool and hundreds of zfs file systems under that
> pool. New file systems are getting created on the fly.
>
> Is it possible to automate zfs incremental send/recv in this scenario?
>
> My assumption is negative as incremental send/recv needs a full
> snapshot to be sent first before starting the incremental one. In our
> case file systems are getting created on the fly while incremental
> send/recv is active in parallel.
>
Provided you do a recursive snapshot of the pool then yes, it will work.

-- 
Ian.

-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20110125/67d4e2c0/attachment.html>

And does it handle the deletions as well?

Bryan

On Tue, Jan 25, 2011 at 12:34:57PM +1300, Ian Collins
wrote:
>    On 01/25/11 12:30 PM, Rahul Deb wrote:
> 
>      There is only one pool and hundreds of zfs file systems under that
>      pool. New file systems are getting created on the fly.
>      Is it possible to automate zfs incremental send/recv in this
>      scenario?
>      My assumption is negative as incremental send/recv needs a full
>      snapshot to be sent first before starting the incremental one. In
>      our
>      case file systems are getting created on the fly while incremental
>      send/recv is active in parallel.
> 
>    Provided you do a recursive snapshot of the pool then yes, it will
>    work.
> --
> Ian.

Thanks Ian for your response.

So you are saying, if I create recursive snapshot of the pool, it will be
able to do the incremental send/recv for the file systems created on the
fly?

I was thinking that if the file systems are created on the fly, then there
is no previous snapshot for the newly created filesystems under that pool.
So incremental send/recv will not work.

On Mon, Jan 24, 2011 at 3:34 PM, Ian Collins <ian at ianshome.com> wrote:
>  On 01/25/11 12:30 PM, Rahul Deb wrote:
>
> There is only one pool and hundreds of zfs file systems under that
> pool. New file systems are getting created on the fly.
>
> Is it possible to automate zfs incremental send/recv in this scenario?
>
> My assumption is negative as incremental send/recv needs a full
> snapshot to be sent first before starting the incremental one. In our
> case file systems are getting created on the fly while incremental
> send/recv is active in parallel.
>
>  Provided you do a recursive snapshot of the pool then yes, it will work.
>
> --
> Ian.
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20110124/d6e28033/attachment.html>

On 01/25/11 08:42 PM, Rahul Deb wrote:
> Thanks Ian for your response.
>
> So you are saying, if I create recursive snapshot of the pool, it will 
> be able to do the incremental send/recv for the file systems created 
> on the fly?
>
> I was thinking that if the file systems are created on the fly, then 
> there is no previous snapshot for the newly created filesystems under 
> that pool. So incremental send/recv will not work.
Oops, yes you are right.  I forgot my script detects and send new nested 
filesystems.

-- 
Ian.

On Jan 24, 2011, at 3:30 PM, Rahul Deb wrote:
> There is only one pool and hundreds of zfs file systems under that  
> pool. New file systems are getting created on the fly.
> 
> Is it possible to automate zfs incremental send/recv in this scenario?
Yes.
> My assumption is negative as incremental send/recv needs a full  
> snapshot to be sent first before starting the incremental one. In our  
> case file systems are getting created on the fly while incremental  
> send/recv is active in parallel.
Yes. Full snapshot sends can be automated, too.
 -- richard
> 
> Thanks in advance,
> --Rahul
> _______________________________________________
> zfs-discuss mailing list
> zfs-discuss at opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss