Can zfs send utilize multiple-streams of data transmission (or some sort of multipleness)? Interesting read for background http://people.planetpostgresql.org/xzilla/index.php?/archives/338-guid.html Note: zfs send takes 3 days for 1TB to another system Regards, Jignesh
On Wed, Apr 09, 2008 at 11:38:03PM -0400, Jignesh K. Shah wrote:> Can zfs send utilize multiple-streams of data transmission (or some sort > of multipleness)? > > Interesting read for background > http://people.planetpostgresql.org/xzilla/index.php?/archives/338-guid.html > > Note: zfs send takes 3 days for 1TB to another systemHuh? That article doesn''t describe how they were moving the zfs send stream, whether the limit was the network, ZFS or disk I/O. In fact, it''s bereft of numbers. It even says that the transfer time is not actually three days but "upwards of 24 hours." Nico --
Indeed - If it was 100Mb/s ethernet, 1TB would take near enough 24 hours just to push that much data... Would be great to see some details of the setup and where the bottleneck was. I''d be surprised if ZFS has anything to do with the transfer rate... But an interesting read anyways. :) Nathan. Nicolas Williams wrote:> On Wed, Apr 09, 2008 at 11:38:03PM -0400, Jignesh K. Shah wrote: >> Can zfs send utilize multiple-streams of data transmission (or some sort >> of multipleness)? >> >> Interesting read for background >> http://people.planetpostgresql.org/xzilla/index.php?/archives/338-guid.html >> >> Note: zfs send takes 3 days for 1TB to another system > > Huh? That article doesn''t describe how they were moving the zfs send > stream, whether the limit was the network, ZFS or disk I/O. In fact, > it''s bereft of numbers. It even says that the transfer time is not > actually three days but "upwards of 24 hours." > > Nico-- ////////////////////////////////////////////////////////////////// // Nathan Kroenert nathan.kroenert at aus.sun.com // // Technical Support Engineer Phone: +61 3 9869-6255 // // Sun Services Fax: +61 3 9869-6288 // // Level 3, 476 St. Kilda Road // // Melbourne 3004 Victoria Australia // //////////////////////////////////////////////////////////////////
Hi Robert, Can you share the details where ZFS send takes three days? I hope to find some solution to help you with your ZFS snapshots and which also in general will help PostgreSQL community for DR solutions using ZFS. Thanks. Regards, Jignesh Nathan Kroenert wrote:> Indeed - > > If it was 100Mb/s ethernet, 1TB would take near enough 24 hours just > to push that much data... > > Would be great to see some details of the setup and where the > bottleneck was. I''d be surprised if ZFS has anything to do with the > transfer rate... > > But an interesting read anyways. :) > > Nathan. > > > > Nicolas Williams wrote: >> On Wed, Apr 09, 2008 at 11:38:03PM -0400, Jignesh K. Shah wrote: >>> Can zfs send utilize multiple-streams of data transmission (or some >>> sort of multipleness)? >>> >>> Interesting read for background >>> http://people.planetpostgresql.org/xzilla/index.php?/archives/338-guid.html >>> >>> >>> Note: zfs send takes 3 days for 1TB to another system >> >> Huh? That article doesn''t describe how they were moving the zfs send >> stream, whether the limit was the network, ZFS or disk I/O. In fact, >> it''s bereft of numbers. It even says that the transfer time is not >> actually three days but "upwards of 24 hours." >> >> Nico >