I''m testing an X4500 where we need to send over 600MB/s over the network. This is no problem, I get about 700MB/s over a single 10G interface. Problem is the box also needs to accept incoming data at 100MB/s. If I do a simple test ftp-ing files into the same filesystem I see the FTP being limited to about 25-30MB/s. Is there a way to increase priority of write over reads ? Doing the writes to a separate pool is not an option because in order to get the read speed I had to make the 4500 into one big pool with 23 mirror vdev ( I got about 25 MB/s per disk so for 700 MB/s I need about 30 disks active concurrently) Paul
Casper.Dik at Sun.COM
2007-Jun-25 12:00 UTC
[zfs-discuss] Write over read priority possible ?
>I''m testing an X4500 where we need to send over 600MB/s over the >network. >This is no problem, I get about 700MB/s over a single 10G interface. >Problem is the box also needs to accept incoming data at 100MB/s. >If I do a simple test ftp-ing files into the same filesystem I see >the FTP being limited to about 25-30MB/s.What was the speed when ftp''ing to /dev/null? (Depending on the exact Solaris version, ftpd may or may not be really slow) Casper
On 25 Jun 2007, at 14:00, Casper.Dik at Sun.COM wrote:> >> I''m testing an X4500 where we need to send over 600MB/s over the >> network. >> This is no problem, I get about 700MB/s over a single 10G interface. >> Problem is the box also needs to accept incoming data at 100MB/s. >> If I do a simple test ftp-ing files into the same filesystem I see >> the FTP being limited to about 25-30MB/s. > > > What was the speed when ftp''ing to /dev/null? (Depending on the exact > Solaris version, ftpd may or may not be really slow) >ftping to a system while no read load was present maxed out the 1GB interface at 100MB/s. Note, the ftp put load was a single stream while the read load were 224 concurrent streams. Paul
Casper.Dik at Sun.COM
2007-Jun-25 12:37 UTC
[zfs-discuss] Write over read priority possible ?
> >On 25 Jun 2007, at 14:00, Casper.Dik at Sun.COM wrote: > >> >>> I''m testing an X4500 where we need to send over 600MB/s over the >>> network. >>> This is no problem, I get about 700MB/s over a single 10G interface. >>> Problem is the box also needs to accept incoming data at 100MB/s. >>> If I do a simple test ftp-ing files into the same filesystem I see >>> the FTP being limited to about 25-30MB/s. >> >> >> What was the speed when ftp''ing to /dev/null? (Depending on the exact >> Solaris version, ftpd may or may not be really slow) >> > >ftping to a system while no read load was present maxed out the 1GB >interface at >100MB/s. >Note, the ftp put load was a single stream while the read load were >224 concurrent streams.How many interfaces did you use and was ftp confined to its own interface? Casper
On 25 Jun 2007, at 14:37, Casper.Dik at Sun.COM wrote:> >> >> On 25 Jun 2007, at 14:00, Casper.Dik at Sun.COM wrote: >> >>> >>>> I''m testing an X4500 where we need to send over 600MB/s over the >>>> network. >>>> This is no problem, I get about 700MB/s over a single 10G >>>> interface. >>>> Problem is the box also needs to accept incoming data at 100MB/s. >>>> If I do a simple test ftp-ing files into the same filesystem I see >>>> the FTP being limited to about 25-30MB/s. >>> >>> >>> What was the speed when ftp''ing to /dev/null? (Depending on the >>> exact >>> Solaris version, ftpd may or may not be really slow) >>> >> >> ftping to a system while no read load was present maxed out the 1GB >> interface at >> 100MB/s. >> Note, the ftp put load was a single stream while the read load were >> 224 concurrent streams. > > > How many interfaces did you use and was ftp confined to its own > interface?Outgoing load used a dedicated 10GB interface, incoming load used a dedicated e1000g interface. Paul
Dedicate some CPU to the task. Create a psrset and bind the ftp daemon to it. If that works then add a few of the read threads as many as what fits in the requirements. -r Le 25 juin 07 ? 15:00, Paul van der Zwan a ?crit :> > On 25 Jun 2007, at 14:37, Casper.Dik at Sun.COM wrote: > >> >>> >>> On 25 Jun 2007, at 14:00, Casper.Dik at Sun.COM wrote: >>> >>>> >>>>> I''m testing an X4500 where we need to send over 600MB/s over the >>>>> network. >>>>> This is no problem, I get about 700MB/s over a single 10G >>>>> interface. >>>>> Problem is the box also needs to accept incoming data at 100MB/s. >>>>> If I do a simple test ftp-ing files into the same filesystem I see >>>>> the FTP being limited to about 25-30MB/s. >>>> >>>> >>>> What was the speed when ftp''ing to /dev/null? (Depending on the >>>> exact >>>> Solaris version, ftpd may or may not be really slow) >>>> >>> >>> ftping to a system while no read load was present maxed out the 1GB >>> interface at >>> 100MB/s. >>> Note, the ftp put load was a single stream while the read load were >>> 224 concurrent streams. >> >> >> How many interfaces did you use and was ftp confined to its own >> interface? > > Outgoing load used a dedicated 10GB interface, incoming load used a > dedicated e1000g > interface. > > Paul > > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss