Chris Samuel
2009-Feb-13 12:31 UTC
Bonnie++ run with RAID-1 on a single SSD (2.6.29-rc4-224-g4b6136c)
Hi folks, For people who might be interested, here is how btrfs performs with two partitions on a single SSD drive in a RAID-1 mirror. This is on a Dell E4200 with Core 2 Duo U9300 (1.2GHz), 2GB RAM and a Samsung SSD (128GB Thin uSATA SSD). Version 1.03c ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP sys26 2G 28299 17 18633 12 85702 29 3094 18 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 7513 99 +++++ +++ 5140 98 3964 67 +++++ +++ 5652 99 sys26,2G,,,28299,17,18633,12,,,85702,29,3093.9,18,16,7513,99,+++++,+++,5140,98,3964,67,+++++,+++,5652,99 real 3m51.883s user 0m0.360s sys 0m46.099s I''d previously blogged a test with 2.6.29-rc2 and there''s no real difference between the two runs. http://www.csamuel.org/2009/01/04/btrfs-raid1-benchmark-on-dell-e4200-with-128gb-ssd For a comparison, here is XFS on a single partition: Version 1.03c ------Sequential Output------ --Sequential Input- --Random- -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP sys26 2G 62075 19 36634 16 92023 26 1432 12 ------Sequential Create------ --------Random Create-------- -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 585 13 +++++ +++ 578 5 538 11 +++++ +++ 417 5 sys26,2G,,,62075,19,36634,16,,,92023,26,1431.8,12,16,585,13,+++++,+++,578,5,538,11,+++++,+++,417,5 real 4m10.987s user 0m0.404s sys 0m33.602s Block I/O is faster, but btrfs hammers it for metadata operations, an order of magnitude faster! cheers, Chris -- Chris Samuel : http://www.csamuel.org/ : Melbourne, VIC This email may come with a PGP signature as a file. Do not panic. For more info see: http://en.wikipedia.org/wiki/OpenPGP
Sander
2009-Feb-13 13:27 UTC
Re: Bonnie++ run with RAID-1 on a single SSD (2.6.29-rc4-224-g4b6136c)
Hi Chris, Thank you for sharing your numbers. Chris Samuel wrote (ao):> For people who might be interested, here is how btrfs performs > with two partitions on a single SSD drive in a RAID-1 mirror. > > This is on a Dell E4200 with Core 2 Duo U9300 (1.2GHz), 2GB RAM > and a Samsung SSD (128GB Thin uSATA SSD).MLC SSDs are famous for their write stalls when the disk gets full and old blocks need to be reused. Do you experience that too? Or can you test that situation? On your site you write: "As SSD''s are not necessarily as reliable as spinning disk yet for data integrity .." I''ve skimmed the article you link to. I still think SSDs are much more reliable than spinning disks, especially the high end SLC SSDs. What is the general opinion on this? Could you also test without RAID1? And with the compression mount flag? And without the ssd mount flag?> Version 1.03c ------Sequential Output------ --Sequential Input- --Random- > -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- > Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP > sys26 2G 28299 17 18633 12 85702 29 3094 18 > ------Sequential Create------ --------Random Create-------- > -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- > files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP > 16 7513 99 +++++ +++ 5140 98 3964 67 +++++ +++ 5652 99 > sys26,2G,,,28299,17,18633,12,,,85702,29,3093.9,18,16,7513,99,+++++,+++,5140,98,3964,67,+++++,+++,5652,99 > > real 3m51.883s > user 0m0.360s > sys 0m46.099sI have no experience with Bonnie++, but based on the output it seems you use a 2GB file while you have 2GB RAM. Is that a valid test? Also the test run of only 3 minutes 52 seconds seems way too short. With kind regards, Sander -- Humilis IT Services and Solutions http://www.humilis.net -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Chris Mason
2009-Feb-13 14:26 UTC
Re: Bonnie++ run with RAID-1 on a single SSD (2.6.29-rc4-224-g4b6136c)
On Fri, 2009-02-13 at 23:31 +1100, Chris Samuel wrote:> Hi folks, > > For people who might be interested, here is how btrfs performs > with two partitions on a single SSD drive in a RAID-1 mirror. > > This is on a Dell E4200 with Core 2 Duo U9300 (1.2GHz), 2GB RAM > and a Samsung SSD (128GB Thin uSATA SSD). >Thanks for posting these, it is especially good to see the metadata ops are still fast on this ssd.> Version 1.03c ------Sequential Output------ --Sequential Input- --Random- > -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- > Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP > sys26 2G 28299 17 18633 12 85702 29 3094 18 > ------Sequential Create------ --------Random Create-------- > -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- > files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP > 16 7513 99 +++++ +++ 5140 98 3964 67 +++++ +++ 5652 99 > sys26,2G,,,28299,17,18633,12,,,85702,29,3093.9,18,16,7513,99,+++++,+++,5140,98,3964,67,+++++,+++,5652,99 >So, btrfs is doing ~28MB/s writes while writing the data twice and XFS is doing 62MB writing it once. That''s not too bad really. But, one important thing about the ssds is they stripe internally across a bunch of flash storage, and then they have the FTL managing all the writes. So, if you make two partitions on a single device, a raid1 data write from btrfs is very likely to result in two large IOs, which the FTL very well might put directly adjacent to each other on the SSD. Duplicating the data does make it more likely you''ll recover something if the device goes bad, but two devices are still safer than one. I''m not saying the test isn''t valid, I just want to make sure people reading the list don''t run off and partition their ssds in hopes of getting raid ;) -chris -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Chris Samuel
2009-Mar-24 10:41 UTC
Re: Bonnie++ run with RAID-1 on a single SSD (2.6.29-rc4-224-g4b6136c)
On Saturday 14 February 2009, Chris Mason wrote:> On Fri, 2009-02-13 at 23:31 +1100, Chris Samuel wrote:[Bonnie++]> > This is on a Dell E4200 with Core 2 Duo U9300 (1.2GHz), 2GB RAM > > and a Samsung SSD (128GB Thin uSATA SSD). > > Thanks for posting these, it is especially good to see the metadata ops > are still fast on this ssd.Not a problem - sorry for the delay in responding.. :-(> So, btrfs is doing ~28MB/s writes while writing the data twice and XFS > is doing 62MB writing it once. That''s not too bad really.Yup, I''m very happy!> But, one important thing about the ssds is they stripe internally across > a bunch of flash storage, and then they have the FTL managing all the > writes.Ah...> So, if you make two partitions on a single device, a raid1 data write > from btrfs is very likely to result in two large IOs, which the FTL very > well might put directly adjacent to each other on the SSD....yes, I can see that could well happen. Bugger.. :-(> Duplicating the data does make it more likely you''ll recover something > if the device goes bad, but two devices are still safer than one.Yeah, but pretty hard to do in a very light laptop!> I''m not saying the test isn''t valid, I just want to make sure people > reading the list don''t run off and partition their ssds in hopes of > getting raid ;)Agreed - I''m just hoping to be a bit safer than not having it.. ;-) cheers, Chris -- Chris Samuel : http://www.csamuel.org/ : Melbourne, VIC This email may come with a PGP signature as a file. Do not panic. For more info see: http://en.wikipedia.org/wiki/OpenPGP