On Mon, Jun 2, 2008 at 2:03 PM, Johnny Hughes <johnny at centos.org> wrote:> I would also not use XFS in production ... but that is just me.Interesting, I thought that XFS was fairly safe for use. What would you recommend for filesystems in the 50-500 terabyte range? (And yes, we do actually run a 70 TB at the moment, so I'm not asking just to annoy you; I'm genuinely interested in your opinion as well as those of others, so feel free to chip in) BR Bent
Filipe Brandenburger
2008-Jun-02 12:38 UTC
[CentOS] Largish filesystems [was Re: XFS install issue]
On Mon, Jun 2, 2008 at 8:18 AM, Bent Terp <bent at nagstrup.dk> wrote:> Interesting, I thought that XFS was fairly safe for use. What would > you recommend for filesystems in the 50-500 terabyte range?I would recommend you split it in several smaller (2-4TB) filesystems. Most applications would support this, and with some clever tactics you might overcome this in applications that do not support it directly. Disadvantages of using one huge filesystem (independent of filesystem type): - If it breaks, you lose *ALL* your data. - If you need to check the filesystem (fsck), it will take ages. - You cannot easily scale horizontally by moving some of the data to a second machine. - It's much harder to tell what is causing performance problems. I never had any filesystem over 5TB in my life (and I've managed more than 100TB at one site), and these days my "sanity" limit is around 1TB per filesystem. I'm currently using XFS in production (we have some SuSE machines just for the support of it), but I've had so many problems that would have been avoided if we weren't using XFS, that I'm seriously considering migrating them all to ext3. (Bonus points for getting rid of that SuSE trash and replacing them with some shiny CentOS 5 machines.) HTH, Filipe
Ross S. W. Walker
2008-Jun-02 13:44 UTC
[CentOS] Largish filesystems [was Re: XFS install issue]
Bent Terp wrote:> On Mon, Jun 2, 2008 at 2:03 PM, Johnny Hughes > <johnny at centos.org> wrote: > > I would also not use XFS in production ... but that is just me. > > Interesting, I thought that XFS was fairly safe for use. What would > you recommend for filesystems in the 50-500 terabyte range? > > (And yes, we do actually run a 70 TB at the moment, so I'm not asking > just to annoy you; I'm genuinely interested in your opinion as well as > those of others, so feel free to chip in)Assuming you still want those all-in-one file systems then you may want to look at JFS as I have heard good things about both it's stability and performance. Is there anyone running JFS currently that can attest to that? -Ross ______________________________________________________________________ This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail, you are hereby notified that any dissemination, distribution or copying of this e-mail, and any attachments thereto, is strictly prohibited. If you have received this e-mail in error, please immediately notify the sender and permanently delete the original and any copy or printout thereof.