No suggestions ? Il 14 giu 2016 10:01 AM, "Gandalf Corvotempesta" < gandalf.corvotempesta at gmail.com> ha scritto:> Let's assume a small cluster made by 3 servers, 12 disks/bricks each. > This cluster would be expanded to a maximum of 15 servers in near future. > > What do you suggest, a JBOD or a RAID? Which RAID level? > > 15 servers with 12 disks/bricks in JBOD are 180 bricks. Is this an > acceptable value? > Multiple raid6 for each servers? In example, RAID-6 with 6 disks and > another RAID-6 with the other 6 disks. I'll loose 4 disks on each > servers, performance would be affected and rebuild times would be huge > (by using 2TB/4TB disks) > > Any suggestions? >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20160704/f337f283/attachment.html>
Hi Gandalf, Are you using hardware raid or mdadm? On high quality hardware raid, a 12 disk raid-6 is pretty solid. With mdadm any raid6 (especially with 12 disks) will be rubbish. Matt.> On 4 Jul 2016, at 15:54:44, Gandalf Corvotempesta <gandalf.corvotempesta at gmail.com> wrote: > > No suggestions ? > > Il 14 giu 2016 10:01 AM, "Gandalf Corvotempesta" <gandalf.corvotempesta at gmail.com> ha scritto: > Let's assume a small cluster made by 3 servers, 12 disks/bricks each. > This cluster would be expanded to a maximum of 15 servers in near future. > > What do you suggest, a JBOD or a RAID? Which RAID level? > > 15 servers with 12 disks/bricks in JBOD are 180 bricks. Is this an > acceptable value? > Multiple raid6 for each servers? In example, RAID-6 with 6 disks and > another RAID-6 with the other 6 disks. I'll loose 4 disks on each > servers, performance would be affected and rebuild times would be huge > (by using 2TB/4TB disks) > > Any suggestions? > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users
Hi Gandalf
Not suggesting really here but just mentioning what I am using: I am using an
HBA adapter with 12 disks so basically JBOD but I am using ZFS and have an array
of 12 disks in RAIDZ2 (sort of RAID6 but ZFS-style). I am pretty happy with that
setup so far.
CheersML
On Monday, July 4, 2016 4:54 PM, Gandalf Corvotempesta
<gandalf.corvotempesta at gmail.com> wrote:
No suggestions ?Il 14 giu 2016 10:01 AM, "Gandalf Corvotempesta"
<gandalf.corvotempesta at gmail.com> ha scritto:
Let's assume a small cluster made by 3 servers, 12 disks/bricks each.
This cluster would be expanded to a maximum of 15 servers in near future.
What do you suggest, a JBOD or a RAID? Which RAID level?
15 servers with 12 disks/bricks in JBOD are 180 bricks. Is this an
acceptable value?
Multiple raid6 for each servers? In example, RAID-6 with 6 disks and
another RAID-6 with the other 6 disks. I'll loose 4 disks on each
servers, performance would be affected and rebuild times would be huge
(by using 2TB/4TB disks)
Any suggestions?
_______________________________________________
Gluster-users mailing list
Gluster-users at gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://www.gluster.org/pipermail/gluster-users/attachments/20160704/7c72cdb4/attachment.html>
IMHO you use raid for performance reasons and gluster for fault tolerance and scale. On July 4, 2016 7:54:44 AM PDT, Gandalf Corvotempesta <gandalf.corvotempesta at gmail.com> wrote:>No suggestions ? >Il 14 giu 2016 10:01 AM, "Gandalf Corvotempesta" < >gandalf.corvotempesta at gmail.com> ha scritto: > >> Let's assume a small cluster made by 3 servers, 12 disks/bricks each. >> This cluster would be expanded to a maximum of 15 servers in near >future. >> >> What do you suggest, a JBOD or a RAID? Which RAID level? >> >> 15 servers with 12 disks/bricks in JBOD are 180 bricks. Is this an >> acceptable value? >> Multiple raid6 for each servers? In example, RAID-6 with 6 disks and >> another RAID-6 with the other 6 disks. I'll loose 4 disks on each >> servers, performance would be affected and rebuild times would be >huge >> (by using 2TB/4TB disks) >> >> Any suggestions? >> > > >------------------------------------------------------------------------ > >_______________________________________________ >Gluster-users mailing list >Gluster-users at gluster.org >http://www.gluster.org/mailman/listinfo/gluster-users-- Sent from my Android device with K-9 Mail. Please excuse my brevity. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20160704/34549ac9/attachment.html>
On 5/07/2016 12:54 AM, Gandalf Corvotempesta wrote:> > No suggestions ? > > Il 14 giu 2016 10:01 AM, "Gandalf Corvotempesta" > <gandalf.corvotempesta at gmail.com > <mailto:gandalf.corvotempesta at gmail.com>> ha scritto: > > Let's assume a small cluster made by 3 servers, 12 disks/bricks each. > This cluster would be expanded to a maximum of 15 servers in near > future. > > What do you suggest, a JBOD or a RAID? Which RAID level? >I setup my much smaller cluster with ZFS RAID10 on each node. - Greatly increased the iops per node - auto bitrot detection and repair - SSD caches - compression clawed back 30% of the disk space I lost to RAID10. -- Lindsay Mathieson -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20160705/ec214943/attachment.html>