Theodore Buchwald
2024-Mar-14 00:39 UTC
[Gluster-users] Adding storage capacity to a production disperse volume
Hi, This is the first time I have tried to expand the storage of a live gluster volume. I was able to get another supermicro storage unit for a gluster cluster that I built. The current clustered storage configuration contains five supermicro units. And the cluster volume is setup with the following configuration: node-6[/var/log/glusterfs]# gluster volume info Volume Name: researchdata Type: Disperse Volume ID: 93d4-482a-8933-2d81298d5b3b Status: Started Snapshot Count: 0 Number of Bricks: 1 x (4 + 1) = 5 Transport-type: tcp Bricks: Brick1: node-1:/mnt/data/researchdata-1 Brick2: node-2:/mnt/data/researchdata-2 Brick3: node-3:/mnt/data/researchdata-3 Brick4: node-4:/mnt/data/researchdata-4 Brick5: node-5:/mnt/data/researchdata-5 Options Reconfigured: features.quota-deem-statfs: on features.inode-quota: on features.quota: on storage.fips-mode-rchecksum: on transport.address-family: inet nfs.disable: on locks.mandatory-locking: optimal Adding the node to the cluster was no problem. But adding a brick using 'add-brick' to the volume resulted in "volume add-brick: failed: Incorrect number of bricks supplied 1 with count 5". So my question is. What would be the correct amount of bricks needed to expand the storage on the current configuration of 'Number of Bricks: 1 x (4 + 1) = 5'? Without reconfiguring the volume all together. Thanks in advance for any pointers in how to expand this volume's storage capabilities. Thanks, Tbuck -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20240313/5b5b18fd/attachment.html>
Thomas Pries
2024-Mar-14 08:56 UTC
[Gluster-users] Adding storage capacity to a production disperse volume
Hi, On 14.03.2024 01:39, Theodore Buchwald wrote:> > ... So my question is. What would be the correct amount of bricks > needed to expand the storage on the current configuration of 'Number > of Bricks: 1 x (4 + 1) = 5'? ... >I tried something similar and ended up with a similar error. As far as I understand the documentation the answer in your case is "5". See: https://docs.gluster.org/en/v3/Administrator%20Guide/Managing%20Volumes/#expanding-volumes "... When expanding distributed replicated and distributed dispersed volumes, you need to add a number of bricks that is a multiple of the replica or disperse count. ..." One suboptimal idea could be: divide the new device in 5 partitions and add these 5 partitions as new bricks and when you get the next device, move one of this bricks to the new device, and so on ... until you have all 5 additional devices. I'm curious for other ideas. Kind regards Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20240314/eb9a02a8/attachment.html>
Strahil Nikolov
2024-Mar-20 11:40 UTC
[Gluster-users] Adding storage capacity to a production disperse volume
Hi, This is dispersed volume - the number of bricks added must match the number of bricks defined, so in your case 5 bricks.By the way, check this thread on the topic:?https://lists.gluster.org/pipermail/gluster-users/2018-July/034491.html Best Regards,Strahil Nikolov On Sun, Mar 17, 2024 at 20:38, Theodore Buchwald<buchwald at ucsc.edu> wrote: Hi, This is the first time I have tried to expand the?storage of a live gluster volume. I was able to get another supermicro storage unit for a gluster cluster that I built. The current clustered storage configuration contains five supermicro units. And the cluster volume is setup with the following configuration: node-6[/var/log/glusterfs]# gluster volume info ? Volume Name: researchdata Type: Disperse Volume ID: 93d4-482a-8933-2d81298d5b3b Status: Started Snapshot Count: 0 Number of Bricks: 1 x (4 + 1) = 5 Transport-type: tcp Bricks: Brick1: node-1:/mnt/data/researchdata-1 Brick2: node-2:/mnt/data/researchdata-2 Brick3: node-3:/mnt/data/researchdata-3 Brick4: node-4:/mnt/data/researchdata-4 Brick5: node-5:/mnt/data/researchdata-5 Options Reconfigured: features.quota-deem-statfs: on features.inode-quota: on features.quota: on storage.fips-mode-rchecksum: on transport.address-family: inet nfs.disable: on locks.mandatory-locking: optimal Adding the node to the cluster was no problem. But adding a brick using 'add-brick' to the volume resulted in "volume add-brick: failed: Incorrect number of bricks supplied 1 with count 5". So my question is. What would be the correct amount of bricks needed to expand the storage on the current configuration of 'Number of Bricks: 1 x (4 + 1) = 5'? Without reconfiguring the volume all together. Thanks in advance for any pointers in how to expand this volume's storage capabilities. ? Thanks, Tbuck________ Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://meet.google.com/cpu-eiue-hvk Gluster-users mailing list Gluster-users at gluster.org https://lists.gluster.org/mailman/listinfo/gluster-users -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20240320/baaf42b8/attachment.html>
Theodore Buchwald
2024-Mar-28 23:28 UTC
[Gluster-users] Adding storage capacity to a production disperse volume
Hello, And thank you to the users of the group. That clarified what I was wondering and answered my question on the additional storage space. I had another question in regard to adding a unit to this gluster disperse setup. I may be able to add a large capacity JBOD to this gluster configuration. So I would be able to divide the single storage unit into 5 bricks of the same size of each of the existing 5 bricks that are configured in the gluster cluster. My question is this possible to do with one unit and add to the single volume "Volume Name: researchdata" in my existing setup? Reading documentation on adding to a disperse volume I am not sure on how to proceed with this type of addition. Thanks Tbuck! On Wed, Mar 13, 2024 at 5:39?PM Theodore Buchwald <buchwald at ucsc.edu> wrote:> Hi, > > > This is the first time I have tried to expand the storage of a live > gluster volume. I was able to get another supermicro storage unit for a > gluster cluster that I built. The current clustered storage configuration > contains five supermicro units. And the cluster volume is setup with the > following configuration: > > > node-6[/var/log/glusterfs]# gluster volume info > > > > Volume Name: researchdata > > Type: Disperse > > Volume ID: 93d4-482a-8933-2d81298d5b3b > > Status: Started > > Snapshot Count: 0 > > Number of Bricks: 1 x (4 + 1) = 5 > > Transport-type: tcp > > Bricks: > > Brick1: node-1:/mnt/data/researchdata-1 > > Brick2: node-2:/mnt/data/researchdata-2 > > Brick3: node-3:/mnt/data/researchdata-3 > > Brick4: node-4:/mnt/data/researchdata-4 > > Brick5: node-5:/mnt/data/researchdata-5 > > Options Reconfigured: > > features.quota-deem-statfs: on > > features.inode-quota: on > > features.quota: on > > storage.fips-mode-rchecksum: on > > transport.address-family: inet > > nfs.disable: on > > locks.mandatory-locking: optimal > > > Adding the node to the cluster was no problem. But adding a brick using > 'add-brick' to the volume resulted in "volume add-brick: failed: Incorrect > number of bricks supplied 1 with count 5". So my question is. What would be > the correct amount of bricks needed to expand the storage on the current > configuration of 'Number of Bricks: 1 x (4 + 1) = 5'? Without > reconfiguring the volume all together. > > > Thanks in advance for any pointers in how to expand this volume's storage > capabilities. > > Thanks, Tbuck >-- Ted Buchwald Divisional LIT support of PBSci IT Staff buchwald at ucsc.edu 831-459-1298 Earth & Marine Sciences Bldg , Room A309 -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20240328/694eabf7/attachment.html>