Gluster users - Mar 2024 - Adding storage capacity to a production disperse volume

Hi,


This is the first time I have tried to expand the storage of a live gluster
volume. I was able to get another supermicro storage unit for a gluster
cluster that I built. The current clustered storage configuration contains
five supermicro units. And the cluster volume is setup with the following
configuration:


node-6[/var/log/glusterfs]# gluster volume info



Volume Name: researchdata

Type: Disperse

Volume ID: 93d4-482a-8933-2d81298d5b3b

Status: Started

Snapshot Count: 0

Number of Bricks: 1 x (4 + 1) = 5

Transport-type: tcp

Bricks:

Brick1: node-1:/mnt/data/researchdata-1

Brick2: node-2:/mnt/data/researchdata-2

Brick3: node-3:/mnt/data/researchdata-3

Brick4: node-4:/mnt/data/researchdata-4

Brick5: node-5:/mnt/data/researchdata-5

Options Reconfigured:

features.quota-deem-statfs: on

features.inode-quota: on

features.quota: on

storage.fips-mode-rchecksum: on

transport.address-family: inet

nfs.disable: on

locks.mandatory-locking: optimal


Adding the node to the cluster was no problem. But adding a brick using
'add-brick' to the volume resulted in "volume add-brick: failed:
Incorrect
number of bricks supplied 1 with count 5". So my question is. What would be
the correct amount of bricks needed to expand the storage on the current
configuration of 'Number of Bricks: 1 x (4 + 1) = 5'? Without
reconfiguring
the volume all together.


Thanks in advance for any pointers in how to expand this volume's storage
capabilities.

  Thanks, Tbuck
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20240313/5b5b18fd/attachment.html>

Hi,

On 14.03.2024 01:39, Theodore Buchwald wrote:
>
> ... So my question is. What would be the correct amount of bricks
> needed to expand the storage on the current configuration of 'Number
> of Bricks: 1 x (4 + 1) = 5'? ...
>
I tried something similar and ended up with a similar error. As far as I
understand the documentation the answer in your case is "5".

See:
https://docs.gluster.org/en/v3/Administrator%20Guide/Managing%20Volumes/#expanding-volumes


"... When expanding distributed replicated and distributed dispersed
volumes, you need to add a number of bricks that is a multiple of the
replica or disperse count. ..."

One suboptimal idea could be: divide the new device in 5 partitions and
add these 5 partitions as new bricks and when you get the next device,
move one of this bricks to the new device, and so on ... until you have
all 5 additional devices.

I'm curious for other ideas.

Kind regards

Thomas

-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20240314/eb9a02a8/attachment.html>

Hi,
This is dispersed volume - the number of bricks added must match the number of
bricks defined, so in your case 5 bricks.By the way, check this thread on the
topic:?https://lists.gluster.org/pipermail/gluster-users/2018-July/034491.html
Best Regards,Strahil Nikolov 
 
  On Sun, Mar 17, 2024 at 20:38, Theodore Buchwald<buchwald at ucsc.edu>
wrote:
Hi,




This is the first time I have tried to expand the?storage of a live gluster
volume. I was able to get another supermicro storage unit for a gluster cluster
that I built. The current clustered storage configuration contains five
supermicro units. And the cluster volume is setup with the following
configuration:




node-6[/var/log/glusterfs]# gluster volume info

?

Volume Name: researchdata

Type: Disperse

Volume ID: 93d4-482a-8933-2d81298d5b3b

Status: Started

Snapshot Count: 0

Number of Bricks: 1 x (4 + 1) = 5

Transport-type: tcp

Bricks:

Brick1: node-1:/mnt/data/researchdata-1

Brick2: node-2:/mnt/data/researchdata-2

Brick3: node-3:/mnt/data/researchdata-3

Brick4: node-4:/mnt/data/researchdata-4

Brick5: node-5:/mnt/data/researchdata-5

Options Reconfigured:

features.quota-deem-statfs: on

features.inode-quota: on

features.quota: on

storage.fips-mode-rchecksum: on

transport.address-family: inet

nfs.disable: on

locks.mandatory-locking: optimal




Adding the node to the cluster was no problem. But adding a brick using
'add-brick' to the volume resulted in "volume add-brick: failed:
Incorrect number of bricks supplied 1 with count 5". So my question is.
What would be the correct amount of bricks needed to expand the storage on the
current configuration of 'Number of Bricks: 1 x (4 + 1) = 5'? Without
reconfiguring the volume all together.




Thanks in advance for any pointers in how to expand this volume's storage
capabilities.

? Thanks, Tbuck________



Community Meeting Calendar:

Schedule -
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Bridge: https://meet.google.com/cpu-eiue-hvk
Gluster-users mailing list
Gluster-users at gluster.org
https://lists.gluster.org/mailman/listinfo/gluster-users
  
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20240320/baaf42b8/attachment.html>

Hello,

And thank you to the users of the group. That clarified what I was
wondering and answered my question on the additional storage space.

I had another question in regard to adding a unit to this gluster disperse
setup. I may be able to add a large capacity JBOD to this gluster
configuration. So I would be able to divide the single storage unit into 5
bricks of the same size of each of the existing 5 bricks that are
configured in the gluster cluster.

My question is this possible to do with one unit and add to the
single volume "Volume Name: researchdata" in my existing setup?
Reading
documentation on adding to a disperse volume I am not sure on how to
proceed with this type of addition.

   Thanks Tbuck!

On Wed, Mar 13, 2024 at 5:39?PM Theodore Buchwald <buchwald at ucsc.edu>
wrote:
> Hi,
>
>
> This is the first time I have tried to expand the storage of a live
> gluster volume. I was able to get another supermicro storage unit for a
> gluster cluster that I built. The current clustered storage configuration
> contains five supermicro units. And the cluster volume is setup with the
> following configuration:
>
>
> node-6[/var/log/glusterfs]# gluster volume info
>
>
>
> Volume Name: researchdata
>
> Type: Disperse
>
> Volume ID: 93d4-482a-8933-2d81298d5b3b
>
> Status: Started
>
> Snapshot Count: 0
>
> Number of Bricks: 1 x (4 + 1) = 5
>
> Transport-type: tcp
>
> Bricks:
>
> Brick1: node-1:/mnt/data/researchdata-1
>
> Brick2: node-2:/mnt/data/researchdata-2
>
> Brick3: node-3:/mnt/data/researchdata-3
>
> Brick4: node-4:/mnt/data/researchdata-4
>
> Brick5: node-5:/mnt/data/researchdata-5
>
> Options Reconfigured:
>
> features.quota-deem-statfs: on
>
> features.inode-quota: on
>
> features.quota: on
>
> storage.fips-mode-rchecksum: on
>
> transport.address-family: inet
>
> nfs.disable: on
>
> locks.mandatory-locking: optimal
>
>
> Adding the node to the cluster was no problem. But adding a brick using
> 'add-brick' to the volume resulted in "volume add-brick:
failed: Incorrect
> number of bricks supplied 1 with count 5". So my question is. What
would be
> the correct amount of bricks needed to expand the storage on the current
> configuration of 'Number of Bricks: 1 x (4 + 1) = 5'? Without
> reconfiguring the volume all together.
>
>
> Thanks in advance for any pointers in how to expand this volume's
storage
> capabilities.
>
>   Thanks, Tbuck
>

-- 

Ted Buchwald

Divisional LIT support of PBSci IT Staff
buchwald at ucsc.edu
831-459-1298

Earth & Marine Sciences Bldg , Room A309
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20240328/694eabf7/attachment.html>