Gluster users - Aug 2008 - Add/remove new server volumes on the fly?

Hi list,

1. While learning GlusterFS, I'was wondering if it's possible to add
server volumes to increase space capacity of my cluster "on the FLY"?
I mean, a hot upgrade.

2. Second, when using "files replicating strategy" (scheduler), is it
possible to remove a server node  without stopping the hole cluster
(ex. hardware maintaining reasons, add more disk/ram to the node ...)?

3. Finally, what's the best volume specifications for writing huge
number (hundred thousands) of big file (1 Gb size in average) on my
cluster?
I've an application which produce these big files at a regular rate
(let say, 1 file per minute)  and I'd like to know if a good volume
scpecification
can handle this amount of data?

Examples will be very welcome guys.

Thanks in advance.

cheers
F.

Hi Ferrety,
 Replies inline.

Hi list,
>
> 1. While learning GlusterFS, I'was wondering if it's possible to
add
> server volumes to increase space capacity of my cluster "on the
FLY"?
> I mean, a hot upgrade.
>
Hope you checked the Roadmap, we have it coming in 1.5 release (planned to
it ready by yearend).

>
> 2. Second, when using "files replicating strategy" (scheduler),
is it
> possible to remove a server node  without stopping the hole cluster
> (ex. hardware maintaining reasons, add more disk/ram to the node ...)?
>
Scheduler is not the term you may be looking at... check AFR (automatic file
replication), and yes, if you are using, you can take out the node when
cluster is active.

>
> 3. Finally, what's the best volume specifications for writing huge
> number (hundred thousands) of big file (1 Gb size in average) on my
> cluster?
> I've an application which produce these big files at a regular rate
> (let say, 1 file per minute)  and I'd like to know if a good volume
> scpecification
> can handle this amount of data?
>
Well, at the rate of 1GB per minute, you will hit the disk speed, hence
stripe is better option. But with Stripe translator you will not be able to
take out the nodes.

>
> Examples will be very welcome guys.
>
> Thanks in advance.
>
> cheers
> F.
>


-- 
Amar Tumballi
Gluster/GlusterFS Hacker
[bulde on #gluster/irc.gnu.org]
http://www.zresearch.com - Commoditizing Super Storage!
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://supercolony.gluster.org/pipermail/gluster-users/attachments/20080815/2c79aab9/attachment.html>

At 03:25 AM 8/15/2008, ferrety ferrety wrote:
>Hi list,
>
>1. While learning GlusterFS, I'was wondering if it's possible to add
>server volumes to increase space capacity of my cluster "on the
FLY"?
>I mean, a hot upgrade.
I'd *think* could could add bricks to an existing unify volume.  I'm 
not sure if you'd have to remount the clients or not.  you'd have to 
restart the server--I'm not sure of a sighup will do the job or 
not.  Someone more qualified will answer I'm sure, but I'd think just 
adding bricks will add space.
>2. Second, when using "files replicating strategy" (scheduler), is
it
>possible to remove a server node  without stopping the hole cluster
>(ex. hardware maintaining reasons, add more disk/ram to the node ...)?
if you have multiple servers AFR'ed, if one server is down, the rest 
will continue after the timeout period.  when that servers back on 
line it will coninue AFRing to it.
Remember, AFR does healing when files are accessed, so the server 
that's offline may be out of sync until any updated files are accessed
again.
>3. Finally, what's the best volume specifications for writing huge
>number (hundred thousands) of big file (1 Gb size in average) on my
>cluster?
>I've an application which produce these big files at a regular rate
>(let say, 1 file per minute)  and I'd like to know if a good volume
>scpecification
>can handle this amount of data?
>
>Examples will be very welcome guys.
>
>Thanks in advance.
>
>cheers
>F.
>
>_______________________________________________
>Gluster-users mailing list
>Gluster-users at gluster.org
>http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users

At 03:25 AM 8/15/2008, ferrety ferrety wrote:
>Hi list,
>
>1. While learning GlusterFS, I''was wondering if it''s
possible to add
>server volumes to increase space capacity of my cluster "on the
FLY"?
>I mean, a hot upgrade.
I''d *think* could could add bricks to an existing unify volume. 
I''m
not sure if you''d have to remount the clients or not.  you''d
have to
restart the server--I''m not sure of a sighup will do the job or 
not.  Someone more qualified will answer I''m sure, but I''d
think just
adding bricks will add space.
>2. Second, when using "files replicating strategy" (scheduler), is
it
>possible to remove a server node  without stopping the hole cluster
>(ex. hardware maintaining reasons, add more disk/ram to the node ...)?
if you have multiple servers AFR''ed, if one server is down, the rest 
will continue after the timeout period.  when that servers back on 
line it will coninue AFRing to it.
Remember, AFR does healing when files are accessed, so the server 
that''s offline may be out of sync until any updated files are accessed
again.
>3. Finally, what''s the best volume specifications for writing huge
>number (hundred thousands) of big file (1 Gb size in average) on my
>cluster?
>I''ve an application which produce these big files at a regular rate
>(let say, 1 file per minute)  and I''d like to know if a good volume
>scpecification
>can handle this amount of data?
>
>Examples will be very welcome guys.
>
>Thanks in advance.
>
>cheers
>F.
>
>_______________________________________________
>Gluster-users mailing list
>Gluster-users at gluster.org
>http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users

At 03:25 AM 8/15/2008, ferrety ferrety wrote:
>Hi list,
>
>1. While learning GlusterFS, I''was wondering if it''s
possible to add
>server volumes to increase space capacity of my cluster "on the
FLY"?
>I mean, a hot upgrade.
I''d *think* could could add bricks to an existing unify volume. 
I''m
not sure if you''d have to remount the clients or not.  you''d
have to
restart the server--I''m not sure of a sighup will do the job or 
not.  Someone more qualified will answer I''m sure, but I''d
think just
adding bricks will add space.
>2. Second, when using "files replicating strategy" (scheduler), is
it
>possible to remove a server node  without stopping the hole cluster
>(ex. hardware maintaining reasons, add more disk/ram to the node ...)?
if you have multiple servers AFR''ed, if one server is down, the rest 
will continue after the timeout period.  when that servers back on 
line it will coninue AFRing to it.
Remember, AFR does healing when files are accessed, so the server 
that''s offline may be out of sync until any updated files are accessed
again.
>3. Finally, what''s the best volume specifications for writing huge
>number (hundred thousands) of big file (1 Gb size in average) on my
>cluster?
>I''ve an application which produce these big files at a regular rate
>(let say, 1 file per minute)  and I''d like to know if a good volume
>scpecification
>can handle this amount of data?
>
>Examples will be very welcome guys.
>
>Thanks in advance.
>
>cheers
>F.
>
>_______________________________________________
>Gluster-users mailing list
>Gluster-users at gluster.org
>http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users

At 03:25 AM 8/15/2008, ferrety ferrety wrote:
>Hi list,
>
>1. While learning GlusterFS, I''was wondering if it''s
possible to add
>server volumes to increase space capacity of my cluster "on the
FLY"?
>I mean, a hot upgrade.
I''d *think* could could add bricks to an existing unify volume. 
I''m
not sure if you''d have to remount the clients or not.  you''d
have to
restart the server--I''m not sure of a sighup will do the job or 
not.  Someone more qualified will answer I''m sure, but I''d
think just
adding bricks will add space.
>2. Second, when using "files replicating strategy" (scheduler), is
it
>possible to remove a server node  without stopping the hole cluster
>(ex. hardware maintaining reasons, add more disk/ram to the node ...)?
if you have multiple servers AFR''ed, if one server is down, the rest 
will continue after the timeout period.  when that servers back on 
line it will coninue AFRing to it.
Remember, AFR does healing when files are accessed, so the server 
that''s offline may be out of sync until any updated files are accessed
again.
>3. Finally, what''s the best volume specifications for writing huge
>number (hundred thousands) of big file (1 Gb size in average) on my
>cluster?
>I''ve an application which produce these big files at a regular rate
>(let say, 1 file per minute)  and I''d like to know if a good volume
>scpecification
>can handle this amount of data?
>
>Examples will be very welcome guys.
>
>Thanks in advance.
>
>cheers
>F.
>
>_______________________________________________
>Gluster-users mailing list
>Gluster-users at gluster.org
>http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users

Hi guys,
>>
>> 1. While learning GlusterFS, I'was wondering if it's possible
to add
>> server volumes to increase space capacity of my cluster "on the
FLY"?
>> I mean, a hot upgrade.
>
> I'd *think* could could add bricks to an existing unify volume. 
I'm not
> sure if you'd have to remount the clients or not.  you'd have to
restart the
> server--I'm not sure of a sighup will do the job or not.  Someone more
> qualified will answer I'm sure, but I'd think just adding bricks
will add
> space.
I'll try to see by myself.
>
>> 2. Second, when using "files replicating strategy"
(scheduler), is it
>> possible to remove a server node  without stopping the hole cluster
>> (ex. hardware maintaining reasons, add more disk/ram to the node ...)?
>
> if you have multiple servers AFR'ed, if one server is down, the rest
will
> continue after the timeout period.  when that servers back on line it will
> coninue AFRing to it.
> Remember, AFR does healing when files are accessed, so the server
that's
> offline may be out of sync until any updated files are accessed again.
Hmmm. Could it be possible to force it to synchronize itself when it's back?


Thanks
F.