Gluster users - Aug 2017 - Quotas not working after adding arbiter brick to replica 2

Mabi,

We have fixed a couple of issues in the quota list path.
Could you also please attach the quota.conf file (/var/lib/glusterd/vols/
patchy/quota.conf)
(Ideally, the first few bytes would be ascii characters followed by 17
bytes per directory on which quota limit is set)
Regards,
Sanoj


On Tue, Aug 1, 2017 at 1:36 PM, mabi <mabi at protonmail.ch> wrote:
> I also just noticed quite a few of the following warning messages in the
> quotad.log log file:
>
> [2017-08-01 07:59:27.834202] W [MSGID: 108027]
[afr-common.c:2496:afr_discover_done]
> 0-myvolume-replicate-0: no read subvols for (null)
>
>
>
>
> -------- Original Message --------
> Subject: [Gluster-users] Quotas not working after adding arbiter brick to
> replica 2
> Local Time: August 1, 2017 8:49 AM
> UTC Time: August 1, 2017 6:49 AM
> From: mabi at protonmail.ch
> To: Gluster Users <gluster-users at gluster.org>
>
> Hello,
>
> As you might have read in my previous post on the mailing list I have
> added an arbiter node to my GlusterFS 3.8.11 replica 2 volume. After some
> healing issues and help of Ravi that could get fixed but now I just noticed
> that my quotas are all gone.
>
> When I run the following command:
>
> glusterfs volume quota myvolume list
>
> There is no output...
>
> In the /var/log/glusterfs/quotad.log I can see the following two lines
> when running the list command:
>
> [2017-08-01 06:46:04.451765] W [dict.c:581:dict_unref]
>
(-->/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/xlator/features/quotad.so(+0x1f3d)
> [0x7fe868e21f3d]
-->/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/xlator/features/quotad.so(+0x2d82)
> [0x7fe868e22d82] -->/usr/lib/x86_64-linux-gnu/
> libglusterfs.so.0(dict_unref+0xc0) [0x7fe86f5c2b10] ) 0-dict: dict is
> NULL [Invalid argument]
> [2017-08-01 06:46:04.459154] W [dict.c:581:dict_unref]
>
(-->/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/xlator/features/quotad.so(+0x1f3d)
> [0x7fe868e21f3d]
-->/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/xlator/features/quotad.so(+0x2d82)
> [0x7fe868e22d82] -->/usr/lib/x86_64-linux-gnu/
> libglusterfs.so.0(dict_unref+0xc0) [0x7fe86f5c2b10] ) 0-dict: dict is
> NULL [Invalid argument]
>
> In case you need this info, I have added by arbiter node to the replica 2
> by using this command:
>
> gluster volume add-brick myvolume replica 3 arbiter 1
> arbiternode.domain.tld:/srv/glusterfs/myvolume/brick
>
>
>
> How can I get my quotas back working as before? I had defined around 20
> quotas on different directories of that volume.
>
> Regards,
> Mabi
>
>
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://lists.gluster.org/mailman/listinfo/gluster-users
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20170802/bec0d0c9/attachment.html>

Hi Sanoj,
I copied over the quota.conf file from the affected volume (node 1) and opened
it up with a hex editor but can not recognize anything really except for the
first few header/version bytes. I have attached it within this mail (compressed
with bzip2) as requested.
Should I recreate them manually? there where around 10 of them. Or is there a
hope of recovering these quotas?
Regards,
M.
> -------- Original Message --------
> Subject: Re: [Gluster-users] Quotas not working after adding arbiter brick
to replica 2
> Local Time: August 2, 2017 1:06 PM
> UTC Time: August 2, 2017 11:06 AM
> From: sunnikri at redhat.com
> To: mabi <mabi at protonmail.ch>
> Gluster Users <gluster-users at gluster.org>
>
> Mabi,
> We have fixed a couple of issues in the quota list path.
> Could you also please attach the quota.conf file
(/var/lib/glusterd/vols/patchy/quota.conf)
> (Ideally, the first few bytes would be ascii characters followed by 17
bytes per directory on which quota limit is set)
> Regards,
> Sanoj
>
> On Tue, Aug 1, 2017 at 1:36 PM, mabi <mabi at protonmail.ch> wrote:
>
>> I also just noticed quite a few of the following warning messages in
the quotad.log log file:
>> [2017-08-01 07:59:27.834202] W [MSGID: 108027]
[afr-common.c:2496:afr_discover_done] 0-myvolume-replicate-0: no read subvols
for (null)
>>
>>> -------- Original Message --------
>>> Subject: [Gluster-users] Quotas not working after adding arbiter
brick to replica 2
>>> Local Time: August 1, 2017 8:49 AM
>>> UTC Time: August 1, 2017 6:49 AM
>>> From: mabi at protonmail.ch
>>> To: Gluster Users <gluster-users at gluster.org>
>>> Hello,
>>> As you might have read in my previous post on the mailing list I
have added an arbiter node to my GlusterFS 3.8.11 replica 2 volume. After some
healing issues and help of Ravi that could get fixed but now I just noticed that
my quotas are all gone.
>>> When I run the following command:
>>> glusterfs volume quota myvolume list
>>> There is no output...
>>> In the /var/log/glusterfs/quotad.log I can see the following two
lines when running the list command:
>>> [2017-08-01 06:46:04.451765] W [dict.c:581:dict_unref]
(-->/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/xlator/features/quotad.so(+0x1f3d)
[0x7fe868e21f3d]
-->/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/xlator/features/quotad.so(+0x2d82)
[0x7fe868e22d82]
-->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(dict_unref+0xc0)
[0x7fe86f5c2b10] ) 0-dict: dict is NULL [Invalid argument]
>>> [2017-08-01 06:46:04.459154] W [dict.c:581:dict_unref]
(-->/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/xlator/features/quotad.so(+0x1f3d)
[0x7fe868e21f3d]
-->/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/xlator/features/quotad.so(+0x2d82)
[0x7fe868e22d82]
-->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(dict_unref+0xc0)
[0x7fe86f5c2b10] ) 0-dict: dict is NULL [Invalid argument]
>>> In case you need this info, I have added by arbiter node to the
replica 2 by using this command:
>>> gluster volume add-brick myvolume replica 3 arbiter 1
arbiternode.domain.tld:/srv/glusterfs/myvolume/brick
>>> How can I get my quotas back working as before? I had defined
around 20 quotas on different directories of that volume.
>>> Regards,
>>> Mabi
>> _______________________________________________
>> Gluster-users mailing list
>> Gluster-users at gluster.org
>> http://lists.gluster.org/mailman/listinfo/gluster-users
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20170802/eaab543f/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: quota.conf.bz2
Type: application/x-bzip
Size: 567 bytes
Desc: not available
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20170802/eaab543f/attachment.bin>

I tried to re-create manually my quotas but not even that works now. Running the
"limit-usage" command as showed below returns success:
$ sudo gluster volume quota myvolume limit-usage /userdirectory 50GB
volume quota : success
but when I list the quotas using "list" nothing appears.
What can I do to fix that issue with the quotas?
> -------- Original Message --------
> Subject: Re: [Gluster-users] Quotas not working after adding arbiter brick
to replica 2
> Local Time: August 2, 2017 2:35 PM
> UTC Time: August 2, 2017 12:35 PM
> From: mabi at protonmail.ch
> To: Sanoj Unnikrishnan <sunnikri at redhat.com>
> Gluster Users <gluster-users at gluster.org>
> Hi Sanoj,
> I copied over the quota.conf file from the affected volume (node 1) and
opened it up with a hex editor but can not recognize anything really except for
the first few header/version bytes. I have attached it within this mail
(compressed with bzip2) as requested.
> Should I recreate them manually? there where around 10 of them. Or is there
a hope of recovering these quotas?
> Regards,
> M.
>
>> -------- Original Message --------
>> Subject: Re: [Gluster-users] Quotas not working after adding arbiter
brick to replica 2
>> Local Time: August 2, 2017 1:06 PM
>> UTC Time: August 2, 2017 11:06 AM
>> From: sunnikri at redhat.com
>> To: mabi <mabi at protonmail.ch>
>> Gluster Users <gluster-users at gluster.org>
>>
>> Mabi,
>> We have fixed a couple of issues in the quota list path.
>> Could you also please attach the quota.conf file
(/var/lib/glusterd/vols/patchy/quota.conf)
>> (Ideally, the first few bytes would be ascii characters followed by 17
bytes per directory on which quota limit is set)
>> Regards,
>> Sanoj
>>
>> On Tue, Aug 1, 2017 at 1:36 PM, mabi <mabi at protonmail.ch>
wrote:
>>
>>> I also just noticed quite a few of the following warning messages
in the quotad.log log file:
>>> [2017-08-01 07:59:27.834202] W [MSGID: 108027]
[afr-common.c:2496:afr_discover_done] 0-myvolume-replicate-0: no read subvols
for (null)
>>>
>>>> -------- Original Message --------
>>>> Subject: [Gluster-users] Quotas not working after adding
arbiter brick to replica 2
>>>> Local Time: August 1, 2017 8:49 AM
>>>> UTC Time: August 1, 2017 6:49 AM
>>>> From: mabi at protonmail.ch
>>>> To: Gluster Users <gluster-users at gluster.org>
>>>> Hello,
>>>> As you might have read in my previous post on the mailing list
I have added an arbiter node to my GlusterFS 3.8.11 replica 2 volume. After some
healing issues and help of Ravi that could get fixed but now I just noticed that
my quotas are all gone.
>>>> When I run the following command:
>>>> glusterfs volume quota myvolume list
>>>> There is no output...
>>>> In the /var/log/glusterfs/quotad.log I can see the following
two lines when running the list command:
>>>> [2017-08-01 06:46:04.451765] W [dict.c:581:dict_unref]
(-->/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/xlator/features/quotad.so(+0x1f3d)
[0x7fe868e21f3d]
-->/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/xlator/features/quotad.so(+0x2d82)
[0x7fe868e22d82]
-->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(dict_unref+0xc0)
[0x7fe86f5c2b10] ) 0-dict: dict is NULL [Invalid argument]
>>>> [2017-08-01 06:46:04.459154] W [dict.c:581:dict_unref]
(-->/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/xlator/features/quotad.so(+0x1f3d)
[0x7fe868e21f3d]
-->/usr/lib/x86_64-linux-gnu/glusterfs/3.8.11/xlator/features/quotad.so(+0x2d82)
[0x7fe868e22d82]
-->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(dict_unref+0xc0)
[0x7fe86f5c2b10] ) 0-dict: dict is NULL [Invalid argument]
>>>> In case you need this info, I have added by arbiter node to the
replica 2 by using this command:
>>>> gluster volume add-brick myvolume replica 3 arbiter 1
arbiternode.domain.tld:/srv/glusterfs/myvolume/brick
>>>> How can I get my quotas back working as before? I had defined
around 20 quotas on different directories of that volume.
>>>> Regards,
>>>> Mabi
>>> _______________________________________________
>>> Gluster-users mailing list
>>> Gluster-users at gluster.org
>>> http://lists.gluster.org/mailman/listinfo/gluster-users
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20170803/0c6b7686/attachment.html>