Gluster users - Jan 2010 - Random directory/files gets unavailable after sometime

Hello,

I am using glusterfs v3.0.0 and having some problems with random
directory/files.

They work fine for some time ( hours ) and them suddenly gets unavailable:

# ls -lh
ls: cannot access MyDir: No such file or directory
total 107M
d????????? ? ?      ?         ?            ? MyDir
( long dir list, intentionally hidden )

At the logs i get a lot of messages like those ones:

[2010-01-07 13:36:16] W [fuse-bridge.c:793:fuse_getattr] glusterfs-fuse: 270708:
GETATTR 3057375160 (fuse_loc_fill() failed)
[2010-01-07 13:36:16] W [fuse-bridge.c:793:fuse_getattr] glusterfs-fuse: 270735:
GETATTR 3057375160 (fuse_loc_fill() failed)
[2010-01-07 13:36:26] W [fuse-bridge.c:793:fuse_getattr] glusterfs-fuse: 270841:
GETATTR 3057375160 (fuse_loc_fill() failed)
[2010-01-07 13:36:26] W [fuse-bridge.c:793:fuse_getattr] glusterfs-fuse: 270844:
GETATTR 3057375160 (fuse_loc_fill() failed)
[2010-01-07 13:36:26] W [fuse-bridge.c:793:fuse_getattr] glusterfs-fuse: 270847:
GETATTR 3057375160 (fuse_loc_fill() failed)
[2010-01-07 13:36:26] W [fuse-bridge.c:793:fuse_getattr] glusterfs-fuse: 270874:
GETATTR 3057375160 (fuse_loc_fill() failed)

Any ideas of what is causing this issue?

Note that restarting glusterfs fix the problem, but this is not ideal when you
are trying to create a HA env.

I tried to search about it, but couldn't find any additional info about this
problem, so i am a bit lost.

Best Regards,
---

Fernando Marcelo
www.consultorpc.com
fernando at consultorpc.com

On Thu, Jan 7, 2010 at 6:22 PM, Fernando Morgenstern
<fernando at consultorpc.com> wrote:
> Hello,
>
> I am using glusterfs v3.0.0 and having some problems with random
directory/files.
>
> They work fine for some time ( hours ) and them suddenly gets unavailable:
>
> # ls -lh
> ls: cannot access MyDir: No such file or directory
> total 107M
> d????????? ? ? ? ? ?? ? ? ? ? ? ? ? ? ? ? ?? MyDir
> ( long dir list, intentionally hidden )
>
> At the logs i get a lot of messages like those ones:
>
> [2010-01-07 13:36:16] W [fuse-bridge.c:793:fuse_getattr] glusterfs-fuse:
270708: GETATTR 3057375160 (fuse_loc_fill() failed)
> [2010-01-07 13:36:16] W [fuse-bridge.c:793:fuse_getattr] glusterfs-fuse:
270735: GETATTR 3057375160 (fuse_loc_fill() failed)
> [2010-01-07 13:36:26] W [fuse-bridge.c:793:fuse_getattr] glusterfs-fuse:
270841: GETATTR 3057375160 (fuse_loc_fill() failed)
> [2010-01-07 13:36:26] W [fuse-bridge.c:793:fuse_getattr] glusterfs-fuse:
270844: GETATTR 3057375160 (fuse_loc_fill() failed)
> [2010-01-07 13:36:26] W [fuse-bridge.c:793:fuse_getattr] glusterfs-fuse:
270847: GETATTR 3057375160 (fuse_loc_fill() failed)
> [2010-01-07 13:36:26] W [fuse-bridge.c:793:fuse_getattr] glusterfs-fuse:
270874: GETATTR 3057375160 (fuse_loc_fill() failed)
>
> Any ideas of what is causing this issue?
>
Can you describe what kind of IO is performed over the mountpoint?
What applications and tools use the mountpoint? Also, posting the full
log file (including the config on top) will help us analyze better.

Avati

Hello Vijay,

Just want to inform that i applied this fix and glusterfs is working perfectly
here for 3 days.

Best Regards,
---

Fernando Marcelo
www.consultorpc.com
fernando at consultorpc.com


Em 08/01/2010, ?s 04:01, Vijay Bellur escreveu:
> Hello Fernando,
> 
> Can you please try by applying this patch to GlusterFS v3.0.0?
> 
> http://patches.gluster.com/patch/2622
> 
> Thanks,
> Vijay