Greg,
can you describe the sequence of operations performed on the
mountpoint before you faced this?
Avati
On Wed, Apr 1, 2009 at 9:06 PM, Greg <greg at easyflirt.com>
wrote:> Hi,
>
> I've just upgraded to 2.0.0-rc7, and add read-ahead + io-cache
translators
> on server side, and got this error on both servers :
>
> 2009-04-01 17:26:21 N [server-protocol.c:7513:mop_setvolume] server:
> accepted client from 10.0.8.3:954
> 2009-04-01 17:26:21 N [server-protocol.c:7513:mop_setvolume] server:
> accepted client from 10.0.8.3:953
> pending frames:
> <D4>J5Y<DB>^?
> patchset: 4e5c297d7c3480d0d3ab1c0c2a184c6a4fb801ef
> signal received: 11
> configuration details:argp 1
> backtrace 1
> bdb->cursor->get 1
> db.h 1
> dlfcn 1
> fdatasync 1
> libpthread 1
> llistxattr 1
> setfsid 1
> spinlock 1
> epoll.h 1
> xattr.h 1
> st_atim.tv_nsec 1
> package-string: glusterfs 2.0.0rc7
> /lib/libc.so.6[0x7fdb58be9f60]
> /lib/libpthread.so.0(pthread_spin_lock+0x0)[0x7fdb58f16630]
> /usr/lib/libglusterfs.so.0(fd_ref+0x1a)[0x7fdb5935139a]
> /usr/lib/libglusterfs.so.0(fop_flush_stub+0x4a)[0x7fdb5934b69a]
>
/usr/lib/glusterfs/2.0.0rc7/xlator/performance/io-threads.so(iot_flush+0x28)[0x7fdb5859a848]
> /usr/lib/libglusterfs.so.0(default_flush+0xaa)[0x7fdb59340eba]
>
/usr/lib/glusterfs/2.0.0rc7/xlator/performance/write-behind.so(wb_flush+0x268)[0x7fdb5818a088]
>
/usr/lib/glusterfs/2.0.0rc7/xlator/performance/read-ahead.so(ra_flush+0xe0)[0x7fdb57f7fb30]
>
/usr/lib/glusterfs/2.0.0rc7/xlator/protocol/server.so(server_release+0xf9)[0x7fdb57d69e79]
>
/usr/lib/glusterfs/2.0.0rc7/xlator/protocol/server.so(protocol_server_pollin+0xa6)[0x7fdb57d647d6]
>
/usr/lib/glusterfs/2.0.0rc7/xlator/protocol/server.so(notify+0x38)[0x7fdb57d64818]
>
/usr/lib/glusterfs/2.0.0rc7/transport/socket.so(socket_event_handler+0xe0)[0x7fdb57b57b80]
> /usr/lib/libglusterfs.so.0[0x7fdb593531ef]
> /usr/sbin/glusterfsd(main+0xa81)[0x403a21]
> /lib/libc.so.6(__libc_start_main+0xe6)[0x7fdb58bd61a6]
> /usr/sbin/glusterfsd[0x402519]
> ---------
>
>
> Configuration:
> # file: /etc/glusterfs/glusterfsd.vol
>
> #
> # Volumes
> #
> volume media-small
> ? ? ? type storage/posix
> ? ? ? option directory /var/local/glusterfs/media_small
> end-volume
>
> volume media-medium
> ? ? ? type storage/posix
> ? ? ? option directory /var/local/glusterfs/media_medium
> end-volume
>
> # Lock posix
> volume media-small-locks
> ? ? ? type features/posix-locks
> ? ? ? option mandatory-locks on
> ? ? ? subvolumes media-small
> # ? ? ? subvolumes trash # enable this if you need trash can support (NOTE:
> not present in 1.3.0-pre5+ releases)
> end-volume
>
> volume media-medium-locks
> ? ? ? type features/posix-locks
> ? ? ? option mandatory-locks on
> ? ? ? subvolumes media-medium
> # ? ? ? subvolumes trash # enable this if you need trash can support (NOTE:
> not present in 1.3.0-pre5+ releases)
> end-volume
>
>
> #
> # Performance
> #
> volume media-small-iot
> ? ? ? type performance/io-threads
> ? ? ? subvolumes media-small-locks
> ? ? ? option thread-count 4 # default value is 1
> end-volume
>
> volume media-small-ioc
> ? ? ? type performance/io-cache
> ? ? ? option cache-size 128MB ? ? ? ? # default is 32MB
> ? ? ? option page-size 128KB ? ? ? ? ?# default is 128KB
> ? ? ? subvolumes media-small-iot
> end-volume
>
> volume media-small-wb
> ? ? ? type performance/write-behind
> ? ? ? option flush-behind on ? ? ? ? ?# default is off
> ? ? ? subvolumes media-small-ioc
> end-volume
>
> volume media-small-ra
> ? ? ? type performance/read-ahead
> ? ? ? subvolumes media-small-wb
> ? ? ? option page-size 256KB ? ? ? ? ?# default is 256KB
> ? ? ? option page-count 4 ? ? ? ? ? ? # default is 2 - cache per file >
(page-count x page-size)
> ? ? ? option force-atime-update no ? ?# defalut is 'no'
> end-volume
>
>
> volume media-medium-iot
> ? ? ? type performance/io-threads
> ? ? ? subvolumes media-medium-locks
> ? ? ? option thread-count 4 # default value is 1
> end-volume
>
> volume media-medium-ioc
> ? ? ? type performance/io-cache
> ? ? ? option cache-size 128MB ? ? ? ? # default is 32MB
> ? ? ? option page-size 128KB ? ? ? ? ?# default is 128KB
> ? ? ? subvolumes media-medium-iot
> end-volume
>
> volume media-medium-wb
> ? ? ? type performance/write-behind
> ? ? ? option flush-behind on ? ? ? ? ?# default is off
> ? ? ? subvolumes media-medium-ioc
> end-volume
>
> volume media-medium-ra
> ? ? ? type performance/read-ahead
> ? ? ? subvolumes media-medium-wb
> ? ? ? option page-size 256KB ? ? ? ? ?# default is 256KB
> ? ? ? option page-count 4 ? ? ? ? ? ? # default is 2 - cache per file >
(page-count x page-size)
> ? ? ? option force-atime-update no ? ?# defalut is 'no'
> end-volume
>
>
>
>
> #
> # Serveur
> #
> volume server
> ? ? ? type protocol/server
> ? ? ? option transport-type tcp/server
> ? ? ? option auth.addr.media-small-ra.allow 10.0.*.*
> ? ? ? option auth.addr.media-medium-ra.allow 10.0.*.*
> ? ? ? # Autoconfiguration, e.g. :
> ? ? ? # glusterfs -l /tmp/glusterfs.log --server=filer-04 ./Cache
> ? ? ? option client-volume-filename /etc/glusterfs/glusterfs.vol
> ? ? ? subvolumes media-small-ra media-medium-ra # volumes export?s
> end-volume
>
> # file: /etc/glusterfs/glusterfs.vol
>
>
> #
> # Clients
> #
> volume media-small-filer-04
> ? ? ? type protocol/client
> ? ? ? option transport-type tcp/client
> ? ? ? option remote-host filer-04.local
> ? ? ? option remote-subvolume media-small-ra
> end-volume
>
> volume media-small-filer-05
> ? ? ? type protocol/client
> ? ? ? option transport-type tcp/client
> ? ? ? option remote-host filer-05.local
> ? ? ? option remote-subvolume media-small-ra
> end-volume
>
> volume media-medium-filer-04
> ? ? ? type protocol/client
> ? ? ? option transport-type tcp/client
> ? ? ? option remote-host filer-04.local
> ? ? ? option remote-subvolume media-medium-ra
> end-volume
>
> volume media-medium-filer-05
> ? ? ? type protocol/client
> ? ? ? option transport-type tcp/client
> ? ? ? option remote-host filer-05.local
> ? ? ? option remote-subvolume media-medium-ra
> end-volume
>
>
> #
> # Volume principal
> #
> volume afr-small
> ? ? ? # AFR has been renamed to "Replicate" for simplicity.
> ? ? ? type cluster/replicate
> ? ? ? # Il faut mettre le serveur avec le moins d'espace disque en 1er
:
> ? ? ? # "When doing a "df -h" on a client, the AVAILABLE
disk space will
> display the maximum disk space of the first AFR sub volume defined in the
> spec file. So if you have two servers with 50 gigs and 100 gigs of free
disk
> space, and the server with 100 gigs is listed first, then you will see 100
> gigs available even though one server only has 50 gigs free. "
> ? ? ? subvolumes media-small-filer-04 media-small-filer-05
> end-volume
>
> volume afr-medium
> ? ? ? # AFR has been renamed to "Replicate" for simplicity.
> ? ? ? type cluster/replicate
> ? ? ? subvolumes media-medium-filer-04 media-medium-filer-05
> end-volume
>
> #
> # Performance
> #
> volume iot-small
> ? ? ? type performance/io-threads
> ? ? ? option thread-count 8 ?# default is 1
> ? ? ? subvolumes afr-small
> end-volume
>
> volume readahead-small
> ? ? ? type performance/read-ahead
> ? ? ? subvolumes iot-small
> ? ? ? option page-size 1MB ? ? ? ? # default is 256KB
> ? ? ? option page-count 4 ? ? ? ? ?# default is 2 - cache per file >
(page-count x page-size)
> ? ? ? option force-atime-update no # defalut is 'no'
> end-volume
>
> volume iocache-small
> ? ? ? type performance/io-cache
> ? ? ? option cache-size 64MB ? ? ? ? ?# default is 32MB
> ? ? ? option page-size 256KB ? ? ? ? ?# default is 128KB
> ? ? ? subvolumes readahead-small
> end-volume
>
> volume wb-small
> ? ? ? type performance/write-behind
> ? ? ? option window-size 1MB # max 4MB
> ? ? ? option flush-behind on # default is off
> ? ? ? subvolumes iocache-small
> end-volume
>
> volume iot-medium
> ? ? ? type performance/io-threads
> ? ? ? option thread-count 8 ?# default is 1
> ? ? ? subvolumes afr-medium
> end-volume
>
> volume readahead-medium
> ? ? ? type performance/read-ahead
> ? ? ? subvolumes iot-medium
> ? ? ? option page-size 1MB ? ? ? ? # default is 256KB
> ? ? ? option page-count 4 ? ? ? ? ?# default is 2 - cache per file >
(page-count x page-size)
> ? ? ? option force-atime-update no # defalut is 'no'
> end-volume
>
> volume iocache-medium
> ? ? ? type performance/io-cache
> ? ? ? option cache-size 64MB ? ? ? ? ?# default is 32MB
> ? ? ? option page-size 256KB ? ? ? ? ?# default is 128KB
> ? ? ? subvolumes readahead-medium
> end-volume
>
> volume wb-medium
> ? ? ? type performance/write-behind
> ? ? ? option window-size 1MB # max 4MB
> ? ? ? option flush-behind on # default is off
> ? ? ? subvolumes iocache-medium
> end-volume
>
> Clients mount afr-* subvolumes, not with performance translators. I'm
> testing performance translators on servers side.
>
> Regards,
>
> --
> Greg
>
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
>