It's obviously been a while since I brought this issue up, but it has
cropped up again for us. We're now on 3.0.3 and I've included my
glusterfs*.vol files below. We end up with file i/o errors like the
ones below:
forrtl: File exists
forrtl: severe (10): cannot overwrite existing file, unit 18,
file /work/b/brs/vdWSi/CHGCAR
Even if the file existed, it shouldn't really be a problem. Other file
systems work just fine. I'll get some more verbose logging going and
share my output. glusterfsd.vol is the same in the referenced e-mails
below.
Thanks in advance,
-Brian
## file auto generated by /usr/bin/glusterfs-volgen (mount.vol)
# Cmd line:
# $ /usr/bin/glusterfs-volgen --name work pvfs0:/pvfs/glusterfs
pvfs1:/pvfs/glusterfs
# TRANSPORT-TYPE tcp
volume pvfs0-1
type protocol/client
option transport-type tcp
option remote-host pvfs0
option remote-port 6996
option transport.socket.nodelay on
option remote-subvolume brick1
end-volume
volume pvfs1-1
type protocol/client
option transport-type tcp
option remote-host pvfs1
option remote-port 6996
option transport.socket.nodelay on
option remote-subvolume brick1
end-volume
volume distribute
type cluster/distribute
subvolumes pvfs0-1 pvfs1-1
end-volume
volume writebehind
type performance/write-behind
option cache-size 4MB
subvolumes distribute
end-volume
volume readahead
type performance/read-ahead
option page-count 4
subvolumes writebehind
end-volume
#volume iocache
# type performance/io-cache
# option cache-size 1GB
# option cache-timeout 1
# subvolumes readahead
#end-volume
#volume quickread
# type performance/quick-read
# option cache-timeout 1
# option max-file-size 64kB
# subvolumes iocache
#end-volume
#volume statprefetch
# type performance/stat-prefetch
# subvolumes quickread
#end-volume
=========================
* replies inline *
On Fri, Feb 12, 2010 at 9:52 PM, Brian Smith <brs at usf.edu> wrote:
> Hi, Harshavardhana,
>
> Thanks for the reply. My volume files are below. Unfortunately,
there> is no helpful information in the logs as it seems the log verbosity is
> set too low. I'll update that and hopefully get some more
information.> I'm using distribute and not NUFA.
>
>
Perfect.
> ## file auto generated by /usr/bin/glusterfs-volgen (export.vol)
> # Cmd line:
> # $ /usr/bin/glusterfs-volgen --name work pvfs0:/pvfs/glusterfs
> pvfs1:/pvfs/glusterfs
>
> volume posix1
> type storage/posix
> option directory /pvfs/glusterfs
> end-volume
>
> volume locks1
> type features/locks
> subvolumes posix1
> option mandatory-locks on
> end-volume
>
> volume brick1
> type performance/io-threads
> option thread-count 8
> subvolumes locks1
> end-volume
>
> volume server-tcp
> type protocol/server
> option transport-type tcp
> option auth.addr.brick1.allow *
> option transport.socket.listen-port 6996
> option transport.socket.nodelay on
> subvolumes brick1
> end-volume
>
> ## file auto generated by /usr/bin/glusterfs-volgen (mount.vol)
> # Cmd line:
> # $ /usr/bin/glusterfs-volgen --name work pvfs0:/pvfs/glusterfs
> pvfs1:/pvfs/glusterfs
>
> # TRANSPORT-TYPE tcp
> volume pvfs0-1
> type protocol/client
> option transport-type tcp
> option remote-host pvfs0
> option transport.socket.nodelay on
> option transport.remote-port 6996
> option remote-subvolume brick1
> end-volume
>
> volume pvfs1-1
> type protocol/client
> option transport-type tcp
> option remote-host pvfs1
> option transport.socket.nodelay on
> option transport.remote-port 6996
> option remote-subvolume brick1
> end-volume
>
> volume distribute
> type cluster/distribute
> subvolumes pvfs0-1 pvfs1-1
> end-volume
>
> volume writebehind
> type performance/write-behind
> option cache-size 4MB
> subvolumes distribute
> end-volume
>
> volume readahead
> type performance/read-ahead
> option page-count 4
> subvolumes writebehind
> end-volume
>
> volume iocache
> type performance/io-cache
> option cache-size 1GB
> option cache-timeout 1
> subvolumes readahead
> end-volume
>
> volume quickread
> type performance/quick-read
> option cache-timeout 1
> option max-file-size 64kB
> subvolumes iocache
> end-volume
>
> volume statprefetch
> type performance/stat-prefetch
> subvolumes quickread
> end-volume
>
>
> Could you remove the above "quickread", stat-prefetch, io-cache
and
test
again. Also could you state the version you are using?.
> --
> Brian Smith
> Senior Systems Administrator
> IT Research Computing, University of South Florida
> 4202 E. Fowler Ave. ENB204
> Office Phone: +1 813 974-1467
> Organization URL: http://rc.usf.edu
>
>