Dmitry Sukhodoyev
2009-Aug-31 10:27 UTC
[Gluster-users] trying to launch 1.3.11 on FreeBSD 7.1-PRERELEASE
hi. i trying to launch glusterfs 1.3.11 on FreeBSD 7.1-PRERELEASE. i don't want to try 2.0.6 because AFR is not working on FreeBSD in 2.0. server config: === cut ==volume pos1 type storage/posix option directory /home/export/b1 end-volume volume pos2 type storage/posix option directory /home/export/b2 end-volume volume pos3 type storage/posix option directory /home/export/b3 end-volume volume pos4 type storage/posix option directory /home/export/b4 end-volume volume pl1 type features/posix-locks option mandatory-locks on subvolumes pos1 end-volume volume pl2 type features/posix-locks option mandatory-locks on subvolumes pos2 end-volume volume pl3 type features/posix-locks option mandatory-locks on subvolumes pos3 end-volume volume pl4 type features/posix-locks option mandatory-locks on subvolumes pos4 end-volume volume b1 type performance/io-threads option thread-count 8 subvolumes pl1 end-volume volume b2 type performance/io-threads option thread-count 8 subvolumes pl2 end-volume volume b3 type performance/io-threads option thread-count 8 subvolumes pl3 end-volume volume b4 type performance/io-threads option thread-count 8 subvolumes pl4 end-volume volume posn1 type storage/posix option directory /home/export/bn1 end-volume volume posn2 type storage/posix option directory /home/export/bn2 end-volume volume pln1 type features/posix-locks option mandatory-locks on subvolumes posn1 end-volume volume pln2 type features/posix-locks option mandatory-locks on subvolumes posn2 end-volume volume bn1 type performance/io-threads option thread-count 8 subvolumes pln1 end-volume volume bn2 type performance/io-threads option thread-count 8 subvolumes pln2 end-volume volume server type protocol/server option transport-type tcp/server option auth.ip.b1.allow 10.72.0.* option auth.ip.b2.allow 10.72.0.* option auth.ip.b3.allow 10.72.0.* option auth.ip.b4.allow 10.72.0.* option auth.ip.bn1.allow 10.72.0.* option auth.ip.bn2.allow 10.72.0.* subvolumes b1 b2 b3 b4 bn1 bn2 end-volume === cut == client config: === cut ==volume b1 type protocol/client option transport-type tcp/client option remote-host 10.72.0.119 option remote-subvolume b1 end-volume #volume bwh1 # type performance/write-behind # option window-size 1MB # subvolumes b1 #end-volume #volume bc1 # type performance/io-cache # option cache-size 10MB # subvolumes bwh1 #end-volume === cut == server launcher: === cut ==#!/bin/sh /usr/local/gluster1/sbin/glusterfsd \ -N -L DEBUG \ -l /var/log/glusterfs-server.log \ -f /home/raven/temp/gluster/1/etc/glusterfs-server.vol === cut == client launcher: === cut ==#!/bin/sh /usr/local/gluster1/sbin/glusterfs \ -N -L DEBUG \ -l /var/log/glusterfs-client.log \ -f /home/raven/temp/gluster/1/etc/glusterfs-client.vol \ -n b1 \ /mnt === cut == server log: === cut ==2009-08-31 16:19:30 E [protocol.c:271:gf_block_unserialize_transport] server: EOF from peer (10.72.0.119:1023) 2009-08-31 16:19:30 D [tcp.c:87:tcp_disconnect] server: connection disconnected 2009-08-31 16:19:30 D [server-protocol.c:6269:server_protocol_cleanup] server: cleaned up transport state for client 10.72.0.119:1023 2009-08-31 16:19:30 D [tcp-server.c:257:gf_transport_fini] server: destroying transport object for 10.72.0.119:1023 (fd=5) 2009-08-31 16:20:10 D [glusterfs.c:167:get_spec_fp] glusterfs: loading spec from /home/raven/temp/gluster/1/etc/glusterfs-server.vol 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pos1' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/storage/posix.so 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:pos1:storage/posix 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:pos1:directory:/home/export/b1 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pos1 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pos2' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/storage/posix.so 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:pos2:storage/posix 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:pos2:directory:/home/export/b2 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pos2 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pos3' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/storage/posix.so 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:pos3:storage/posix 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:pos3:directory:/home/export/b3 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pos3 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pos4' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/storage/posix.so 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:pos4:storage/posix 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:pos4:directory:/home/export/b4 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pos4 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pl1' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/features/posix-locks.so 2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: dlsym(notify) on Undefined symbol "notify" -- neglecting 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:pl1:features/posix-locks 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:pl1:mandatory-locks:on 2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:pl1->pos1 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pl1 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pl2' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/features/posix-locks.so 2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: dlsym(notify) on Undefined symbol "notify" -- neglecting 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:pl2:features/posix-locks 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:pl2:mandatory-locks:on 2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:pl2->pos2 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pl2 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pl3' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/features/posix-locks.so 2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: dlsym(notify) on Undefined symbol "notify" -- neglecting 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:pl3:features/posix-locks 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:pl3:mandatory-locks:on 2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:pl3->pos3 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pl3 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pl4' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/features/posix-locks.so 2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: dlsym(notify) on Undefined symbol "notify" -- neglecting 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:pl4:features/posix-locks 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:pl4:mandatory-locks:on 2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:pl4->pos4 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pl4 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'b1' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/performance/io-threads.so 2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: dlsym(notify) on Undefined symbol "notify" -- neglecting 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:b1:performance/io-threads 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:b1:thread-count:8 2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:b1->pl1 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:b1 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'b2' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/performance/io-threads.so 2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: dlsym(notify) on Undefined symbol "notify" -- neglecting 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:b2:performance/io-threads 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:b2:thread-count:8 2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:b2->pl2 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:b2 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'b3' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/performance/io-threads.so 2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: dlsym(notify) on Undefined symbol "notify" -- neglecting 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:b3:performance/io-threads 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:b3:thread-count:8 2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:b3->pl3 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:b3 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'b4' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/performance/io-threads.so 2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: dlsym(notify) on Undefined symbol "notify" -- neglecting 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:b4:performance/io-threads 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:b4:thread-count:8 2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:b4->pl4 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:b4 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'posn1' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/storage/posix.so 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:posn1:storage/posix 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:posn1:directory:/home/export/bn1 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:posn1 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'posn2' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/storage/posix.so 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:posn2:storage/posix 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:posn2:directory:/home/export/bn2 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:posn2 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pln1' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/features/posix-locks.so 2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: dlsym(notify) on Undefined symbol "notify" -- neglecting 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:pln1:features/posix-locks 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:pln1:mandatory-locks:on 2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:pln1->posn1 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pln1 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pln2' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/features/posix-locks.so 2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: dlsym(notify) on Undefined symbol "notify" -- neglecting 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:pln2:features/posix-locks 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:pln2:mandatory-locks:on 2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:pln2->posn2 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pln2 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'bn1' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/performance/io-threads.so 2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: dlsym(notify) on Undefined symbol "notify" -- neglecting 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:bn1:performance/io-threads 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:bn1:thread-count:8 2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:bn1->pln1 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:bn1 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'bn2' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/performance/io-threads.so 2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: dlsym(notify) on Undefined symbol "notify" -- neglecting 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:bn2:performance/io-threads 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:bn2:thread-count:8 2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:bn2->pln2 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:bn2 2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'server' 2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/protocol/server.so 2009-08-31 16:20:10 D [spec.y:127:section_type] parser: Type:server:protocol/server 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:server:transport-type:tcp/server 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:server:auth.ip.b1.allow:10.72.0.* 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:server:auth.ip.b2.allow:10.72.0.* 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:server:auth.ip.b3.allow:10.72.0.* 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:server:auth.ip.b4.allow:10.72.0.* 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:server:auth.ip.bn1.allow:10.72.0.* 2009-08-31 16:20:10 D [spec.y:141:section_option] parser: Option:server:auth.ip.bn2.allow:10.72.0.* 2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:server->b1 2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:server->b2 2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:server->b3 2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:server->b4 2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:server->bn1 2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:server->bn2 2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:server 2009-08-31 16:20:10 D [io-threads.c:1166:init] io-threads: Using conf->thread_count = 8 2009-08-31 16:20:10 D [io-threads.c:1166:init] io-threads: Using conf->thread_count = 8 2009-08-31 16:20:10 D [io-threads.c:1166:init] io-threads: Using conf->thread_count = 8 2009-08-31 16:20:10 D [io-threads.c:1166:init] io-threads: Using conf->thread_count = 8 2009-08-31 16:20:10 D [io-threads.c:1166:init] io-threads: Using conf->thread_count = 8 2009-08-31 16:20:10 D [io-threads.c:1166:init] io-threads: Using conf->thread_count = 8 2009-08-31 16:20:10 D [server-protocol.c:6309:init] server: protocol/server xlator loaded 2009-08-31 16:20:10 D [transport.c:80:transport_load] transport: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/transport/tcp/server.so 2009-08-31 16:20:10 D [server-protocol.c:6350:init] server: defaulting limits.transaction-size to 4194304 === cut = client log: === cut ==2009-08-31 16:21:56 D [glusterfs.c:167:get_spec_fp] glusterfs: loading spec from /home/raven/temp/gluster/1/etc/glusterfs-client.vol 2009-08-31 16:21:56 D [spec.y:107:new_section] parser: New node for 'b1' 2009-08-31 16:21:56 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/protocol/client.so 2009-08-31 16:21:56 D [spec.y:127:section_type] parser: Type:b1:protocol/client 2009-08-31 16:21:56 D [spec.y:141:section_option] parser: Option:b1:transport-type:tcp/client 2009-08-31 16:21:56 D [spec.y:141:section_option] parser: Option:b1:remote-host:10.72.0.119 2009-08-31 16:21:56 D [spec.y:141:section_option] parser: Option:b1:remote-subvolume:b1 2009-08-31 16:21:56 D [spec.y:209:section_end] parser: end:b1 2009-08-31 16:21:56 D [client-protocol.c:5013:init] b1: defaulting transport-timeout to 42 2009-08-31 16:21:56 D [transport.c:80:transport_load] transport: attempt to load file /usr/local/gluster1/lib/glusterfs/1.3.11/transport/tcp/client.so 2009-08-31 16:21:56 D [client-protocol.c:5040:init] b1: defaulting limits.transaction-size to 268435456 2009-08-31 16:21:56 D [client-protocol.c:5340:notify] b1: got GF_EVENT_PARENT_UP, attempting connect on transport 2009-08-31 16:21:56 D [client-protocol.c:4757:client_protocol_reconnect] b1: attempting reconnect 2009-08-31 16:21:56 D [tcp-client.c:77:tcp_connect] b1: socket fd = 4 2009-08-31 16:21:56 D [tcp-client.c:107:tcp_connect] b1: finalized on port `1022' 2009-08-31 16:21:56 D [tcp-client.c:128:tcp_connect] b1: defaulting remote-port to 6996 2009-08-31 16:21:56 D [common-utils.c:179:gf_resolve_ip] resolver: DNS cache not present, freshly probing hostname: 10.72.0.119 2009-08-31 16:21:56 D [common-utils.c:204:gf_resolve_ip] resolver: returning IP:10.72.0.119[0] for hostname: 10.72.0.119 2009-08-31 16:21:56 D [common-utils.c:212:gf_resolve_ip] resolver: flushing DNS cache 2009-08-31 16:21:56 D [tcp-client.c:161:tcp_connect] b1: connect on 4 in progress (non-blocking) 2009-08-31 16:21:56 D [tcp-client.c:205:tcp_connect] b1: connection on 4 success 2009-08-31 16:21:56 D [client-protocol.c:5362:notify] b1: got GF_EVENT_CHILD_UP 2009-08-31 16:21:56 D [client-protocol.c:5103:client_protocol_handshake_reply] b1: reply frame has callid: 424242 2009-08-31 16:21:56 D [client-protocol.c:5137:client_protocol_handshake_reply] b1: SETVOLUME on remote-host succeeded 2009-08-31 16:21:57 D [client-protocol.c:4763:client_protocol_reconnect] b1: breaking reconnect chain === cut == and nothing mounted to /mnt. no references about fuse in client log. what is wrong? in 2.0.6 same actions make success mounting, but unsuccess to work (crash in threads..).
Vijay Bellur
2009-Aug-31 10:35 UTC
[Gluster-users] trying to launch 1.3.11 on FreeBSD 7.1-PRERELEASE
> > and nothing mounted to /mnt. no references about fuse in client log. > what is wrong? in 2.0.6 same actions make success mounting, but > unsuccess to work (crash in threads..).Can you please post the core/log when the crash happens in 2.0.6? I feel it would be better to have 2.0.6 or a release in 2.0 working rather than spend cycles on 1.3.11. Thanks, Vijay