Christoph Martin
2012-May-24 13:23 UTC
[Samba] Could not find node to take over public address
Hi, we run ctdb with samba on SLES11. It was running for some month ok but after an update of the system and ctdb it fails to run. I tried to setup a new ctdb setup on two other nodes and it still fails with the same error. After startup the status is:> ctdb status > Number of nodes:2 > pnn:0 10.94.43.7 DISABLED > pnn:1 10.94.43.8 DISABLED (THIS NODE) > Generation:1641386327 > Size:2 > hash:0 lmaster:0 > hash:1 lmaster:1 > Recovery mode:NORMAL (0) > Recovery master:0I could not find out why the nodes are both disabled. So then I issue # ctdb enable on each node. After that ctdb will not be able to assign the public ip addresses. On the first node I get repeatedly:> 2012/05/24 14:32:09.408217 [ 6773]: Forced running of eventscripts with argument > s ipreallocated > 2012/05/24 14:32:09.442628 [recoverd: 6800]: Public address '10.94.43.67' is not > assigned and we could serve this ip > 2012/05/24 14:32:09.442643 [recoverd: 6800]: Public address '10.94.43.66' is not > assigned and we could serve this ip > 2012/05/24 14:32:09.442648 [recoverd: 6800]: Public address '10.94.43.65' is not > assigned and we could serve this ip > 2012/05/24 14:32:09.442653 [recoverd: 6800]: Public address '10.94.43.64' is not > assigned and we could serve this ip > 2012/05/24 14:32:09.442657 [recoverd: 6800]: Trigger takeoverrunOn the other node:> 2012/05/24 14:32:26.458731 [recoverd: 2970]: Deterministic IPs enabled. Resettin > g all ip allocations > 2012/05/24 14:32:26.458779 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could n > ot find node to take over public address '10.94.43.67' > 2012/05/24 14:32:26.458798 [recoverd: 2970]: Failed to find node to cover ip 10. > 94.43.67 > 2012/05/24 14:32:26.458814 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could n > ot find node to take over public address '10.94.43.66' > 2012/05/24 14:32:26.458830 [recoverd: 2970]: Failed to find node to cover ip 10. > 94.43.66 > 2012/05/24 14:32:26.458845 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could n > ot find node to take over public address '10.94.43.65' > 2012/05/24 14:32:26.458860 [recoverd: 2970]: Failed to find node to cover ip 10. > 94.43.65 > 2012/05/24 14:32:26.458875 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could n > ot find node to take over public address '10.94.43.64' > 2012/05/24 14:32:26.458890 [recoverd: 2970]: Failed to find node to cover ip 10. > 94.43.64 > 2012/05/24 14:32:26.459388 [ 2943]: Forced running of eventscripts with argument > s ipreallocated > 2012/05/24 14:32:26.491779 [recoverd: 2970]: Public address '10.94.43.67' is not > assigned and we could serve this ip > 2012/05/24 14:32:26.491817 [recoverd: 2970]: Public address '10.94.43.66' is not > assigned and we could serve this ip > 2012/05/24 14:32:26.491836 [recoverd: 2970]: Public address '10.94.43.65' is not > assigned and we could serve this ip > 2012/05/24 14:32:26.491852 [recoverd: 2970]: Public address '10.94.43.64' is not > assigned and we could serve this ip > 2012/05/24 14:32:26.491865 [recoverd: 2970]: Trigger takeoverrunDo you have any idea what it could be? Config and logs are attached. CTDB version: 1.2.29-40.1 Any other information you need? Christoph -- ===========================================================================Christoph Martin, Zentrum f?r Datenverarbeitung, Uni-Mainz, Germany Instant-Messaging: Jabber: martin at uni-mainz.de (Siehe http://www.zdv.uni-mainz.de/4010.php) -------------- next part -------------- ### Options to ctdbd. This is read by /etc/init.d/ctdb ## Path: Network/Ctdb ## Description: Ctdb location of the shared lock file ## Type: string ## Default: "" # you must specify the location of a shared lock file across all the # nodes. This must be on shared storage # there is no default CTDB_RECOVERY_LOCK="/gpfs/hafs/ctdb/lock" ## Description: Ctdb public network interface ## Type: string ## Default: "" # when doing IP takeover you also may specify what network interface # to use by default for the public addresses. Otherwise you must # specify an interface on each line of the public addresses file # there is no default CTDB_PUBLIC_INTERFACE=eth0 ## Description: Location of the file with the public IP addresses ## Type: string ## Default: /etc/ctdb/public_addresses # Should ctdb do IP takeover? If it should, then specify a file # containing the list of public IP addresses that ctdb will manage # Note that these IPs must be different from those in $NODES above # there is no default. # The syntax is one line per public address of the form : # <ipaddress>/<netmask> <interface> # Example: 10.1.1.1/24 eth0 CTDB_PUBLIC_ADDRESSES=/etc/ctdb/public_addresses ## Description: Use single LVS public IP? ## Type: ip ## Default: "" # Should CTDB present the cluster using a single public ip address to clients # and multiplex clients across all CONNECTED nodes ? # This is based on LVS # When this is enabled, the entire cluster will present one single ip address # which clients will connect to. CTDB_LVS_PUBLIC_IP ## Description: Ctdb manages to start and stop Samba? ## Type: yesno ## Default: yes # should ctdb manage starting/stopping the Samba service for you? # default is to not manage Samba CTDB_MANAGES_SAMBA=yes ## Description: Skip Samba share checks? # If there are very many shares it may not be feasible to check that all # of them are available during each monitoring interval. # In that case this check can be disabled ## Type: yesno ## Default: yes CTDB_SAMBA_SKIP_SHARE_CHECK=yes ## Description: Skip NFS share checks? # If there are very many shares it may not be feasible to check that all # of them are available during each monitoring interval. # In that case this check can be disabled ## Type: yesno ## Default: yes CTDB_NFS_SKIP_SHARE_CHECK=yes ### Must we remove the leading ^# and which default to set when we're happy ### with ctdb's default? ## Description: Manage winbind? ## Type: yesno ## Default: yes # should ctdb manage starting/stopping Winbind service? # if left comented out then it will be autodetected based on smb.conf CTDB_MANAGES_WINBIND=yes ## Description: Manage vsftpd? ## Type: yesno ## Default: yes # should ctdb manage starting/stopping the VSFTPD service CTDB_MANAGES_VSFTPD=no ## Description: Manage iSCSI? ## Type: yesno ## Default: yes # should ctdb manage starting/stopping the ISCSI service CTDB_MANAGES_ISCSI=no ## Description: Manage NFS? ## Type: yesno ## Default: yes # should ctdb manage starting/stopping the NFS service CTDB_MANAGES_NFS=no ## Description: Manage Apache? ## Type: yesno ## Default: yes # should ctdb manage starting/stopping the Apache web server httpd? CTDB_MANAGES_HTTPD=no ## Description: Init script style ## Type: string ## Default: "" # The init style (redhat/suse/ubuntu...) is usually auto-detected. # The names of init scripts of services managed by CTDB are set # based on the detected init style. You can override the init style # auto-detection here to explicitly use a scheme. This might be # useful when you have installed a packages (for instance samba # packages) with a different init script layout. # There is no default. CTDB_INIT_STYLE ## Description: Samba smb services init script # The following is a smb specific Samba init script / service that you # can override from auto-detection. ## Type: string ## Default: smb CTDB_SERVICE_SMB=smb ## Description: Samba nmb services init script # The following is a nmb specific Samba init script / service that you # can override from auto-detection. ## Type: string ## Default: nmb CTDB_SERVICE_NMB=nmb ## Description: Samba winbind services init script # The following is a winbind specific Samba init script / service that you # can override from auto-detection. ## Type: string ## Default: winbind CTDB_SERVICE_WINBIND=winbind # you may wish to raise the file descriptor limit for ctdb # use a ulimit command here. ctdb needs one file descriptor per # connected client (ie. one per connected client in Samba) # ulimit -n 10000 ## Description: This file enumerates all nodes of the cluster ## Type: string ## Default: /etc/ctdb/nodes # the NODES file must be specified or ctdb won't start # it should contain a list of IPs that ctdb will use # it must be exactly the same on all cluster nodes # defaults to /etc/ctdb/nodes CTDB_NODES=/etc/ctdb/nodes ## Description: Script used to notify about node health changes ## Type: string ## Default: /etc/ctdb/notify.sh # a script to run when node health changes CTDB_NOTIFY_SCRIPT=/etc/ctdb/notify.sh ## Description: Database location ## Type: string ## Default: /var/lib/ctdb # the directory to put the local ctdb database files in # defaults to /var/lib/ctdb CTDB_DBDIR=/var/lib/ctdb ## Description: Persistent database location ## Type: string ## Default: /var/lib/ctdb/persistent # the directory to put the local persistent ctdb database files in # defaults to /var/lib/ctdb/persistent CTDB_DBDIR_PERSISTENT=/var/lib/ctdb/persistent ## Description: Event script directory location ## Type: string ## Default: /etc/ctdb/events.d # the directory where service specific event scripts are stored # defaults to /etc/ctdb/events.d CTDB_EVENT_SCRIPT_DIR=/etc/ctdb/events.d ## Description: Socket location ## Type: string ## Default: /var/lib/ctdb/ctdb.socket # the location of the local ctdb socket # defaults to /var/lib/ctdb/ctdb.socket CTDB_SOCKET=/var/lib/ctdb/ctdb.socket ## Description: Type of transport ## Type: string ## Default: tcp # what transport to use. Only tcp is currently supported # defaults to tcp CTDB_TRANSPORT="tcp" ## Description: Minimal amount of free memory ## Type: integer ## Default: 100 # When set, this variable makes ctdb monitor the amount of free memory # in the system (the second number in the buffers/cache output from free -m). # If the amount of free memory drops below this treshold the node will become # unhealthy and ctdb and all managed services will be shutdown. # Once this occurs, the administrator needs to find the reason for the OOM # situation, rectify it and restart ctdb with "service ctdb start" # The unit is MByte CTDB_MONITOR_FREE_MEMORY=100 ## Description: Start ctdb disabled? ## Type: yesno ## Default: yes # When set to yes, the CTDB node will start in DISABLED mode and not host # any public ip addresses. The administrator needs to explicitely enable # the node with "ctdb enable" CTDB_START_AS_DISABLED="yes" ## Description: RECMASTER capability. # By default all nodes are capable of both being LMASTER for records and # also for taking the RECMASTER role and perform recovery. # These parameters can be used to disable these two roles on a node. # Note: If there are NO available nodes left in a cluster that can perform # the RECMASTER role, the cluster will not be able to recover from a failure # and will remain in RECOVERY mode until an RECMASTER capable node becomes # available. Same for LMASTER. # These parameters are useful for scenarios where you have one "remote" node # in a cluster and you do not want the remote node to be fully participating # in the cluster and slow things down. # For that case, set both roles to "no" for the remote node on the remote site # but leave the roles default to "yes" on the primary nodes in the central # datacentre. ## Type: yesno ## Default: yes CTDB_CAPABILITY_RECMASTER=yes ## Description: LMASTER capability. # By default all nodes are capable of both being LMASTER for records and # also for taking the RECMASTER role and perform recovery. # These parameters can be used to disable these two roles on a node. # Note: If there are NO available nodes left in a cluster that can perform # the RECMASTER role, the cluster will not be able to recover from a failure # and will remain in RECOVERY mode until an RECMASTER capable node becomes # available. Same for LMASTER. # These parameters are useful for scenarios where you have one "remote" node # in a cluster and you do not want the remote node to be fully participating # in the cluster and slow things down. # For that case, set both roles to "no" for the remote node on the remote site # but leave the roles default to "yes" on the primary nodes in the central # datacentre. ## Type: yesno ## Default: yes CTDB_CAPABILITY_LMASTER=yes # NAT-GW configuration # Some services running on nthe CTDB node may need to originate traffic to # remote servers before the node is assigned any IP addresses, # This is problematic since before the node has public addresses the node might # not be able to route traffic to the public networks. # One solution is to have static public addresses assigned with routing # in addition to the public address interfaces, thus guaranteeing that # a node always can route traffic to the external network. # This is the most simple solution but it uses up a large number of # additional ip addresses. # # A more complex solution is NAT-GW. # In this mode we only need one additional ip address for the cluster from # the exsternal public network. # One of the nodes in the cluster is elected to be hosting this ip address # so it can reach the external services. This node is also configured # to use NAT MASQUERADING for all traffic from the internal private network # to the external network. This node is the NAT-GW node. # # All other nodes are set up with a default rote with a metric of 10 to point # to the nat-gw node. # # The effect of this is that only when a node does not have a public address # and thus no proper routes to the external world it will instead # route all packets through the nat-gw node. # ## Description: NAT gateway public IP ## Type: ip ## Default: "" NATGW_PUBLIC_IP## Description: NAT gateway public interface ## Type: string ## Default: "" NATGW_PUBLIC_IFACE## Description: NAT gateway default gateway ## Type: ip ## Default: "" NATGW_DEFAULT_GATEWAY## Description: NAT gateway private interface ## Type: string ## Default: "" NATGW_PRIVATE_IFACE## Description: NAT gateway network ## Type: ip ## Default: "" NATGW_PRIVATE_NETWORK## Description: NAT gateway nodes ## Type: string ## Default: /etc/ctdb/natgw_nodes # NATGW_NODES is the list of nodes that belong to this natgw group. # You can have multiple natgw groups in one cluster but each node # can only belong to one single natgw group. NATGW_NODES=/etc/ctdb/natgw_nodes ## Description: Ctdb log file location ## Type: string ## Default: /var/log/ctdb/log.ctdb # where to log messages # the default is /var/log/ctdb/log.ctdb CTDB_LOGFILE=/var/log/ctdb/log.ctdb ## Description: Ctdb debug level ## Type: integer(0:10) ## Default: 2 # what debug level to run at. Higher means more verbose # the default is 2 CTDB_DEBUGLEVEL=2 ## Description: Ctdb any other option ## Type: string ## Default: "" # any other options you might want. Run ctdbd --help for a list CTDB_OPTIONS ## Description: Samba check ports? ## Type: integer ## Default: # specify which ports we should check that there is a daemon listening to # by default we use testparm and look in smb.conf to figure out. # CTDB_SAMBA_CHECK_PORTS="445" -------------- next part -------------- # smb.conf is the main Samba configuration file. You find a full commented # version at /usr/share/doc/packages/samba/examples/smb.conf.SUSE if the # samba-doc package is installed. # Date: 2012-04-22 [global] workgroup = WORKGROUP passdb backend = tdbsam printing = cups printcap name = cups printcap cache time = 750 cups options = raw map to guest = Bad User include = /etc/samba/dhcp.conf logon path = \\%L\profiles\.msprofile logon home = \\%L\%U\.9xprofile logon drive = P: usershare allow guests = Yes clustering = yes netbios name = gpfssam idmap backend = tdb2 cluster addresses = 10.94.43.64 10.94.43.65 10.94.43.66 10.94.43.67 [homes] comment = Home Directories valid users = %S, %D%w%S browseable = No read only = No inherit acls = Yes [profiles] comment = Network Profiles Service path = %H read only = No store dos attributes = Yes create mask = 0600 directory mask = 0700 [users] comment = All users path = /home read only = No inherit acls = Yes veto files = /aquota.user/groups/shares/ [groups] comment = All groups path = /home/groups read only = No inherit acls = Yes [printers] comment = All Printers path = /var/tmp printable = Yes create mask = 0600 browseable = No [print$] comment = Printer Drivers path = /var/lib/samba/drivers write list = @ntadmin root force group = ntadmin create mask = 0664 directory mask = 0775 -------------- next part -------------- 10.94.43.7 10.94.43.8 -------------- next part -------------- 10.94.43.64/24 eth0 10.94.43.65/24 eth0 10.94.43.66/24 eth0 10.94.43.67/24 eth0 -------------- next part -------------- 2012/05/24 14:35:15.022507 [recoverd: 2970]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:15.022512 [recoverd: 2970]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:15.022516 [recoverd: 2970]: Trigger takeoverrun 2012/05/24 14:35:15.990887 [recoverd: 2970]: Deterministic IPs enabled. Resetting all ip allocations 2012/05/24 14:35:15.990961 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.67' 2012/05/24 14:35:15.990982 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.67 2012/05/24 14:35:15.991000 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.66' 2012/05/24 14:35:15.991017 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.66 2012/05/24 14:35:15.991033 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.65' 2012/05/24 14:35:15.991049 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.65 2012/05/24 14:35:15.991064 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.64' 2012/05/24 14:35:15.991080 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.64 2012/05/24 14:35:15.991719 [ 2943]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:16.062196 [recoverd: 2970]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:16.062252 [recoverd: 2970]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:16.062272 [recoverd: 2970]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:16.062291 [recoverd: 2970]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:16.062304 [recoverd: 2970]: Trigger takeoverrun 2012/05/24 14:35:16.990439 [recoverd: 2970]: Deterministic IPs enabled. Resetting all ip allocations 2012/05/24 14:35:16.990476 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.67' 2012/05/24 14:35:16.990482 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.67 2012/05/24 14:35:16.990487 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.66' 2012/05/24 14:35:16.990492 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.66 2012/05/24 14:35:16.990496 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.65' 2012/05/24 14:35:16.990501 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.65 2012/05/24 14:35:16.990505 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.64' 2012/05/24 14:35:16.990510 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.64 2012/05/24 14:35:16.991147 [ 2943]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:17.047971 [recoverd: 2970]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:17.047995 [recoverd: 2970]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:17.048001 [recoverd: 2970]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:17.048006 [recoverd: 2970]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:17.048011 [recoverd: 2970]: Trigger takeoverrun 2012/05/24 14:35:17.994842 [recoverd: 2970]: Deterministic IPs enabled. Resetting all ip allocations 2012/05/24 14:35:17.994900 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.67' 2012/05/24 14:35:17.994919 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.67 2012/05/24 14:35:17.994936 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.66' 2012/05/24 14:35:17.994970 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.66 2012/05/24 14:35:17.994987 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.65' 2012/05/24 14:35:17.995003 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.65 2012/05/24 14:35:17.995018 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.64' 2012/05/24 14:35:17.995034 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.64 2012/05/24 14:35:17.995654 [ 2943]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:18.032405 [recoverd: 2970]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:18.032419 [recoverd: 2970]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:18.032425 [recoverd: 2970]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:18.032430 [recoverd: 2970]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:18.032434 [recoverd: 2970]: Trigger takeoverrun 2012/05/24 14:35:18.998918 [recoverd: 2970]: Deterministic IPs enabled. Resetting all ip allocations 2012/05/24 14:35:18.998972 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.67' 2012/05/24 14:35:18.998991 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.67 2012/05/24 14:35:18.999008 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.66' 2012/05/24 14:35:18.999024 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.66 2012/05/24 14:35:18.999039 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.65' 2012/05/24 14:35:18.999054 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.65 2012/05/24 14:35:18.999069 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.64' 2012/05/24 14:35:18.999084 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.64 2012/05/24 14:35:18.999676 [ 2943]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:19.039969 [recoverd: 2970]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:19.039983 [recoverd: 2970]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:19.039989 [recoverd: 2970]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:19.039994 [recoverd: 2970]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:19.039998 [recoverd: 2970]: Trigger takeoverrun 2012/05/24 14:35:20.002557 [recoverd: 2970]: Deterministic IPs enabled. Resetting all ip allocations 2012/05/24 14:35:20.002606 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.67' 2012/05/24 14:35:20.002625 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.67 2012/05/24 14:35:20.002642 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.66' 2012/05/24 14:35:20.002658 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.66 2012/05/24 14:35:20.002673 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.65' 2012/05/24 14:35:20.002689 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.65 2012/05/24 14:35:20.002703 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.64' 2012/05/24 14:35:20.002719 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.64 2012/05/24 14:35:20.003334 [ 2943]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:20.003385 [ 2943]: server/eventscript.c:575 Sending SIGTERM to child pid:14448 2012/05/24 14:35:20.037809 [recoverd: 2970]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:20.037833 [recoverd: 2970]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:20.037839 [recoverd: 2970]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:20.037845 [recoverd: 2970]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:20.037848 [recoverd: 2970]: Trigger takeoverrun 2012/05/24 14:35:21.006801 [recoverd: 2970]: Deterministic IPs enabled. Resetting all ip allocations 2012/05/24 14:35:21.006850 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.67' 2012/05/24 14:35:21.006869 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.67 2012/05/24 14:35:21.006885 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.66' 2012/05/24 14:35:21.006901 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.66 2012/05/24 14:35:21.006916 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.65' 2012/05/24 14:35:21.006932 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.65 2012/05/24 14:35:21.006946 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.64' 2012/05/24 14:35:21.006962 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.64 2012/05/24 14:35:21.007559 [ 2943]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:21.046646 [recoverd: 2970]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:21.046660 [recoverd: 2970]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:21.046666 [recoverd: 2970]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:21.046671 [recoverd: 2970]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:21.046675 [recoverd: 2970]: Trigger takeoverrun 2012/05/24 14:35:22.010923 [recoverd: 2970]: Deterministic IPs enabled. Resetting all ip allocations 2012/05/24 14:35:22.010971 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.67' 2012/05/24 14:35:22.010989 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.67 2012/05/24 14:35:22.011005 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.66' 2012/05/24 14:35:22.011022 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.66 2012/05/24 14:35:22.011036 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.65' 2012/05/24 14:35:22.011052 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.65 2012/05/24 14:35:22.011066 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.64' 2012/05/24 14:35:22.011081 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.64 2012/05/24 14:35:22.011679 [ 2943]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:22.051636 [recoverd: 2970]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:22.051650 [recoverd: 2970]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:22.051656 [recoverd: 2970]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:22.051662 [recoverd: 2970]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:22.051666 [recoverd: 2970]: Trigger takeoverrun 2012/05/24 14:35:23.014512 [recoverd: 2970]: Deterministic IPs enabled. Resetting all ip allocations 2012/05/24 14:35:23.014562 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.67' 2012/05/24 14:35:23.014581 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.67 2012/05/24 14:35:23.014598 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.66' 2012/05/24 14:35:23.014633 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.66 2012/05/24 14:35:23.014650 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.65' 2012/05/24 14:35:23.014666 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.65 2012/05/24 14:35:23.014680 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.64' 2012/05/24 14:35:23.014695 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.64 2012/05/24 14:35:23.015293 [ 2943]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:23.049736 [recoverd: 2970]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:23.049750 [recoverd: 2970]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:23.049756 [recoverd: 2970]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:23.049761 [recoverd: 2970]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:23.049765 [recoverd: 2970]: Trigger takeoverrun 2012/05/24 14:35:24.018272 [recoverd: 2970]: Deterministic IPs enabled. Resetting all ip allocations 2012/05/24 14:35:24.018320 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.67' 2012/05/24 14:35:24.018339 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.67 2012/05/24 14:35:24.018355 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.66' 2012/05/24 14:35:24.018371 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.66 2012/05/24 14:35:24.018386 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.65' 2012/05/24 14:35:24.018402 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.65 2012/05/24 14:35:24.018416 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.64' 2012/05/24 14:35:24.018432 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.64 2012/05/24 14:35:24.018970 [ 2943]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:24.058270 [recoverd: 2970]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:24.058294 [recoverd: 2970]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:24.058304 [recoverd: 2970]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:24.058313 [recoverd: 2970]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:24.058320 [recoverd: 2970]: Trigger takeoverrun 2012/05/24 14:35:25.018542 [recoverd: 2970]: Deterministic IPs enabled. Resetting all ip allocations 2012/05/24 14:35:25.018592 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.67' 2012/05/24 14:35:25.018612 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.67 2012/05/24 14:35:25.018628 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.66' 2012/05/24 14:35:25.018644 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.66 2012/05/24 14:35:25.018659 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.65' 2012/05/24 14:35:25.018675 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.65 2012/05/24 14:35:25.018689 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.64' 2012/05/24 14:35:25.018705 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.64 2012/05/24 14:35:25.019353 [ 2943]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:25.019411 [ 2943]: server/eventscript.c:575 Sending SIGTERM to child pid:14605 2012/05/24 14:35:25.054160 [recoverd: 2970]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:25.054203 [recoverd: 2970]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:25.054214 [recoverd: 2970]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:25.054224 [recoverd: 2970]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:25.054231 [recoverd: 2970]: Trigger takeoverrun 2012/05/24 14:35:26.021672 [recoverd: 2970]: Deterministic IPs enabled. Resetting all ip allocations 2012/05/24 14:35:26.021720 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.67' 2012/05/24 14:35:26.021739 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.67 2012/05/24 14:35:26.021755 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.66' 2012/05/24 14:35:26.021771 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.66 2012/05/24 14:35:26.021786 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.65' 2012/05/24 14:35:26.021802 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.65 2012/05/24 14:35:26.021817 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.64' 2012/05/24 14:35:26.021832 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.64 2012/05/24 14:35:26.022401 [ 2943]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:26.059966 [recoverd: 2970]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:26.059980 [recoverd: 2970]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:26.059986 [recoverd: 2970]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:26.059991 [recoverd: 2970]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:26.059995 [recoverd: 2970]: Trigger takeoverrun 2012/05/24 14:35:27.022465 [recoverd: 2970]: Deterministic IPs enabled. Resetting all ip allocations 2012/05/24 14:35:27.022513 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.67' 2012/05/24 14:35:27.022533 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.67 2012/05/24 14:35:27.022549 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.66' 2012/05/24 14:35:27.022565 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.66 2012/05/24 14:35:27.022580 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.65' 2012/05/24 14:35:27.022596 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.65 2012/05/24 14:35:27.022610 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.64' 2012/05/24 14:35:27.022625 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.64 2012/05/24 14:35:27.023195 [ 2943]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:27.075307 [recoverd: 2970]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:27.075330 [recoverd: 2970]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:27.075340 [recoverd: 2970]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:27.075349 [recoverd: 2970]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:27.075356 [recoverd: 2970]: Trigger takeoverrun 2012/05/24 14:35:28.022824 [recoverd: 2970]: Deterministic IPs enabled. Resetting all ip allocations 2012/05/24 14:35:28.022872 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.67' 2012/05/24 14:35:28.022891 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.67 2012/05/24 14:35:28.022907 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.66' 2012/05/24 14:35:28.022943 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.66 2012/05/24 14:35:28.022959 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.65' 2012/05/24 14:35:28.022975 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.65 2012/05/24 14:35:28.022990 [recoverd: 2970]: server/ctdb_takeover.c:1153 Could not find node to take over public address '10.94.43.64' 2012/05/24 14:35:28.023005 [recoverd: 2970]: Failed to find node to cover ip 10.94.43.64 2012/05/24 14:35:28.023544 [ 2943]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:28.052910 [recoverd: 2970]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:28.052924 [recoverd: 2970]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:28.052929 [recoverd: 2970]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:28.052935 [recoverd: 2970]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:28.052939 [recoverd: 2970]: Trigger takeoverrun -------------- next part -------------- 2012/05/24 14:34:44.912779 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:34:44.912783 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:34:45.892916 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:34:45.912515 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:34:45.912556 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:34:45.912574 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:34:45.912590 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:34:45.912602 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:34:46.896481 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:34:46.916817 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:34:46.916832 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:34:46.916837 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:34:46.916842 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:34:46.916846 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:34:47.900856 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:34:47.917003 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:34:47.917042 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:34:47.917059 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:34:47.917075 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:34:47.917087 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:34:48.908859 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:34:48.908937 [ 6773]: server/eventscript.c:575 Sending SIGTERM to child pid:11164 2012/05/24 14:34:48.920706 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:34:48.920738 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:34:48.920746 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:34:48.920753 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:34:48.920758 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:34:49.911979 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:34:49.921024 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:34:49.921064 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:34:49.921082 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:34:49.921099 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:34:49.921113 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:34:50.916419 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:34:50.925012 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:34:50.925052 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:34:50.925070 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:34:50.925087 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:34:50.925101 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:34:51.924964 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:34:51.928936 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:34:51.928976 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:34:51.928993 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:34:51.929009 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:34:51.929022 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:34:52.928387 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:34:52.932964 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:34:52.933004 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:34:52.933022 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:34:52.933039 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:34:52.933051 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:34:53.932554 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:34:53.932621 [ 6773]: server/eventscript.c:575 Sending SIGTERM to child pid:11561 2012/05/24 14:34:53.933557 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:34:53.933573 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:34:53.933579 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:34:53.933584 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:34:53.933588 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:34:54.936820 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:34:54.937933 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:34:54.937974 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:34:54.937992 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:34:54.938032 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:34:54.938046 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:34:55.940236 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:34:55.941557 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:34:55.941597 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:34:55.941616 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:34:55.941633 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:34:55.941647 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:34:56.944460 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:34:56.945554 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:34:56.945595 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:34:56.945613 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:34:56.945630 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:34:56.945643 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:34:57.948231 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:34:57.949557 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:34:57.949598 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:34:57.949617 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:34:57.949634 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:34:57.949647 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:34:58.952157 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:34:58.952189 [ 6773]: server/eventscript.c:575 Sending SIGTERM to child pid:11698 2012/05/24 14:34:58.952900 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:34:58.952941 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:34:58.952958 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:34:58.952975 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:34:58.952987 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:34:59.952683 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:34:59.953893 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:34:59.953942 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:34:59.953961 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:34:59.953979 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:34:59.953992 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:35:00.952785 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:00.952841 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:00.952859 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:00.952876 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:00.952889 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:35:00.955571 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:01.956262 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:01.957645 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:01.957692 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:01.957712 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:01.957729 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:01.957742 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:35:02.958073 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:02.958131 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:02.958148 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:02.958164 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:02.958177 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:35:02.960157 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:03.961471 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:03.961528 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:03.961548 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:03.961567 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:03.961580 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:35:03.964171 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:03.964249 [ 6773]: server/eventscript.c:575 Sending SIGTERM to child pid:11996 2012/05/24 14:35:04.961119 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:04.961173 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:04.961192 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:04.961210 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:04.961223 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:35:04.968407 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:05.965276 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:05.965332 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:05.965351 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:05.965368 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:05.965381 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:35:05.968328 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:06.969269 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:06.969323 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:06.969342 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:06.969359 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:06.969371 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:35:06.972142 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:07.968975 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:07.969033 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:07.969078 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:07.969098 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:07.969111 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:35:07.976430 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:08.973552 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:08.973608 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:08.973626 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:08.973643 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:08.973656 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:35:08.975813 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:08.975871 [ 6773]: server/eventscript.c:575 Sending SIGTERM to child pid:12340 2012/05/24 14:35:09.973204 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:09.973247 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:09.973266 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:09.973283 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:09.973295 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:35:09.975940 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:10.976874 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:10.976915 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:10.976933 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:10.976949 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:10.976962 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:35:10.979580 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:11.980742 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:11.981844 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:11.981885 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:11.981903 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:11.981920 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:11.981933 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:35:12.984791 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:12.985883 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:12.985924 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:12.985942 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:12.985959 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:12.985972 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:35:13.984456 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:13.984536 [ 6773]: server/eventscript.c:575 Sending SIGTERM to child pid:12492 2012/05/24 14:35:13.985650 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:13.985693 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:13.985731 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:13.985749 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:13.985763 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:35:14.988951 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:14.990053 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:14.990094 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:14.990112 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:14.990130 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:14.990142 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:35:15.992754 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:15.993842 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:15.993882 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:15.993900 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:15.993917 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:15.993929 [recoverd: 6800]: Trigger takeoverrun 2012/05/24 14:35:16.991380 [ 6773]: Forced running of eventscripts with arguments ipreallocated 2012/05/24 14:35:16.997013 [recoverd: 6800]: Public address '10.94.43.67' is not assigned and we could serve this ip 2012/05/24 14:35:16.997059 [recoverd: 6800]: Public address '10.94.43.66' is not assigned and we could serve this ip 2012/05/24 14:35:16.997078 [recoverd: 6800]: Public address '10.94.43.65' is not assigned and we could serve this ip 2012/05/24 14:35:16.997095 [recoverd: 6800]: Public address '10.94.43.64' is not assigned and we could serve this ip 2012/05/24 14:35:16.997107 [recoverd: 6800]: Trigger takeoverrun
Maybe Matching Threads
Wisdom of the Ancients
