Any thoughts on this?
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: Failed update
of IP 10.11.24.112 from interface __none__ to eth1
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]:
==============================================================
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: INTERNAL ERROR:
Signal 11 in pid 31307 (4.12.3)
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: If you are
running a recent Samba version, and if you think this problem is not yet
fixed in the latest versions, please consider reporting this bug, see
https://wiki.samba.org/index.php/Bug_Reporting
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]:
==============================================================
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]:
smb_panic_default: PANIC (pid 31307): internal error
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: BACKTRACE: 20
stack frames:
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #0
/lib64/libsamba-util.so.0(log_stack_trace+0x34) [0x7facf0104264]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #1
/lib64/libsamba-util.so.0(smb_panic+0x4f) [0x7facf010437f]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #2
/lib64/libsamba-util.so.0(+0x185c1) [0x7facf01045c1]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #3
/lib64/libpthread.so.0(+0x12b20) [0x7facef70bb20]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #4
/usr/sbin/ctdbd(+0x58329) [0x55f7f69f4329]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #5
/usr/sbin/ctdbd(+0x564bb) [0x55f7f69f24bb]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #6
/usr/sbin/ctdbd(+0x56572) [0x55f7f69f2572]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #7
/usr/sbin/ctdbd(+0x563a2) [0x55f7f69f23a2]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #8
/usr/sbin/ctdbd(+0x23058) [0x55f7f69bf058]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #9
/usr/sbin/ctdbd(+0x231e2) [0x55f7f69bf1e2]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #10
/lib64/libtevent.so.0(tevent_common_invoke_fd_handler+0x83) [0x7facef4ec533]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #11
/lib64/libtevent.so.0(+0xdacf) [0x7facef4f2acf]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #12
/lib64/libtevent.so.0(+0xbadb) [0x7facef4f0adb]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #13
/lib64/libtevent.so.0(_tevent_loop_once+0x95) [0x7facef4ebc05]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #14
/lib64/libtevent.so.0(tevent_common_loop_wait+0x1b) [0x7facef4ebeab]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #15
/lib64/libtevent.so.0(+0xba6b) [0x7facef4f0a6b]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #16
/usr/sbin/ctdbd(ctdb_start_daemon+0x5ce) [0x55f7f69d38de]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #17
/usr/sbin/ctdbd(main+0x4fa) [0x55f7f69b04ea]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #18
/lib64/libc.so.6(__libc_start_main+0xf3) [0x7facef1457b3]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdbd[31307]: #19
/usr/sbin/ctdbd(_start+0x2e) [0x55f7f69b0bae]
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]:
10.interface: ERROR: Unable to determine interface for IP 10.11.24.111
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]: updateip
event failed
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 systemd[1]: Created slice
system-systemd\x2dcoredump.slice.
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 systemd[1]: Started Process
Core Dump (PID 31919/UID 0).
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]:
10.interface: ERROR: Unable to determine interface for IP 10.11.24.110
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]: updateip
event failed
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]:
10.interface: ERROR: Unable to determine interface for IP 10.11.24.109
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]: updateip
event failed
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]:
10.interface: ERROR: Unable to determine interface for IP 10.11.24.108
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]: updateip
event failed
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]:
10.interface: ERROR: Unable to determine interface for IP 10.11.24.107
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]: updateip
event failed
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]:
10.interface: ERROR: Unable to determine interface for IP 10.11.24.106
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]: updateip
event failed
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]:
10.interface: ERROR: Unable to determine interface for IP 10.11.24.105
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]: updateip
event failed
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]:
10.interface: ERROR: Unable to determine interface for IP 10.11.24.104
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]: updateip
event failed
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]:
10.interface: ERROR: Unable to determine interface for IP 10.11.24.103
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]: updateip
event failed
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]:
10.interface: ERROR: Unable to determine interface for IP 10.11.24.102
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]: updateip
event failed
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]:
10.interface: ERROR: Unable to determine interface for IP 10.11.24.101
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]: updateip
event failed
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 winbindd[31812]: [2020/12/02
14:12:44.352830, 0] ../../source3/lib/ctdbd_conn.c:121(cluster_fatal)
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 winbindd[31812]: cluster
fatal event: cluster read error, peer closed connection
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 winbindd[31812]: - exiting
immediately
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 winbindd[31811]: [2020/12/02
14:12:44.352839, 0] ../../source3/lib/ctdbd_conn.c:121(cluster_fatal)
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 winbindd[31811]: cluster
fatal event: cluster read error, peer closed connection
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 winbindd[31811]: - exiting
immediately
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-recoverd[31440]:
recovery daemon parent died - exiting
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-takeover[31909]:
connection to daemon closed, exiting
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 smbd[31809]: [2020/12/02
14:12:44.352865, 0] ../../source3/lib/ctdbd_conn.c:121(cluster_fatal)
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 smbd[31810]: [2020/12/02
14:12:44.352850, 0] ../../source3/lib/ctdbd_conn.c:121(cluster_fatal)
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 smbd[31809]: cluster fatal
event: cluster read error, peer closed connection
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 smbd[31810]: cluster fatal
event: cluster read error, peer closed connection
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 smbd[31809]: - exiting
immediately
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 smbd[31810]: - exiting
immediately
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 winbindd[31778]: [2020/12/02
14:12:44.353109, 0] ../../source3/lib/ctdbd_conn.c:121(cluster_fatal)
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 winbindd[31778]: cluster
fatal event: cluster read error, peer closed connection
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 systemd[1]: ctdb.service:
Main process exited, code=dumped, status=6/ABRT
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 winbindd[31778]: - exiting
immediately
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 winbindd[31780]: [2020/12/02
14:12:44.353786, 0] ../../source3/lib/ctdbd_conn.c:121(cluster_fatal)
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 winbindd[31780]: cluster
fatal event: cluster read error, peer closed connection
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 winbindd[31780]: - exiting
immediately
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 smbd[31807]: [2020/12/02
14:12:44.353867, 0] ../../source3/lib/ctdbd_conn.c:121(cluster_fatal)
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 smbd[31807]: cluster fatal
event: cluster read error, peer closed connection
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 smbd[31807]: - exiting
immediately
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 systemd[1]: winbind.service:
Main process exited, code=exited, status=1/FAILURE
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]: Received
signal 15
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 ctdb-eventd[31309]: Shutting
down
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 systemd[1]: smb.service: Main
process exited, code=exited, status=1/FAILURE
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 systemd[1]: smb.service:
Failed with result 'exit-code'.
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 systemd[1]: ctdb.service:
Failed with result 'core-dump'.
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 systemd[1]: winbind.service:
Failed with result 'exit-code'.
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 systemd-coredump[31925]:
Process 31307 (ctdbd) of user 0 dumped core.#012#012Stack trace of thread
31307:#012#0 0x00007facef1597ff raise (libc.so.6)#012#1 0x00007facef143c35
abort (libc.so.6)#012#2 0x00007facf01043be smb_panic
(/usr/lib64/libsamba-util.so.0.0.1)#012#3 0x00007facf01045c1 sig_fault
(/usr/lib64/libsamba-util.so.0.0.1)#012#4 0x00007facef70bb20 __restore_rt
(libpthread.so.0)#012#5 0x000055f7f69f4329 ctdb_do_updateip_callback
(ctdbd)#012#6 0x000055f7f69f24bb ctdb_event_script_run_done
(ctdbd)#012#7 0x000055f7f69f2572
eventd_client_run_done (ctdbd)#012#8 0x000055f7f69f23a2 eventd_client_read
(ctdbd)#012#9 0x000055f7f69bf058 sock_queue_process (ctdbd)#012#10
0x000055f7f69bf1e2 sock_queue_handler (ctdbd)#012#11 0x00007facef4ec533
tevent_common_invoke_fd_handler (libtevent.so.0)#012#12 0x00007facef4f2acf
epoll_event_loop_once (libtevent.so.0)#012#13 0x00007facef4f0adb
std_event_loop_once (libtevent.so.0)#012#14 0x00007facef4ebc05
_tevent_loop_once (libtevent.so.0)#012#15 0x00007facef4ebeab
tevent_common_loop_wait (libtevent.so.0)#012#16 0x00007facef4f0a6b
std_event_loop_wait (libtevent.so.0)#012#17 0x000055f7f69d38de
ctdb_start_daemon (ctdbd)#012#18 0x000055f7f69b04ea main (ctdbd)#012#19
0x00007facef1457b3 __libc_start_main (libc.so.6)#012#20 0x000055f7f69b0bae
_start (ctdbd)
Dec 2 14:12:44 euw2-samba-server-c26-euw2-01 systemd[1]:
systemd-coredump at 0-31919-0.service: Succeeded.
Dec 2 14:12:54 euw2-samba-server-c26-euw2-01 trace-agent[1053]: 2020-12-02
14:12:54 UTC | TRACE | INFO | (pkg/trace/info/stats.go:101 in LogStats) |
No data received
--
BOB BUCK
SENIOR PLATFORM SOFTWARE ENGINEER
SKIDMORE, OWINGS & MERRILL
7 WORLD TRADE CENTER
250 GREENWICH STREET
NEW YORK, NY 10007
T (212) 298-9624
ROBERT.BUCK at SOM.COM