Any idea how I can debug this?
On Fri, Feb 2, 2024 at 8:14?PM Elias Pereira <empbilly at gmail.com>
wrote:
> hi,
>
> Thanks for the answer, Douglas!!
>
> You're right. The kcc runs every 5 minutes.
>
> [2024/02/02 19:23:26.126663, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: INFO: Current debug levels:
> [2024/02/02 19:23:26.126992, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: all: 5
> [2024/02/02 19:23:26.127106, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: tdb: 5
> [2024/02/02 19:23:26.127176, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: printdrivers: 5
> [2024/02/02 19:23:26.127262, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: lanman: 5
> [2024/02/02 19:23:26.127339, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: smb: 5
> [2024/02/02 19:23:26.127520, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: rpc_parse: 5
> [2024/02/02 19:23:26.127659, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: rpc_srv: 5
> [2024/02/02 19:23:26.127792, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: rpc_cli: 5
> [2024/02/02 19:23:26.127932, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: passdb: 5
> [2024/02/02 19:23:26.128071, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: sam: 5
> [2024/02/02 19:23:26.128200, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: auth: 5
> [2024/02/02 19:23:26.128408, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: winbind: 5
> [2024/02/02 19:23:26.128551, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: vfs: 5
> [2024/02/02 19:23:26.128819, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: idmap: 5
> [2024/02/02 19:23:26.129039, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: quota: 5
> [2024/02/02 19:23:26.129304, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: acls: 5
> [2024/02/02 19:23:26.129529, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: locking: 5
> [2024/02/02 19:23:26.129740, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: msdfs: 5
> [2024/02/02 19:23:26.129949, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dmapi: 5
> [2024/02/02 19:23:26.130158, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: registry: 5
> [2024/02/02 19:23:26.130392, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: scavenger: 5
> [2024/02/02 19:23:26.130605, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dns: 5
> [2024/02/02 19:23:26.130816, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: ldb: 5
> [2024/02/02 19:23:26.131026, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: tevent: 5
> [2024/02/02 19:23:26.131236, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: auth_audit: 5
> [2024/02/02 19:23:26.131450, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: auth_json_audit: 5
> [2024/02/02 19:23:26.131689, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: kerberos: 5
> [2024/02/02 19:23:26.131900, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: drs_repl: 5
> [2024/02/02 19:23:26.132135, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: smb2: 5
> [2024/02/02 19:23:26.132358, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: smb2_credits: 5
> [2024/02/02 19:23:26.132572, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dsdb_audit: 5
> [2024/02/02 19:23:26.132783, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dsdb_json_audit: 5
> [2024/02/02 19:23:26.132993, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dsdb_password_audit: 5
> [2024/02/02 19:23:26.133204, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dsdb_password_json_audit: 5
> [2024/02/02 19:23:26.133354, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dsdb_transaction_audit: 5
> [2024/02/02 19:23:26.133515, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dsdb_transaction_json_audit: 5
> [2024/02/02 19:23:26.133677, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dsdb_group_audit: 5
> [2024/02/02 19:23:26.133841, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dsdb_group_json_audit: 5
> [2024/02/02 19:23:26.134000, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: lpcfg_load: refreshing parameters from
> /etc/samba/smb.conf
> [2024/02/02 19:23:26.134143, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: Processing section "[global]"
> [2024/02/02 19:23:26.134299, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: Processing section "[netlogon]"
> [2024/02/02 19:23:26.134443, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: Processing section "[sysvol]"
> [2024/02/02 19:23:26.134598, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: pm_process() returned Yes
>
>
> [2024/02/02 19:28:26.247247, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: INFO: Current debug levels:
> [2024/02/02 19:28:26.247610, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: all: 5
> [2024/02/02 19:28:26.247754, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: tdb: 5
> [2024/02/02 19:28:26.247836, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: printdrivers: 5
> [2024/02/02 19:28:26.247894, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: lanman: 5
> [2024/02/02 19:28:26.247950, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: smb: 5
> [2024/02/02 19:28:26.248018, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: rpc_parse: 5
> [2024/02/02 19:28:26.248074, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: rpc_srv: 5
> [2024/02/02 19:28:26.248129, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: rpc_cli: 5
> [2024/02/02 19:28:26.248185, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: passdb: 5
> [2024/02/02 19:28:26.248243, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: sam: 5
> [2024/02/02 19:28:26.248298, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: auth: 5
> [2024/02/02 19:28:26.248364, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: winbind: 5
> [2024/02/02 19:28:26.248420, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: vfs: 5
> [2024/02/02 19:28:26.248476, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: idmap: 5
> [2024/02/02 19:28:26.248532, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: quota: 5
> [2024/02/02 19:28:26.248587, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: acls: 5
> [2024/02/02 19:28:26.248651, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: locking: 5
> [2024/02/02 19:28:26.248708, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: msdfs: 5
> [2024/02/02 19:28:26.248763, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dmapi: 5
> [2024/02/02 19:28:26.248848, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: registry: 5
> [2024/02/02 19:28:26.248914, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: scavenger: 5
> [2024/02/02 19:28:26.248980, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dns: 5
> [2024/02/02 19:28:26.249036, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: ldb: 5
> [2024/02/02 19:28:26.249091, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: tevent: 5
> [2024/02/02 19:28:26.249147, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: auth_audit: 5
> [2024/02/02 19:28:26.249284, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: auth_json_audit: 5
> [2024/02/02 19:28:26.249372, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: kerberos: 5
> [2024/02/02 19:28:26.249429, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: drs_repl: 5
> [2024/02/02 19:28:26.249485, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: smb2: 5
> [2024/02/02 19:28:26.249539, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: smb2_credits: 5
> [2024/02/02 19:28:26.249614, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dsdb_audit: 5
> [2024/02/02 19:28:26.249670, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dsdb_json_audit: 5
> [2024/02/02 19:28:26.249725, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dsdb_password_audit: 5
> [2024/02/02 19:28:26.249781, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dsdb_password_json_audit: 5
> [2024/02/02 19:28:26.249838, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dsdb_transaction_audit: 5
> [2024/02/02 19:28:26.249920, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dsdb_transaction_json_audit: 5
> [2024/02/02 19:28:26.249977, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dsdb_group_audit: 5
> [2024/02/02 19:28:26.250059, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: dsdb_group_json_audit: 5
> [2024/02/02 19:28:26.250140, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: lpcfg_load: refreshing parameters from
> /etc/samba/smb.conf
> [2024/02/02 19:28:26.250206, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: Processing section "[global]"
> [2024/02/02 19:28:26.250265, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: Processing section "[netlogon]"
> [2024/02/02 19:28:26.250323, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: Processing section "[sysvol]"
> [2024/02/02 19:28:26.250532, 0]
> ../../lib/util/util_runcmd.c:355(samba_runcmd_io_handler)
> /usr/sbin/samba_kcc: pm_process() returned Yes
>
> [2024/02/02 20:04:06.799279, 0]
> ../../source4/dsdb/kcc/kcc_periodic.c:790(samba_kcc_done)
> ../../source4/dsdb/kcc/kcc_periodic.c:790: Failed samba_kcc -
> NT_STATUS_IO_TIMEOUT
> [2024/02/02 20:05:17.752322, 0]
> ../../source4/dsdb/repl/drepl_out_helpers.c:1300(dreplsrv_update_refs_done)
> UpdateRefs failed with NT_STATUS_IO_TIMEOUT
>
> But then at the time below the error occurred again. It seems to be the
> kcc, but there was no debugging?
>
> What does this part of the code do?
> source4/dsdb/kcc/kcc_periodic.c:790
>
> On Tue, Jan 30, 2024 at 8:19?PM Douglas Bagnall <
> douglas.bagnall at catalyst.net.nz> wrote:
>
>> On 22/01/24 13:40, Elias Pereira via samba wrote:
>> > hi,
>> >
>> > *EDIT*: Every 2 hours kcc_periodic.c is executed
>> >
>> > The error occurs on all 4 of my DCs:
>> >
>> > [2024/01/19 14:02:05.917120, 0]
>> > source4/dsdb/kcc/kcc_periodic.c:790(samba_kcc_done)
>> > source4/dsdb/kcc/kcc_periodic.c:790: Failed samba_kcc -
>> > NT_STATUS_IO_TIMEOUT
>> >
>> > Today I enabled logging at level 5 and monitored DC1. There was no
>> error,
>> > on the contrary, kcc_periodic.c ran correctly and the message was
Ok.
>> >
>> > [2024/01/19 16:04:30.732009, 3]
>> > ../../source4/dsdb/kcc/kcc_periodic.c:793(samba_kcc_done)
>> > Completed samba_kcc OK
>> >
>> > Why the difference between running with and without log level?
>> >
>>
>> I don't know the answer to that, but I think setting
>>
>> samba kcc command = /usr/sbin/samba_kcc -d5
>>
>> will turn up the log level on the samba_kcc subprocess itself and not
on
>> everything else.
>>
>> samba_kcc should be running every 5 minutes, not every 2 hours, so
I'd
>> be looking for something else that is making your network seize up
every
>> two hours.
>>
>> As it happens, 2 hours is the DNS record scavenging interval, but I
>> don't see how that would affect this.
>>
>> cheers,
>> Douglas
>>
>>
>
> --
> Elias Pereira
>
--
Elias Pereira