Hello,
On my bridge head DC, i can see in kern.log lots of < Out of memory : kill
process >
I'm using Samba 4.9.6 (11147 objects) on Debian Stretch 64
This DC synchronize from/to 20 others DC in bridge head mode (no mesh)
Here is my VM (HyperV 2016) config :
- 4 x Vcpu (intel Xeon Silver 4110)
- 2 Go Ram
- 1 Go swap
I'm really not an expert on this kind of problem. I think adding more Ram is
not a solution. Perhaps is there some memory leak somewhere ?
Thanks
[762294.966826] Out of memory: Kill process 848 (samba) score 90 or sacrifice
child
[762294.968147] Killed process 155556 (samba) total-vm:1142900kB,
anon-rss:23484kB, file-rss:4kB, shmem-rss:0kB
[762294.976191] oom_reaper: reaped process 155556 (samba), now anon-rss:0kB,
file-rss:0kB, shmem-rss:0kB
[762303.508349] samba invoked oom-killer:
gfp_mask=0x6200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0,
oom_score_adj=0
[762303.508350] samba cpuset=/ mems_allowed=0
[762303.508355] CPU: 0 PID: 155555 Comm: samba Not tainted 4.19.0-0.bpo.5-amd64
#1 Debian 4.19.37-4~bpo9+1
[762303.508356] Hardware name: Microsoft Corporation Virtual Machine/Virtual
Machine, BIOS Hyper-V UEFI Release v1.0 11/26/2012
[762303.508357] Call Trace:
[762303.508366] dump_stack+0x5c/0x7b
[762303.508369] dump_header+0x6b/0x29c
[762303.508371] oom_kill_process+0x272/0x280
[762303.508372] ? oom_badness+0x23/0x130
[762303.508374] out_of_memory+0x10c/0x480
[762303.508377] __alloc_pages_slowpath+0x9d8/0xdb0
[762303.508380] ? blk_mq_make_request+0x28a/0x530
[762303.508382] __alloc_pages_nodemask+0x258/0x2a0
[762303.508386] alloc_pages_vma+0x7c/0x1d0
[762303.508390] __read_swap_cache_async+0x147/0x200
[762303.508392] read_swap_cache_async+0x28/0x60
[762303.508394] swap_cluster_readahead+0x217/0x290
[762303.508397] ? __switch_to_asm+0x40/0x70
[762303.508399] ? __switch_to+0x115/0x450
[762303.508401] ? swap_range_free+0xa3/0xc0
[762303.508403] ? swapin_readahead+0x60/0x5e0
[762303.508405] swapin_readahead+0x60/0x5e0
[762303.508406] ? free_swap_slot+0xc0/0xe0
[762303.508408] ? radix_tree_lookup_slot+0x1e/0x50
[762303.508411] ? find_get_entry+0x19/0x100
[762303.508413] ? pagecache_get_page+0x30/0x2c0
[762303.508416] ? do_swap_page+0x3af/0x970
[762303.508417] do_swap_page+0x3af/0x970
[762303.508420] __handle_mm_fault+0x7c5/0x1210
[762303.508422] ? __switch_to_asm+0x40/0x70
[762303.508423] ? __switch_to_asm+0x34/0x70
[762303.508425] handle_mm_fault+0xfc/0x1f0
[762303.508429] __do_page_fault+0x255/0x4f0
[762303.508432] ? exit_to_usermode_loop+0x6a/0xf0
[762303.508434] ? page_fault+0x8/0x30
[762303.508435] page_fault+0x1e/0x30
[762303.508438] RIP: 0033:0x7f4f826418bf
[762303.508440] Code: 48 29 c3 49 01 c5 48 8b 43 08 48 83 e0 f8 48 3b 04 03 0f
85 df 07 00 00 48 8b 43 10 48 8b 53 18 48 3b 58 18 0f 85 4f 07 00 00 <48>
3b 5a 10 0f 85 45 07 00 00 48 81 7b 08 ff 03 00 00 48 89 50 18
[762303.508441] RSP: 002b:00007ffdff9d9ad0 EFLAGS: 00010246
[762303.508442] RAX: 0000560ca4fe3410 RBX: 0000560c96ef87c0 RCX:
0000560c96ef8750
[762303.508443] RDX: 0000560c9ec36320 RSI: 0000000000000000 RDI:
00007f4f82963b00
[762303.508444] RBP: 00007f4f82963b00 R08: 0000560c95a4e290 R09:
000000000000a100
[762303.508445] R10: 0000000000000001 R11: 0000000000000246 R12:
0000000000000000
[762303.508446] R13: 0000000000000150 R14: 0000560c96ef8910 R15:
0000000000000100
[762303.508447] Mem-Info:
[762303.508451] active_anon:307811 inactive_anon:102551 isolated_anon:94
active_file:151 inactive_file:141 isolated_file:0
unevictable:0 dirty:0 writeback:19 unstable:0
slab_reclaimable:6246 slab_unreclaimable:14897
mapped:248 shmem:237 pagetables:16941 bounce:0
free:13092 free_pcp:381 free_cma:0
[762303.508454] Node 0 active_anon:1231244kB inactive_anon:410204kB
active_file:604kB inactive_file:564kB unevictable:0kB isolated(anon):376kB
isolated(file):0kB mapped:992kB dirty:0kB writeback:76kB shmem:948kB shmem_thp:
0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB
all_unreclaimable? no
[762303.508455] Node 0 DMA free:7744kB min:376kB low:468kB high:560kB
active_anon:6096kB inactive_anon:1960kB active_file:0kB inactive_file:0kB
unevictable:0kB writepending:0kB present:15996kB managed:15904kB mlocked:0kB
kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB
free_cma:0kB
[762303.508459] lowmem_reserve[]: 0 1844 1844 1844 1844
[762303.508462] Node 0 DMA32 free:44624kB min:44676kB low:55844kB high:67012kB
active_anon:1225424kB inactive_anon:408044kB active_file:1036kB
inactive_file:1028kB unevictable:0kB writepending:76kB present:2080156kB
managed:1915684kB mlocked:0kB kernel_stack:6224kB pagetables:67764kB bounce:0kB
free_pcp:1524kB local_pcp:1392kB free_cma:0kB
[762303.508465] lowmem_reserve[]: 0 0 0 0 0
[762303.508468] Node 0 DMA: 6*4kB (UM) 2*8kB (UM) 1*16kB (M) 2*32kB (UE) 3*64kB
(UME) 2*128kB (UE) 2*256kB (UE) 3*512kB (ME) 5*1024kB (UME) 0*2048kB 0*4096kB =
7736kB
[762303.508478] Node 0 DMA32: 1109*4kB (UMEH) 636*8kB (UMEH) 329*16kB (UMEH)
155*32kB (UMEH) 60*64kB (UEH) 24*128kB (UE) 16*256kB (UME) 7*512kB (E) 9*1024kB
(UE) 1*2048kB (E) 0*4096kB = 45604kB
[762303.508490] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0
hugepages_size=2048kB
[762303.508490] 1368 total pagecache pages
[762303.508491] 820 pages in swap cache
[762303.508492] Swap cache stats: add 6987161, delete 6987506, find
56080169/59465882
[762303.508493] Free swap = 0kB
[762303.508493] Total swap = 1048572kB
[762303.508494] 524038 pages RAM
[762303.508494] 0 pages HighMem/MovableOnly
[762303.508495] 41141 pages reserved
[762303.508495] 0 pages hwpoisoned
[762303.508495] Tasks state (memory values in pages):
[762303.508496] [ pid ] uid tgid total_vm rss pgtables_bytes swapents
oom_score_adj name
[762303.508500] [ 253] 0 253 14783 37 126976 97
0 systemd-journal
[762303.508502] [ 284] 0 284 11648 0 118784 411
-1000 systemd-udevd
[762303.508504] [ 421] 0 421 3152 2 65536 46
0 rsync
[762303.508506] [ 422] 0 422 8951 18 106496 63
0 irqbalance
[762303.508508] [ 423] 0 423 1052 0 61440 34
0 acpid
[762303.508509] [ 424] 0 424 7417 8 106496 64
0 cron
[762303.508511] [ 425] 0 425 1043 0 49152 39
0 hv_vss_daemon
[762303.508513] [ 426] 0 426 11619 30 135168 107
0 systemd-logind
[762303.508514] [ 427] 0 427 1735 5 61440 41
0 hv_kvp_daemon
[762303.508516] [ 428] 0 428 62529 92 135168 343
0 rsyslogd
[762303.508517] [ 429] 0 429 1043 0 53248 23
0 hv_fcopy_daemon
[762303.508519] [ 431] 106 431 11281 42 139264 82
-900 dbus-daemon
[762303.508521] [ 501] 0 501 221424 6 1060864 5516
0 samba
[762303.508522] [ 510] 107 510 16674 224 167936 912
0 snmpd
[762303.508524] [ 518] 0 518 3632 0 73728 37
0 agetty
[762303.508526] [ 773] 0 773 17489 3 180224 189
-1000 sshd
[762303.508527] [ 784] 0 784 39887 0 274432 418
0 nginx
[762303.508529] [ 785] 33 785 40045 14 274432 540
0 nginx
[762303.508530] [ 786] 33 786 40045 9 274432 529
0 nginx
[762303.508532] [ 787] 33 787 40045 39 274432 503
0 nginx
[762303.508533] [ 788] 33 788 40045 10 274432 538
0 nginx
[762303.508535] [ 792] 0 792 62500 16 356352 1057
0 php5-fpm
[762303.508536] [ 799] 33 799 69928 37 397312 2116
0 php5-fpm
[762303.508538] [ 800] 33 800 69928 16 397312 2145
0 php5-fpm
[762303.508540] [ 805] 111 805 118227 188 290816 2155
0 freeradius
[762303.508541] [ 847] 0 847 221424 2 999424 5520
0 samba
[762303.508543] [ 848] 0 848 285725 30911 1798144 36175
0 samba
[762303.508544] [ 849] 0 849 221425 3 995328 5519
0 samba
[762303.508546] [ 850] 0 850 222462 131 1327104 5395
0 samba
[762303.508547] [ 851] 0 851 230486 49 1363968 5529
0 smbd
[762303.508549] [ 852] 0 852 221424 12 999424 5510
0 samba
[762303.508550] [ 853] 0 853 221424 29 1204224 5497
0 samba
[762303.508552] [ 854] 0 854 221424 382 1314816 5140
0 samba
[762303.508553] [ 855] 0 855 224354 675 1339392 5178
0 samba
[762303.508555] [ 856] 0 856 224223 841 1314816 4755
0 samba
[762303.508556] [ 857] 0 857 221424 0 999424 5522
0 samba
[762303.508558] [ 858] 0 858 221424 33 1310720 5489
0 samba
[762303.508559] [ 859] 0 859 221473 13 1314816 5559
0 samba
[762303.508560] [ 860] 0 860 221424 31 1200128 5492
0 samba
[762303.508562] [ 861] 0 861 223102 640 1093632 4890
0 samba
[762303.508563] [ 862] 0 862 221425 2 995328 5520
0 samba
[762303.508565] [ 863] 0 863 210241 226 1196032 5151
0 winbindd
[762303.508566] [ 870] 0 870 227564 3 1224704 5565
0 smbd-notifyd
[762303.508568] [ 873] 0 873 215599 390 1290240 5129
0 winbindd
[762303.508569] [ 874] 0 874 210241 50 1122304 5334
0 winbindd
[762303.508571] [ 875] 0 875 230436 2 1232896 5576
0 lpqd
[762303.508572] [ 905] 105 905 25527 16 118784 121
0 ntpd
[762303.508574] [ 1002] 0 1002 213405 62 1155072 5328
0 winbindd
[762303.508575] [ 1005] 0 1005 224234 73 1277952 5525
0 samba
[762303.508577] [ 103016] 0 103016 230440 13 1220608 5565
0 cleanupd
[762303.508578] [ 152295] 0 152295 236285 0 1380352 5622
0 smbd
[762303.508580] [ 152299] 0 152299 236285 0 1380352 5623
0 smbd
[762303.508581] [ 154383] 3002053 154383 244716 277 1449984 5359
0 smbd
[762303.508583] [ 154481] 3002042 154481 240618 189 1437696 5443
0 smbd
[762303.508585] [ 154614] 3002048 154614 240618 125 1437696 5507
0 smbd
[762303.508586] [ 154725] 0 154725 223102 7 1290240 5528
0 samba
[762303.508588] [ 154743] 3002034 154743 240618 234 1437696 5398
0 smbd
[762303.508589] [ 154927] 3000034 154927 238557 227 1433600 5388
0 smbd
[762303.508591] [ 155006] 0 155006 240606 20 1404928 5597
0 smbd
[762303.508592] [ 155196] 3000034 155196 240606 83 1441792 5534
0 smbd
[762303.508594] [ 155300] 0 155300 223102 1 1343488 5533
0 samba
[762303.508596] [ 155344] 3000034 155344 240606 189 1404928 5428
0 smbd
[762303.508597] [ 155421] 0 155421 223102 10 1306624 5524
0 samba
[762303.508599] [ 155428] 0 155428 223102 0 1306624 5548
0 samba
[762303.508600] [ 155509] 0 155509 285725 42373 1716224 24720
0 samba
[762303.508602] [ 155517] 0 155517 285725 39661 1708032 27431
0 samba
[762303.508603] [ 155518] 0 155518 285725 57450 1716224 9638
0 samba
[762303.508605] [ 155527] 0 155527 285725 63983 1740800 3106
0 samba
[762303.508606] [ 155531] 0 155531 285725 43704 1728512 23383
0 samba
[762303.508607] [ 155537] 0 155537 285725 39585 1724416 27508
0 samba
[762303.508609] [ 155545] 0 155545 285725 34394 1728512 32698
0 samba
[762303.508610] [ 155546] 0 155546 285725 39396 1728512 27697
0 samba
[762303.508612] [ 155555] 0 155555 285725 13544 1716224 53548
0 samba
[762303.508613] [ 155574] 0 155574 234187 930 1363968 4665
0 smbd
You could try this. cat /proc/sys/vm/swappiness This is most probely set to 60. verify it. If so, run : sysctl vm.swappiness=20 If that works, you can set it in /etc/sysctl.conf So its keeps 20 after a reboot. And do also consider to upgrade samba to 4.9.11 Greetz, Louis> -----Oorspronkelijk bericht----- > Van: samba [mailto:samba-bounces at lists.samba.org] Namens > MORILLO Jordi via samba > Verzonden: vrijdag 12 juli 2019 17:18 > Aan: samba at lists.samba.org > Onderwerp: [Samba] Out of memory: kill process > > Hello, > > On my bridge head DC, i can see in kern.log lots of < Out of > memory : kill process > > I'm using Samba 4.9.6 (11147 objects) on Debian Stretch 64 > This DC synchronize from/to 20 others DC in bridge head mode (no mesh) > > Here is my VM (HyperV 2016) config : > > - 4 x Vcpu (intel Xeon Silver 4110) > > - 2 Go Ram > > - 1 Go swap > > I'm really not an expert on this kind of problem. I think > adding more Ram is not a solution. Perhaps is there some > memory leak somewhere ? > Thanks > > [762294.966826] Out of memory: Kill process 848 (samba) score > 90 or sacrifice child > [762294.968147] Killed process 155556 (samba) > total-vm:1142900kB, anon-rss:23484kB, file-rss:4kB, shmem-rss:0kB > [762294.976191] oom_reaper: reaped process 155556 (samba), > now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB > [762303.508349] samba invoked oom-killer: > gfp_mask=0x6200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), > order=0, oom_score_adj=0 > [762303.508350] samba cpuset=/ mems_allowed=0 > [762303.508355] CPU: 0 PID: 155555 Comm: samba Not tainted > 4.19.0-0.bpo.5-amd64 #1 Debian 4.19.37-4~bpo9+1 > [762303.508356] Hardware name: Microsoft Corporation Virtual > Machine/Virtual Machine, BIOS Hyper-V UEFI Release v1.0 11/26/2012 > [762303.508357] Call Trace: > [762303.508366] dump_stack+0x5c/0x7b > [762303.508369] dump_header+0x6b/0x29c > [762303.508371] oom_kill_process+0x272/0x280 > [762303.508372] ? oom_badness+0x23/0x130 > [762303.508374] out_of_memory+0x10c/0x480 > [762303.508377] __alloc_pages_slowpath+0x9d8/0xdb0 > [762303.508380] ? blk_mq_make_request+0x28a/0x530 > [762303.508382] __alloc_pages_nodemask+0x258/0x2a0 > [762303.508386] alloc_pages_vma+0x7c/0x1d0 > [762303.508390] __read_swap_cache_async+0x147/0x200 > [762303.508392] read_swap_cache_async+0x28/0x60 > [762303.508394] swap_cluster_readahead+0x217/0x290 > [762303.508397] ? __switch_to_asm+0x40/0x70 > [762303.508399] ? __switch_to+0x115/0x450 > [762303.508401] ? swap_range_free+0xa3/0xc0 > [762303.508403] ? swapin_readahead+0x60/0x5e0 > [762303.508405] swapin_readahead+0x60/0x5e0 > [762303.508406] ? free_swap_slot+0xc0/0xe0 > [762303.508408] ? radix_tree_lookup_slot+0x1e/0x50 > [762303.508411] ? find_get_entry+0x19/0x100 > [762303.508413] ? pagecache_get_page+0x30/0x2c0 > [762303.508416] ? do_swap_page+0x3af/0x970 > [762303.508417] do_swap_page+0x3af/0x970 > [762303.508420] __handle_mm_fault+0x7c5/0x1210 > [762303.508422] ? __switch_to_asm+0x40/0x70 > [762303.508423] ? __switch_to_asm+0x34/0x70 > [762303.508425] handle_mm_fault+0xfc/0x1f0 > [762303.508429] __do_page_fault+0x255/0x4f0 > [762303.508432] ? exit_to_usermode_loop+0x6a/0xf0 > [762303.508434] ? page_fault+0x8/0x30 > [762303.508435] page_fault+0x1e/0x30 > [762303.508438] RIP: 0033:0x7f4f826418bf > [762303.508440] Code: 48 29 c3 49 01 c5 48 8b 43 08 48 83 e0 > f8 48 3b 04 03 0f 85 df 07 00 00 48 8b 43 10 48 8b 53 18 48 > 3b 58 18 0f 85 4f 07 00 00 <48> 3b 5a 10 0f 85 45 07 00 00 48 > 81 7b 08 ff 03 00 00 48 89 50 18 > [762303.508441] RSP: 002b:00007ffdff9d9ad0 EFLAGS: 00010246 > [762303.508442] RAX: 0000560ca4fe3410 RBX: 0000560c96ef87c0 > RCX: 0000560c96ef8750 > [762303.508443] RDX: 0000560c9ec36320 RSI: 0000000000000000 > RDI: 00007f4f82963b00 > [762303.508444] RBP: 00007f4f82963b00 R08: 0000560c95a4e290 > R09: 000000000000a100 > [762303.508445] R10: 0000000000000001 R11: 0000000000000246 > R12: 0000000000000000 > [762303.508446] R13: 0000000000000150 R14: 0000560c96ef8910 > R15: 0000000000000100 > [762303.508447] Mem-Info: > [762303.508451] active_anon:307811 inactive_anon:102551 > isolated_anon:94 > active_file:151 inactive_file:141 isolated_file:0 > unevictable:0 dirty:0 writeback:19 unstable:0 > slab_reclaimable:6246 slab_unreclaimable:14897 > mapped:248 shmem:237 pagetables:16941 bounce:0 > free:13092 free_pcp:381 free_cma:0 > [762303.508454] Node 0 active_anon:1231244kB > inactive_anon:410204kB active_file:604kB inactive_file:564kB > unevictable:0kB isolated(anon):376kB isolated(file):0kB > mapped:992kB dirty:0kB writeback:76kB shmem:948kB shmem_thp: > 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB > unstable:0kB all_unreclaimable? no > [762303.508455] Node 0 DMA free:7744kB min:376kB low:468kB > high:560kB active_anon:6096kB inactive_anon:1960kB > active_file:0kB inactive_file:0kB unevictable:0kB > writepending:0kB present:15996kB managed:15904kB mlocked:0kB > kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB > local_pcp:0kB free_cma:0kB > [762303.508459] lowmem_reserve[]: 0 1844 1844 1844 1844 > [762303.508462] Node 0 DMA32 free:44624kB min:44676kB > low:55844kB high:67012kB active_anon:1225424kB > inactive_anon:408044kB active_file:1036kB > inactive_file:1028kB unevictable:0kB writepending:76kB > present:2080156kB managed:1915684kB mlocked:0kB > kernel_stack:6224kB pagetables:67764kB bounce:0kB > free_pcp:1524kB local_pcp:1392kB free_cma:0kB > [762303.508465] lowmem_reserve[]: 0 0 0 0 0 > [762303.508468] Node 0 DMA: 6*4kB (UM) 2*8kB (UM) 1*16kB (M) > 2*32kB (UE) 3*64kB (UME) 2*128kB (UE) 2*256kB (UE) 3*512kB > (ME) 5*1024kB (UME) 0*2048kB 0*4096kB = 7736kB > [762303.508478] Node 0 DMA32: 1109*4kB (UMEH) 636*8kB (UMEH) > 329*16kB (UMEH) 155*32kB (UMEH) 60*64kB (UEH) 24*128kB (UE) > 16*256kB (UME) 7*512kB (E) 9*1024kB (UE) 1*2048kB (E) > 0*4096kB = 45604kB > [762303.508490] Node 0 hugepages_total=0 hugepages_free=0 > hugepages_surp=0 hugepages_size=2048kB > [762303.508490] 1368 total pagecache pages > [762303.508491] 820 pages in swap cache > [762303.508492] Swap cache stats: add 6987161, delete > 6987506, find 56080169/59465882 > [762303.508493] Free swap = 0kB > [762303.508493] Total swap = 1048572kB > [762303.508494] 524038 pages RAM > [762303.508494] 0 pages HighMem/MovableOnly > [762303.508495] 41141 pages reserved > [762303.508495] 0 pages hwpoisoned > [762303.508495] Tasks state (memory values in pages): > [762303.508496] [ pid ] uid tgid total_vm rss > pgtables_bytes swapents oom_score_adj name > [762303.508500] [ 253] 0 253 14783 37 > 126976 97 0 systemd-journal > [762303.508502] [ 284] 0 284 11648 0 > 118784 411 -1000 systemd-udevd > [762303.508504] [ 421] 0 421 3152 2 > 65536 46 0 rsync > [762303.508506] [ 422] 0 422 8951 18 > 106496 63 0 irqbalance > [762303.508508] [ 423] 0 423 1052 0 > 61440 34 0 acpid > [762303.508509] [ 424] 0 424 7417 8 > 106496 64 0 cron > [762303.508511] [ 425] 0 425 1043 0 > 49152 39 0 hv_vss_daemon > [762303.508513] [ 426] 0 426 11619 30 > 135168 107 0 systemd-logind > [762303.508514] [ 427] 0 427 1735 5 > 61440 41 0 hv_kvp_daemon > [762303.508516] [ 428] 0 428 62529 92 > 135168 343 0 rsyslogd > [762303.508517] [ 429] 0 429 1043 0 > 53248 23 0 hv_fcopy_daemon > [762303.508519] [ 431] 106 431 11281 42 > 139264 82 -900 dbus-daemon > [762303.508521] [ 501] 0 501 221424 6 > 1060864 5516 0 samba > [762303.508522] [ 510] 107 510 16674 224 > 167936 912 0 snmpd > [762303.508524] [ 518] 0 518 3632 0 > 73728 37 0 agetty > [762303.508526] [ 773] 0 773 17489 3 > 180224 189 -1000 sshd > [762303.508527] [ 784] 0 784 39887 0 > 274432 418 0 nginx > [762303.508529] [ 785] 33 785 40045 14 > 274432 540 0 nginx > [762303.508530] [ 786] 33 786 40045 9 > 274432 529 0 nginx > [762303.508532] [ 787] 33 787 40045 39 > 274432 503 0 nginx > [762303.508533] [ 788] 33 788 40045 10 > 274432 538 0 nginx > [762303.508535] [ 792] 0 792 62500 16 > 356352 1057 0 php5-fpm > [762303.508536] [ 799] 33 799 69928 37 > 397312 2116 0 php5-fpm > [762303.508538] [ 800] 33 800 69928 16 > 397312 2145 0 php5-fpm > [762303.508540] [ 805] 111 805 118227 188 > 290816 2155 0 freeradius > [762303.508541] [ 847] 0 847 221424 2 > 999424 5520 0 samba > [762303.508543] [ 848] 0 848 285725 30911 > 1798144 36175 0 samba > [762303.508544] [ 849] 0 849 221425 3 > 995328 5519 0 samba > [762303.508546] [ 850] 0 850 222462 131 > 1327104 5395 0 samba > [762303.508547] [ 851] 0 851 230486 49 > 1363968 5529 0 smbd > [762303.508549] [ 852] 0 852 221424 12 > 999424 5510 0 samba > [762303.508550] [ 853] 0 853 221424 29 > 1204224 5497 0 samba > [762303.508552] [ 854] 0 854 221424 382 > 1314816 5140 0 samba > [762303.508553] [ 855] 0 855 224354 675 > 1339392 5178 0 samba > [762303.508555] [ 856] 0 856 224223 841 > 1314816 4755 0 samba > [762303.508556] [ 857] 0 857 221424 0 > 999424 5522 0 samba > [762303.508558] [ 858] 0 858 221424 33 > 1310720 5489 0 samba > [762303.508559] [ 859] 0 859 221473 13 > 1314816 5559 0 samba > [762303.508560] [ 860] 0 860 221424 31 > 1200128 5492 0 samba > [762303.508562] [ 861] 0 861 223102 640 > 1093632 4890 0 samba > [762303.508563] [ 862] 0 862 221425 2 > 995328 5520 0 samba > [762303.508565] [ 863] 0 863 210241 226 > 1196032 5151 0 winbindd > [762303.508566] [ 870] 0 870 227564 3 > 1224704 5565 0 smbd-notifyd > [762303.508568] [ 873] 0 873 215599 390 > 1290240 5129 0 winbindd > [762303.508569] [ 874] 0 874 210241 50 > 1122304 5334 0 winbindd > [762303.508571] [ 875] 0 875 230436 2 > 1232896 5576 0 lpqd > [762303.508572] [ 905] 105 905 25527 16 > 118784 121 0 ntpd > [762303.508574] [ 1002] 0 1002 213405 62 > 1155072 5328 0 winbindd > [762303.508575] [ 1005] 0 1005 224234 73 > 1277952 5525 0 samba > [762303.508577] [ 103016] 0 103016 230440 13 > 1220608 5565 0 cleanupd > [762303.508578] [ 152295] 0 152295 236285 0 > 1380352 5622 0 smbd > [762303.508580] [ 152299] 0 152299 236285 0 > 1380352 5623 0 smbd > [762303.508581] [ 154383] 3002053 154383 244716 277 > 1449984 5359 0 smbd > [762303.508583] [ 154481] 3002042 154481 240618 189 > 1437696 5443 0 smbd > [762303.508585] [ 154614] 3002048 154614 240618 125 > 1437696 5507 0 smbd > [762303.508586] [ 154725] 0 154725 223102 7 > 1290240 5528 0 samba > [762303.508588] [ 154743] 3002034 154743 240618 234 > 1437696 5398 0 smbd > [762303.508589] [ 154927] 3000034 154927 238557 227 > 1433600 5388 0 smbd > [762303.508591] [ 155006] 0 155006 240606 20 > 1404928 5597 0 smbd > [762303.508592] [ 155196] 3000034 155196 240606 83 > 1441792 5534 0 smbd > [762303.508594] [ 155300] 0 155300 223102 1 > 1343488 5533 0 samba > [762303.508596] [ 155344] 3000034 155344 240606 189 > 1404928 5428 0 smbd > [762303.508597] [ 155421] 0 155421 223102 10 > 1306624 5524 0 samba > [762303.508599] [ 155428] 0 155428 223102 0 > 1306624 5548 0 samba > [762303.508600] [ 155509] 0 155509 285725 42373 > 1716224 24720 0 samba > [762303.508602] [ 155517] 0 155517 285725 39661 > 1708032 27431 0 samba > [762303.508603] [ 155518] 0 155518 285725 57450 > 1716224 9638 0 samba > [762303.508605] [ 155527] 0 155527 285725 63983 > 1740800 3106 0 samba > [762303.508606] [ 155531] 0 155531 285725 43704 > 1728512 23383 0 samba > [762303.508607] [ 155537] 0 155537 285725 39585 > 1724416 27508 0 samba > [762303.508609] [ 155545] 0 155545 285725 34394 > 1728512 32698 0 samba > [762303.508610] [ 155546] 0 155546 285725 39396 > 1728512 27697 0 samba > [762303.508612] [ 155555] 0 155555 285725 13544 > 1716224 53548 0 samba > [762303.508613] [ 155574] 0 155574 234187 930 > 1363968 4665 0 smbd > > > > -- > To unsubscribe from this list go to the following URL and read the > instructions: https://lists.samba.org/mailman/options/samba > >
Ok thank you Louis ! -----Message d'origine----- De?: samba <samba-bounces at lists.samba.org> De la part de L.P.H. van Belle via samba Envoy??: vendredi 12 juillet 2019 17:43 ??: samba at lists.samba.org Objet?: Re: [Samba] Out of memory: kill process You could try this. cat /proc/sys/vm/swappiness This is most probely set to 60. verify it. If so, run : sysctl vm.swappiness=20 If that works, you can set it in /etc/sysctl.conf So its keeps 20 after a reboot. And do also consider to upgrade samba to 4.9.11 Greetz, Louis> -----Oorspronkelijk bericht----- > Van: samba [mailto:samba-bounces at lists.samba.org] Namens MORILLO Jordi > via samba > Verzonden: vrijdag 12 juli 2019 17:18 > Aan: samba at lists.samba.org > Onderwerp: [Samba] Out of memory: kill process > > Hello, > > On my bridge head DC, i can see in kern.log lots of < Out of memory : > kill process > I'm using Samba 4.9.6 (11147 objects) on Debian Stretch > 64 This DC synchronize from/to 20 others DC in bridge head mode (no > mesh) > > Here is my VM (HyperV 2016) config : > > - 4 x Vcpu (intel Xeon Silver 4110) > > - 2 Go Ram > > - 1 Go swap > > I'm really not an expert on this kind of problem. I think adding more > Ram is not a solution. Perhaps is there some memory leak somewhere ? > Thanks > > [762294.966826] Out of memory: Kill process 848 (samba) score > 90 or sacrifice child > [762294.968147] Killed process 155556 (samba) total-vm:1142900kB, > anon-rss:23484kB, file-rss:4kB, shmem-rss:0kB [762294.976191] > oom_reaper: reaped process 155556 (samba), now anon-rss:0kB, > file-rss:0kB, shmem-rss:0kB [762303.508349] samba invoked oom-killer: > gfp_mask=0x6200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, > oom_score_adj=0 [762303.508350] samba cpuset=/ mems_allowed=0 > [762303.508355] CPU: 0 PID: 155555 Comm: samba Not tainted > 4.19.0-0.bpo.5-amd64 #1 Debian 4.19.37-4~bpo9+1 [762303.508356] > Hardware name: Microsoft Corporation Virtual Machine/Virtual Machine, > BIOS Hyper-V UEFI Release v1.0 11/26/2012 [762303.508357] Call Trace: > [762303.508366] dump_stack+0x5c/0x7b > [762303.508369] dump_header+0x6b/0x29c [762303.508371] > oom_kill_process+0x272/0x280 [762303.508372] ? oom_badness+0x23/0x130 > [762303.508374] out_of_memory+0x10c/0x480 [762303.508377] > __alloc_pages_slowpath+0x9d8/0xdb0 > [762303.508380] ? blk_mq_make_request+0x28a/0x530 [762303.508382] > __alloc_pages_nodemask+0x258/0x2a0 > [762303.508386] alloc_pages_vma+0x7c/0x1d0 [762303.508390] > __read_swap_cache_async+0x147/0x200 > [762303.508392] read_swap_cache_async+0x28/0x60 [762303.508394] > swap_cluster_readahead+0x217/0x290 > [762303.508397] ? __switch_to_asm+0x40/0x70 [762303.508399] ? > __switch_to+0x115/0x450 [762303.508401] ? swap_range_free+0xa3/0xc0 > [762303.508403] ? swapin_readahead+0x60/0x5e0 [762303.508405] > swapin_readahead+0x60/0x5e0 [762303.508406] ? > free_swap_slot+0xc0/0xe0 [762303.508408] ? > radix_tree_lookup_slot+0x1e/0x50 [762303.508411] ? > find_get_entry+0x19/0x100 [762303.508413] ? > pagecache_get_page+0x30/0x2c0 [762303.508416] ? > do_swap_page+0x3af/0x970 [762303.508417] do_swap_page+0x3af/0x970 > [762303.508420] __handle_mm_fault+0x7c5/0x1210 [762303.508422] ? > __switch_to_asm+0x40/0x70 [762303.508423] ? __switch_to_asm+0x34/0x70 > [762303.508425] handle_mm_fault+0xfc/0x1f0 [762303.508429] > __do_page_fault+0x255/0x4f0 [762303.508432] ? > exit_to_usermode_loop+0x6a/0xf0 [762303.508434] ? page_fault+0x8/0x30 > [762303.508435] page_fault+0x1e/0x30 [762303.508438] RIP: > 0033:0x7f4f826418bf [762303.508440] Code: 48 29 c3 49 01 c5 48 8b 43 > 08 48 83 e0 > f8 48 3b 04 03 0f 85 df 07 00 00 48 8b 43 10 48 8b 53 18 48 3b 58 18 > 0f 85 4f 07 00 00 <48> 3b 5a 10 0f 85 45 07 00 00 48 > 81 7b 08 ff 03 00 00 48 89 50 18 > [762303.508441] RSP: 002b:00007ffdff9d9ad0 EFLAGS: 00010246 > [762303.508442] RAX: 0000560ca4fe3410 RBX: 0000560c96ef87c0 > RCX: 0000560c96ef8750 > [762303.508443] RDX: 0000560c9ec36320 RSI: 0000000000000000 > RDI: 00007f4f82963b00 > [762303.508444] RBP: 00007f4f82963b00 R08: 0000560c95a4e290 > R09: 000000000000a100 > [762303.508445] R10: 0000000000000001 R11: 0000000000000246 > R12: 0000000000000000 > [762303.508446] R13: 0000000000000150 R14: 0000560c96ef8910 > R15: 0000000000000100 > [762303.508447] Mem-Info: > [762303.508451] active_anon:307811 inactive_anon:102551 > isolated_anon:94 > active_file:151 inactive_file:141 isolated_file:0 > unevictable:0 dirty:0 writeback:19 unstable:0 > slab_reclaimable:6246 slab_unreclaimable:14897 > mapped:248 shmem:237 pagetables:16941 bounce:0 > free:13092 free_pcp:381 free_cma:0 [762303.508454] > Node 0 active_anon:1231244kB inactive_anon:410204kB active_file:604kB > inactive_file:564kB unevictable:0kB isolated(anon):376kB > isolated(file):0kB mapped:992kB dirty:0kB writeback:76kB shmem:948kB > shmem_thp: > 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB > all_unreclaimable? no [762303.508455] Node 0 DMA free:7744kB min:376kB > low:468kB high:560kB active_anon:6096kB inactive_anon:1960kB > active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB > present:15996kB managed:15904kB mlocked:0kB kernel_stack:0kB > pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB > [762303.508459] lowmem_reserve[]: 0 1844 1844 1844 1844 > [762303.508462] Node 0 DMA32 free:44624kB min:44676kB low:55844kB > high:67012kB active_anon:1225424kB inactive_anon:408044kB > active_file:1036kB inactive_file:1028kB unevictable:0kB > writepending:76kB present:2080156kB managed:1915684kB mlocked:0kB > kernel_stack:6224kB pagetables:67764kB bounce:0kB free_pcp:1524kB > local_pcp:1392kB free_cma:0kB [762303.508465] lowmem_reserve[]: 0 0 0 > 0 0 [762303.508468] Node 0 DMA: 6*4kB (UM) 2*8kB (UM) 1*16kB (M) > 2*32kB (UE) 3*64kB (UME) 2*128kB (UE) 2*256kB (UE) 3*512kB > (ME) 5*1024kB (UME) 0*2048kB 0*4096kB = 7736kB [762303.508478] Node 0 > DMA32: 1109*4kB (UMEH) 636*8kB (UMEH) 329*16kB (UMEH) 155*32kB (UMEH) > 60*64kB (UEH) 24*128kB (UE) 16*256kB (UME) 7*512kB (E) 9*1024kB (UE) > 1*2048kB (E) 0*4096kB = 45604kB [762303.508490] Node 0 > hugepages_total=0 hugepages_free=0 > hugepages_surp=0 hugepages_size=2048kB [762303.508490] 1368 total > pagecache pages [762303.508491] 820 pages in swap cache > [762303.508492] Swap cache stats: add 6987161, delete 6987506, find > 56080169/59465882 [762303.508493] Free swap = 0kB [762303.508493] > Total swap = 1048572kB [762303.508494] 524038 pages RAM > [762303.508494] 0 pages HighMem/MovableOnly [762303.508495] 41141 > pages reserved [762303.508495] 0 pages hwpoisoned [762303.508495] > Tasks state (memory values in pages): > [762303.508496] [ pid ] uid tgid total_vm rss > pgtables_bytes swapents oom_score_adj name > [762303.508500] [ 253] 0 253 14783 37 > 126976 97 0 systemd-journal > [762303.508502] [ 284] 0 284 11648 0 > 118784 411 -1000 systemd-udevd > [762303.508504] [ 421] 0 421 3152 2 > 65536 46 0 rsync > [762303.508506] [ 422] 0 422 8951 18 > 106496 63 0 irqbalance > [762303.508508] [ 423] 0 423 1052 0 > 61440 34 0 acpid > [762303.508509] [ 424] 0 424 7417 8 > 106496 64 0 cron > [762303.508511] [ 425] 0 425 1043 0 > 49152 39 0 hv_vss_daemon > [762303.508513] [ 426] 0 426 11619 30 > 135168 107 0 systemd-logind > [762303.508514] [ 427] 0 427 1735 5 > 61440 41 0 hv_kvp_daemon > [762303.508516] [ 428] 0 428 62529 92 > 135168 343 0 rsyslogd > [762303.508517] [ 429] 0 429 1043 0 > 53248 23 0 hv_fcopy_daemon > [762303.508519] [ 431] 106 431 11281 42 > 139264 82 -900 dbus-daemon > [762303.508521] [ 501] 0 501 221424 6 > 1060864 5516 0 samba > [762303.508522] [ 510] 107 510 16674 224 > 167936 912 0 snmpd > [762303.508524] [ 518] 0 518 3632 0 > 73728 37 0 agetty > [762303.508526] [ 773] 0 773 17489 3 > 180224 189 -1000 sshd > [762303.508527] [ 784] 0 784 39887 0 > 274432 418 0 nginx > [762303.508529] [ 785] 33 785 40045 14 > 274432 540 0 nginx > [762303.508530] [ 786] 33 786 40045 9 > 274432 529 0 nginx > [762303.508532] [ 787] 33 787 40045 39 > 274432 503 0 nginx > [762303.508533] [ 788] 33 788 40045 10 > 274432 538 0 nginx > [762303.508535] [ 792] 0 792 62500 16 > 356352 1057 0 php5-fpm > [762303.508536] [ 799] 33 799 69928 37 > 397312 2116 0 php5-fpm > [762303.508538] [ 800] 33 800 69928 16 > 397312 2145 0 php5-fpm > [762303.508540] [ 805] 111 805 118227 188 > 290816 2155 0 freeradius > [762303.508541] [ 847] 0 847 221424 2 > 999424 5520 0 samba > [762303.508543] [ 848] 0 848 285725 30911 > 1798144 36175 0 samba > [762303.508544] [ 849] 0 849 221425 3 > 995328 5519 0 samba > [762303.508546] [ 850] 0 850 222462 131 > 1327104 5395 0 samba > [762303.508547] [ 851] 0 851 230486 49 > 1363968 5529 0 smbd > [762303.508549] [ 852] 0 852 221424 12 > 999424 5510 0 samba > [762303.508550] [ 853] 0 853 221424 29 > 1204224 5497 0 samba > [762303.508552] [ 854] 0 854 221424 382 > 1314816 5140 0 samba > [762303.508553] [ 855] 0 855 224354 675 > 1339392 5178 0 samba > [762303.508555] [ 856] 0 856 224223 841 > 1314816 4755 0 samba > [762303.508556] [ 857] 0 857 221424 0 > 999424 5522 0 samba > [762303.508558] [ 858] 0 858 221424 33 > 1310720 5489 0 samba > [762303.508559] [ 859] 0 859 221473 13 > 1314816 5559 0 samba > [762303.508560] [ 860] 0 860 221424 31 > 1200128 5492 0 samba > [762303.508562] [ 861] 0 861 223102 640 > 1093632 4890 0 samba > [762303.508563] [ 862] 0 862 221425 2 > 995328 5520 0 samba > [762303.508565] [ 863] 0 863 210241 226 > 1196032 5151 0 winbindd > [762303.508566] [ 870] 0 870 227564 3 > 1224704 5565 0 smbd-notifyd > [762303.508568] [ 873] 0 873 215599 390 > 1290240 5129 0 winbindd > [762303.508569] [ 874] 0 874 210241 50 > 1122304 5334 0 winbindd > [762303.508571] [ 875] 0 875 230436 2 > 1232896 5576 0 lpqd > [762303.508572] [ 905] 105 905 25527 16 > 118784 121 0 ntpd > [762303.508574] [ 1002] 0 1002 213405 62 > 1155072 5328 0 winbindd > [762303.508575] [ 1005] 0 1005 224234 73 > 1277952 5525 0 samba > [762303.508577] [ 103016] 0 103016 230440 13 > 1220608 5565 0 cleanupd > [762303.508578] [ 152295] 0 152295 236285 0 > 1380352 5622 0 smbd > [762303.508580] [ 152299] 0 152299 236285 0 > 1380352 5623 0 smbd > [762303.508581] [ 154383] 3002053 154383 244716 277 > 1449984 5359 0 smbd > [762303.508583] [ 154481] 3002042 154481 240618 189 > 1437696 5443 0 smbd > [762303.508585] [ 154614] 3002048 154614 240618 125 > 1437696 5507 0 smbd > [762303.508586] [ 154725] 0 154725 223102 7 > 1290240 5528 0 samba > [762303.508588] [ 154743] 3002034 154743 240618 234 > 1437696 5398 0 smbd > [762303.508589] [ 154927] 3000034 154927 238557 227 > 1433600 5388 0 smbd > [762303.508591] [ 155006] 0 155006 240606 20 > 1404928 5597 0 smbd > [762303.508592] [ 155196] 3000034 155196 240606 83 > 1441792 5534 0 smbd > [762303.508594] [ 155300] 0 155300 223102 1 > 1343488 5533 0 samba > [762303.508596] [ 155344] 3000034 155344 240606 189 > 1404928 5428 0 smbd > [762303.508597] [ 155421] 0 155421 223102 10 > 1306624 5524 0 samba > [762303.508599] [ 155428] 0 155428 223102 0 > 1306624 5548 0 samba > [762303.508600] [ 155509] 0 155509 285725 42373 > 1716224 24720 0 samba > [762303.508602] [ 155517] 0 155517 285725 39661 > 1708032 27431 0 samba > [762303.508603] [ 155518] 0 155518 285725 57450 > 1716224 9638 0 samba > [762303.508605] [ 155527] 0 155527 285725 63983 > 1740800 3106 0 samba > [762303.508606] [ 155531] 0 155531 285725 43704 > 1728512 23383 0 samba > [762303.508607] [ 155537] 0 155537 285725 39585 > 1724416 27508 0 samba > [762303.508609] [ 155545] 0 155545 285725 34394 > 1728512 32698 0 samba > [762303.508610] [ 155546] 0 155546 285725 39396 > 1728512 27697 0 samba > [762303.508612] [ 155555] 0 155555 285725 13544 > 1716224 53548 0 samba > [762303.508613] [ 155574] 0 155574 234187 930 > 1363968 4665 0 smbd > > > > -- > To unsubscribe from this list go to the following URL and read the > instructions: https://lists.samba.org/mailman/options/samba > >-- To unsubscribe from this list go to the following URL and read the instructions: https://lists.samba.org/mailman/options/samba
Apparently Analagous Threads
- Out of memory: kill process
- Stacktrace from 5.4.26 kernel.
- summary.default rounding on numeric seems inconsistent with other R behaviors
- summary.default rounding on numeric seems inconsistent with other R behaviors
- summary.default rounding on numeric seems inconsistent with other R behaviors