thr3ads.net - dovecot - dovecot/config processes open, and consuming all memory [Aug 2022]

If this information is useful, please help other people find it:
Share via:

John Stoffel

2022-Aug-14 21:24 UTC

dovecot/config processes open, and consuming all memory

>>>>> "filipe at digirati" == filipe at digirati com br
<filipe at digirati.com.br> writes:
filipe at digirati> I'm having strange behavior in dovecot 2.3.16.
filipe at digirati> It's opening dozens of dovecot/config process and
consuming all server
filipe at digirati> memory. Normally each process consumes between 700Mb and
1Gb of ram.

filipe at digirati> Would anyone have an idea about this?

filipe at digirati> service config {
filipe at digirati>  ? vsz_limit = 2048M
filipe at digirati>  ? idle_kill = 60s
filipe at digirati>  ? service_count = 1024
filipe at digirati> }

I wonder why you have the service count so high?  I'd drop it down, or
do you really have 1025 connections in 60 seconds?
>From the docs:

     service_count

     Number of client connections to handle until the process kills
     itself. 0 means unlimited. 1 means only a single connection is handled
     until the process is stopped - this is the most secure choice since
     there?s no way for one connection?s state to leak to the next one. For
     better performance this can be set higher, but ideally not unlimited
     since more complex services can have small memory leaks and/or memory
     fragmentation and the process should get restarted eventually. For
     example 100..1000 can be good values.

So maybe drop it down to 100 for now and see how that works for you.  


filipe at digirati> pstree
filipe at digirati> systemd???ModemManager???2*[{ModemManager}]
filipe at digirati>  ??????? ??agetty
filipe at digirati>  ??????? ??cron
filipe at digirati>  ??????? ??dbus-daemon
filipe at digirati>  ??????? ??dovecot???anvil
filipe at digirati>  ??????? ????????? ??6*[auth]
filipe at digirati>  ??????? ????????? ??46*[config]
filipe at digirati>  ??????? ????????? ??1212*[imap]
filipe at digirati>  ??????? ????????? ??155*[imap-login]
filipe at digirati>  ??????? ????????? ??12*[lmtp]
filipe at digirati>  ??????? ????????? ??38*[log]
filipe at digirati>  ??????? ????????? ??10*[managesieve]
filipe at digirati>  ??????? ????????? ??19*[pop3]
filipe at digirati>  ??????? ????????? ??3*[pop3-login]
filipe at digirati>  ??????? ????????? ??18*[stats]


filipe at digirati> root?????? 45831? 0.0? 1.1 774688 752732 ??????? S???
09:31 0:31
filipe at digirati> dovecot/config
filipe at digirati> root????? 388792? 0.0? 1.1 775060 753276 ??????? S???
14:00?? 0:15
filipe at digirati> dovecot/config
filipe at digirati> root????? 510685? 0.0? 1.1 775384 753604 ??????? S???
15:06?? 0:20
filipe at digirati> dovecot/config
filipe at digirati> root????? 675638? 0.0? 1.1 775348 753620 ??????? S???
16:56?? 0:15
filipe at digirati> dovecot/config
filipe at digirati> root????? 795375? 0.0? 1.1 775460 753516 ??????? S???
18:03?? 0:07
filipe at digirati> dovecot/config
filipe at digirati> root????? 798754? 0.2? 1.1 775592 753712 ??????? S???
18:05?? 0:30
filipe at digirati> dovecot/config
filipe at digirati> root???? 1082696? 0.2? 1.1 774892 753216 ??????? S???
21:10?? 0:07
filipe at digirati> dovecot/config
filipe at digirati> root???? 1098433? 0.4? 1.1 774924 753244 ??????? S???
21:33?? 0:07
filipe at digirati> dovecot/config
filipe at digirati> root???? 1109255? 0.9? 1.1 774924 753344 ??????? S???
21:50?? 0:07
filipe at digirati> dovecot/config
filipe at digirati> root???? 1112976? 2.0? 1.1 774956 753528 ??????? S???
21:57?? 0:07
filipe at digirati> dovecot/config
filipe at digirati> root???? 1114137? 3.0? 1.1 775028 753308 ??????? S???
21:59?? 0:07
filipe at digirati> dovecot/config
filipe at digirati> root???? 1115382? 5.4? 1.1 774924 753496 ??????? S???
22:01?? 0:06
filipe at digirati> dovecot/config
filipe at digirati> root???? 1883627? 0.0? 1.1 759120 728832 ??????? S???
Aug11?? 0:07
filipe at digirati> dovecot/config
filipe at digirati> root???? 1889705? 0.0? 1.8 1251460 1221872 ????? S???
Aug11?? 0:11
filipe at digirati> dovecot/config
filipe at digirati> root???? 1895022? 0.0? 1.8 1253280 1224284 ????? S???
Aug11?? 0:11
filipe at digirati> dovecot/config
filipe at digirati> root???? 1900690? 0.0? 1.8 1255684 1227528 ????? S???
Aug11?? 0:12
filipe at digirati> dovecot/config
filipe at digirati> root???? 1905648? 0.0? 1.8 1257880 1229912 ????? S???
Aug11?? 0:12
filipe at digirati> dovecot/config
filipe at digirati> root???? 1910857? 0.0? 1.8 1259156 1231552 ????? S???
Aug11?? 0:12
filipe at digirati> dovecot/config
filipe at digirati> root???? 1914332? 0.0? 1.1 764328 736552 ??????? S???
Aug11?? 0:20
filipe at digirati> dovecot/config
filipe at digirati> root???? 2343896? 0.0? 1.8 1259472 1231516 ????? S???
Aug11?? 0:12
filipe at digirati> dovecot/config
filipe at digirati> root???? 2346351? 0.0? 1.8 1259472 1231836 ????? S???
Aug11?? 0:13
filipe at digirati> dovecot/config
filipe at digirati> root???? 2348559? 0.0? 1.1 764704 736440 ??????? S???
Aug11?? 0:14
filipe at digirati> dovecot/config
filipe at digirati> root???? 2445701? 0.0? 1.1 764276 736540 ??????? S???
Aug11?? 0:19
filipe at digirati> dovecot/config
filipe at digirati> root???? 2572525? 0.0? 1.1 764640 736880 ??????? S???
Aug11?? 0:18
filipe at digirati> dovecot/config
filipe at digirati> root???? 2734251? 0.0? 1.1 764776 737696 ??????? S???
Aug11?? 0:08
filipe at digirati> dovecot/config
filipe at digirati> root???? 2740980? 0.0? 1.1 764768 737244 ??????? S???
Aug11?? 0:17
filipe at digirati> dovecot/config
filipe at digirati> root???? 2899925? 0.0? 1.1 764624 737760 ??????? S???
Aug11?? 0:43
filipe at digirati> dovecot/config
filipe at digirati> root???? 3517063? 0.0? 1.1 764984 738004 ??????? S???
Aug11?? 0:09
filipe at digirati> dovecot/config
filipe at digirati> root???? 3541465? 0.0? 1.1 765224 738756 ??????? S???
Aug11?? 0:07
filipe at digirati> dovecot/config
filipe at digirati> root???? 3545589? 0.0? 1.1 766452 740408 ??????? S???
Aug11?? 0:06
filipe at digirati> dovecot/config
filipe at digirati> root???? 3549259? 0.0? 1.1 766796 741048 ??????? S???
Aug11?? 0:07
filipe at digirati> dovecot/config
filipe at digirati> root???? 3553902? 0.0? 1.1 767812 742284 ??????? S???
Aug11?? 0:07
filipe at digirati> dovecot/config
filipe at digirati> root???? 3558080? 0.0? 1.1 768440 743524 ??????? S???
Aug11?? 0:08
filipe at digirati> dovecot/config
filipe at digirati> root???? 3562091? 0.0? 1.1 769224 744424 ??????? S???
Aug11?? 0:07
filipe at digirati> dovecot/config
filipe at digirati> root???? 3568721? 0.0? 1.1 769388 744888 ??????? S???
Aug11?? 0:07
filipe at digirati> dovecot/config
filipe at digirati> root???? 3573024? 0.0? 1.1 770048 745904 ??????? S???
Aug11?? 0:08
filipe at digirati> dovecot/config
filipe at digirati> root???? 3578416? 0.0? 1.1 770836 746736 ??????? S???
Aug11?? 0:06
filipe at digirati> dovecot/config
filipe at digirati> root???? 3581765? 0.0? 1.1 771948 748492 ??????? S???
Aug11?? 0:06
filipe at digirati> dovecot/config
filipe at digirati> root???? 3585837? 0.0? 1.1 772828 749860 ??????? S???
Aug11?? 0:07
filipe at digirati> dovecot/config
filipe at digirati> root???? 3590276? 0.0? 1.1 773560 750520 ??????? S???
Aug11?? 0:07
filipe at digirati> dovecot/config
filipe at digirati> root???? 3594640? 0.0? 1.1 774612 752552 ??????? S???
Aug11?? 0:08
filipe at digirati> dovecot/config
filipe at digirati> root???? 3597417? 0.0? 1.1 774968 753076 ??????? S???
Aug11?? 0:35
filipe at digirati> dovecot/config
filipe at digirati> root???? 4116314? 0.0? 1.9 1280496 1258580 ????? S???
05:31?? 0:13
filipe at digirati> dovecot/config
filipe at digirati> root???? 4118115? 0.0? 1.1 774688 752556 ??????? S???
05:33?? 0:16
filipe at digirati> dovecot/config

filipe at digirati.com.br

2022-Aug-15 14:28 UTC

head link

dovecot/config processes open, and consuming all memory

Hello,
I tested the suggestion to decrease the service_count and the accounts 
stopped logging in, then I gradually increased it to 500, and now it's 
working. But the dovecot/config processes are still being created, there 
has been no change for the better.
Now I have an error constantly appearing in the mail.err file

Aug 15 14:19:34 box6 dovecot: imap(USER_NAME): Error: Error reading 
configuration: read(/run/dovecot/config) failed: read(size=8192) failed: 
Interrupted system call - Also failed to read config by executing 
doveconf: /run/dovecot/config is a UNIX socket (path is from CONFIG_FILE 
environment)
Aug 15 14:19:34 box6 dovecot: imap(USER_NAME): Error: Error reading 
configuration: read(/run/dovecot/config) failed: read(size=8192) failed: 
Interrupted system call - Also failed to read config by executing 
doveconf: /run/dovecot/config is a UNIX socket (path is from CONFIG_FILE 
environment)
Aug 15 14:19:34 box6 dovecot: imap(USER_NAME): Error: Error reading 
configuration: read(/run/dovecot/config) failed: read(size=8192) failed: 
Interrupted system call - Also failed to read config by executing 
doveconf: /run/dovecot/config is a UNIX socket (path is from CONFIG_FILE 
environment)

On 14/08/2022 22:24, John Stoffel wrote:>>>>>> "filipe at digirati" == filipe at digirati
com br <filipe at digirati.com.br> writes:
> filipe at digirati> I'm having strange behavior in dovecot 2.3.16.
> filipe at digirati> It's opening dozens of dovecot/config process
and consuming all server
> filipe at digirati> memory. Normally each process consumes between 700Mb
and 1Gb of ram.
>
> filipe at digirati> Would anyone have an idea about this?
>
> filipe at digirati> service config {
> filipe at digirati>  ? vsz_limit = 2048M
> filipe at digirati>  ? idle_kill = 60s
> filipe at digirati>  ? service_count = 1024
> filipe at digirati> }
>
> I wonder why you have the service count so high?  I'd drop it down, or
> do you really have 1025 connections in 60 seconds?
>
>  From the docs:
>
>
>       service_count
>
>       Number of client connections to handle until the process kills
>       itself. 0 means unlimited. 1 means only a single connection is
handled
>       until the process is stopped - this is the most secure choice since
>       there?s no way for one connection?s state to leak to the next one.
For
>       better performance this can be set higher, but ideally not unlimited
>       since more complex services can have small memory leaks and/or memory
>       fragmentation and the process should get restarted eventually. For
>       example 100..1000 can be good values.
>
> So maybe drop it down to 100 for now and see how that works for you.
>
>
> filipe at digirati> pstree
> filipe at digirati> systemd???ModemManager???2*[{ModemManager}]
> filipe at digirati>  ??????? ??agetty
> filipe at digirati>  ??????? ??cron
> filipe at digirati>  ??????? ??dbus-daemon
> filipe at digirati>  ??????? ??dovecot???anvil
> filipe at digirati>  ??????? ????????? ??6*[auth]
> filipe at digirati>  ??????? ????????? ??46*[config]
> filipe at digirati>  ??????? ????????? ??1212*[imap]
> filipe at digirati>  ??????? ????????? ??155*[imap-login]
> filipe at digirati>  ??????? ????????? ??12*[lmtp]
> filipe at digirati>  ??????? ????????? ??38*[log]
> filipe at digirati>  ??????? ????????? ??10*[managesieve]
> filipe at digirati>  ??????? ????????? ??19*[pop3]
> filipe at digirati>  ??????? ????????? ??3*[pop3-login]
> filipe at digirati>  ??????? ????????? ??18*[stats]
>
>
> filipe at digirati> root?????? 45831? 0.0? 1.1 774688 752732 ???????
S??? 09:31 0:31
> filipe at digirati> dovecot/config
> filipe at digirati> root????? 388792? 0.0? 1.1 775060 753276 ???????
S??? 14:00?? 0:15
> filipe at digirati> dovecot/config
> filipe at digirati> root????? 510685? 0.0? 1.1 775384 753604 ???????
S??? 15:06?? 0:20
> filipe at digirati> dovecot/config
> filipe at digirati> root????? 675638? 0.0? 1.1 775348 753620 ???????
S??? 16:56?? 0:15
> filipe at digirati> dovecot/config
> filipe at digirati> root????? 795375? 0.0? 1.1 775460 753516 ???????
S??? 18:03?? 0:07
> filipe at digirati> dovecot/config
> filipe at digirati> root????? 798754? 0.2? 1.1 775592 753712 ???????
S??? 18:05?? 0:30
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 1082696? 0.2? 1.1 774892 753216 ???????
S??? 21:10?? 0:07
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 1098433? 0.4? 1.1 774924 753244 ???????
S??? 21:33?? 0:07
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 1109255? 0.9? 1.1 774924 753344 ???????
S??? 21:50?? 0:07
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 1112976? 2.0? 1.1 774956 753528 ???????
S??? 21:57?? 0:07
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 1114137? 3.0? 1.1 775028 753308 ???????
S??? 21:59?? 0:07
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 1115382? 5.4? 1.1 774924 753496 ???????
S??? 22:01?? 0:06
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 1883627? 0.0? 1.1 759120 728832 ???????
S??? Aug11?? 0:07
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 1889705? 0.0? 1.8 1251460 1221872 ?????
S??? Aug11?? 0:11
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 1895022? 0.0? 1.8 1253280 1224284 ?????
S??? Aug11?? 0:11
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 1900690? 0.0? 1.8 1255684 1227528 ?????
S??? Aug11?? 0:12
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 1905648? 0.0? 1.8 1257880 1229912 ?????
S??? Aug11?? 0:12
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 1910857? 0.0? 1.8 1259156 1231552 ?????
S??? Aug11?? 0:12
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 1914332? 0.0? 1.1 764328 736552 ???????
S??? Aug11?? 0:20
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 2343896? 0.0? 1.8 1259472 1231516 ?????
S??? Aug11?? 0:12
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 2346351? 0.0? 1.8 1259472 1231836 ?????
S??? Aug11?? 0:13
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 2348559? 0.0? 1.1 764704 736440 ???????
S??? Aug11?? 0:14
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 2445701? 0.0? 1.1 764276 736540 ???????
S??? Aug11?? 0:19
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 2572525? 0.0? 1.1 764640 736880 ???????
S??? Aug11?? 0:18
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 2734251? 0.0? 1.1 764776 737696 ???????
S??? Aug11?? 0:08
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 2740980? 0.0? 1.1 764768 737244 ???????
S??? Aug11?? 0:17
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 2899925? 0.0? 1.1 764624 737760 ???????
S??? Aug11?? 0:43
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 3517063? 0.0? 1.1 764984 738004 ???????
S??? Aug11?? 0:09
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 3541465? 0.0? 1.1 765224 738756 ???????
S??? Aug11?? 0:07
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 3545589? 0.0? 1.1 766452 740408 ???????
S??? Aug11?? 0:06
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 3549259? 0.0? 1.1 766796 741048 ???????
S??? Aug11?? 0:07
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 3553902? 0.0? 1.1 767812 742284 ???????
S??? Aug11?? 0:07
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 3558080? 0.0? 1.1 768440 743524 ???????
S??? Aug11?? 0:08
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 3562091? 0.0? 1.1 769224 744424 ???????
S??? Aug11?? 0:07
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 3568721? 0.0? 1.1 769388 744888 ???????
S??? Aug11?? 0:07
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 3573024? 0.0? 1.1 770048 745904 ???????
S??? Aug11?? 0:08
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 3578416? 0.0? 1.1 770836 746736 ???????
S??? Aug11?? 0:06
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 3581765? 0.0? 1.1 771948 748492 ???????
S??? Aug11?? 0:06
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 3585837? 0.0? 1.1 772828 749860 ???????
S??? Aug11?? 0:07
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 3590276? 0.0? 1.1 773560 750520 ???????
S??? Aug11?? 0:07
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 3594640? 0.0? 1.1 774612 752552 ???????
S??? Aug11?? 0:08
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 3597417? 0.0? 1.1 774968 753076 ???????
S??? Aug11?? 0:35
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 4116314? 0.0? 1.9 1280496 1258580 ?????
S??? 05:31?? 0:13
> filipe at digirati> dovecot/config
> filipe at digirati> root???? 4118115? 0.0? 1.1 774688 752556 ???????
S??? 05:33?? 0:16
> filipe at digirati> dovecot/config
>

dovecot - Aug 2022 - dovecot/config processes open, and consuming all memory

dovecot/config processes open, and consuming all memory

dovecot/config processes open, and consuming all memory