thr3ads.net - dovecot - Btrfs RAID-10 performance [Sep 2020]

If this information is useful, please help other people find it:
Share via:

Miloslav Hůla

2020-Sep-07 12:16 UTC

Btrfs RAID-10 performance

Dne 07.09.2020 v 12:43 Sami Ketola napsal(a):>> On 7. Sep 2020, at 12.38, Miloslav H?la <miloslav.hula at
gmail.com> wrote:
>>
>> Hello,
>>
>> I sent this into the Linux Kernel Btrfs mailing list and I got reply:
"RAID-1 would be preferable"
(https://lore.kernel.org/linux-btrfs/7b364356-7041-7d18-bd77-f60e0e2e2112 at
lechevalier.se/T/). May I ask you for the comments as from people around the
Dovecot?
>>
>>
>> We are using btrfs RAID-10 (/data, 4.7TB) on a physical Supermicro
server with Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz and 125GB of RAM. We run
'btrfs scrub start -B -d /data' every Sunday as a cron task. It takes
about 50 minutes to finish.
>>
>> # uname -a
>> Linux imap 4.9.0-12-amd64 #1 SMP Debian 4.9.210-1 (2020-01-20) x86_64
GNU/Linux
>>
>> RAID is a composition of 16 harddrives. Harddrives are connected via
AVAGO MegaRAID SAS 9361-8i as a RAID-0 devices. All harddrives are SAS 2.5"
15k drives.
>>
>> Server serves as a IMAP with Dovecot 2.2.27-3+deb9u6, 4104 accounts,
Mailbox format, LMTP delivery.
> 
> does "Mailbox format" mean mbox?
> 
> If so, then there is your bottleneck. mbox is the slowest possible mailbox
format there is.
> 
> Sami
Sorry, no, it is a typo. We are using "Maildir".

"doveconf -a" attached

Milo


# 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf
# Pigeonhole version 0.4.16 (fed8554)
# OS: Linux 4.9.0-12-amd64 x86_64 Debian 9.13
# NOTE: Send doveconf -n output instead when asking for help.
auth_anonymous_username = anonymous
auth_cache_negative_ttl = 30 secs
auth_cache_size = 100 M
auth_cache_ttl = 30 secs
auth_debug = no
auth_debug_passwords = no
auth_default_realm auth_failure_delay = 2 secs
auth_gssapi_hostname auth_krb5_keytab auth_master_user_separator auth_mechanisms
= plain
auth_policy_hash_mech = sha256
auth_policy_hash_nonce auth_policy_hash_truncate = 12
auth_policy_reject_on_fail = no
auth_policy_request_attributes = login=%{orig_username} 
pwhash=%{hashed_password} remote=%{real_rip}
auth_policy_server_api_header auth_policy_server_timeout_msecs = 2000
auth_policy_server_url auth_proxy_self auth_realms auth_socket_path =
auth-userdb
auth_ssl_require_client_cert = no
auth_ssl_username_from_cert = no
auth_stats = no
auth_use_winbind = no
auth_username_chars = 
abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@
auth_username_format = %Lu
auth_username_translation auth_verbose = no
auth_verbose_passwords = no
auth_winbind_helper_path = /usr/bin/ntlm_auth
auth_worker_max_count = 30
base_dir = /var/run/dovecot
config_cache_size = 1 M
debug_log_path default_client_limit = 1000
default_idle_kill = 1 mins
default_internal_user = dovecot
default_login_user = dovenull
default_process_limit = 100
default_vsz_limit = 256 M
deliver_log_format = msgid=%m: %$
dict_db_config director_consistent_hashing = no
director_doveadm_port = 0
director_flush_socket director_mail_servers director_servers
director_user_expire = 15 mins
director_user_kick_delay = 2 secs
director_username_hash = %u
disable_plaintext_auth = yes
dotlock_use_excl = yes
doveadm_allowed_commands doveadm_api_key doveadm_password doveadm_port = 0
doveadm_socket_path = doveadm-server
doveadm_username = doveadm
doveadm_worker_count = 0
dsync_alt_char = _
dsync_features dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server
-u%u -U
first_valid_gid = 1
first_valid_uid = 109
haproxy_timeout = 3 secs
haproxy_trusted_networks hostname imap_capability imap_client_workarounds
imap_hibernate_timeout = 0
imap_id_log = *
imap_id_send = name *
imap_idle_notify_interval = 2 mins
imap_logout_format = in=%i out=%o
imap_max_line_length = 64 k
imap_metadata = no
imap_urlauth_host imap_urlauth_logout_format = in=%i out=%o
imap_urlauth_port = 143
imapc_cmd_timeout = 5 mins
imapc_features imapc_host imapc_list_prefix imapc_master_user
imapc_max_idle_time = 29 mins
imapc_max_line_length = 0
imapc_password imapc_port = 143
imapc_rawlog_dir imapc_sasl_mechanisms imapc_ssl = no
imapc_ssl_verify = yes
imapc_user import_environment = TZ CORE_OUTOFMEM CORE_ERROR LISTEN_PID
LISTEN_FDS
info_log_path instance_name = dovecot
last_valid_gid = 0
last_valid_uid = 0
lda_mailbox_autocreate = no
lda_mailbox_autosubscribe = no
lda_original_recipient_header libexec_dir = /usr/lib/dovecot
listen = *, ::
lmtp_address_translate lmtp_hdr_delivery_address = final
lmtp_proxy = no
lmtp_rcpt_check_quota = no
lmtp_save_to_detail_mailbox = no
lmtp_user_concurrency_limit = 0
lock_method = fcntl
log_path = syslog
log_timestamp = "%b %d %H:%M:%S "
login_access_sockets login_greeting = Dovecot ready.
login_log_format = %$: %s
login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c 
session=<%{session}>
login_plugin_dir = /usr/lib/dovecot/modules/login
login_plugins login_proxy_max_disconnect_delay = 0
login_source_ips login_trusted_networks mail_access_groups
mail_always_cache_fields mail_attachment_dir mail_attachment_fs = sis posix
mail_attachment_hash = %{sha1}
mail_attachment_min_size = 128 k
mail_attribute_dict mail_cache_fields = flags
mail_cache_min_mail_count = 0
mail_chroot mail_debug = no
mail_fsync = optimized
mail_full_filesystem_access = no
mail_gid = vmail
mail_home = /data/vmail/user/%n
mail_location = maildir:/data/vmail/user/%n/Maildir
mail_log_prefix = "%s(%u): "
mail_max_keyword_length = 50
mail_max_lock_timeout = 0
mail_max_userip_connections = 10
mail_never_cache_fields = imap.envelope
mail_nfs_index = no
mail_nfs_storage = no
mail_plugin_dir = /usr/lib/dovecot/modules
mail_plugins mail_prefetch_count = 0
mail_privileged_group mail_save_crlf = yes
mail_server_admin mail_server_comment mail_shared_explicit_inbox = no
mail_temp_dir = /tmp
mail_temp_scan_interval = 1 weeks
mail_uid = vmail
mailbox_idle_check_interval = 30 secs
mailbox_list_index = no
mailbox_list_index_very_dirty_syncs = no
maildir_broken_filename_sizes = no
maildir_copy_with_hardlinks = yes
maildir_empty_new = no
maildir_stat_dirs = no
maildir_very_dirty_syncs = no
managesieve_client_workarounds managesieve_implementation_string = Dovecot
Pigeonhole
managesieve_logout_format = bytes=%i/%o
managesieve_max_compile_errors = 5
managesieve_max_line_length = 65536
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope 
encoded-character vacation subaddress comparator-i;ascii-numeric 
relational regex copy include variables body enotify environment mailbox 
date index ihave duplicate mime foreverypart extracttext 
vacation-seconds imapflags notify
master_user_separator mbox_dirty_syncs = yes
mbox_dotlock_change_timeout = 2 mins
mbox_lazy_writes = yes
mbox_lock_timeout = 5 mins
mbox_md5 = apop3d
mbox_min_index_size = 0
mbox_read_locks = fcntl
mbox_very_dirty_syncs = no
mbox_write_locks = fcntl dotlock
mdbox_preallocate_space = no
mdbox_purge_preserve_alt = no
mdbox_rotate_interval = 0
mdbox_rotate_size = 2 M
mmap_disable = no
namespace {
   disabled = no
   hidden = no
   ignore_on_failure = no
   inbox = no
   list = children
   location = 
maildir:/data/vmail/user/%%n/Maildir:INDEXPVT=/data/vmail/user/%n/Maildir/Shared/%%n:SUBSCRIPTIONS=../../%n/Maildir/Shared/subscriptions-%%n
   order = 0
   prefix = user.%%n.
   separator = .
   subscriptions = yes
   type = shared
}
namespace inbox {
   disabled = no
   hidden = no
   ignore_on_failure = no
   inbox = yes
   list = yes
   location    mailbox Archives {
     auto = no
     autoexpunge = 0
     autoexpunge_max_mails = 0
     comment      driver      special_use = \Archive
   }
   mailbox Drafts {
     auto = subscribe
     autoexpunge = 0
     autoexpunge_max_mails = 0
     comment      driver      special_use = \Drafts
   }
   mailbox Junk {
     auto = no
     autoexpunge = 0
     autoexpunge_max_mails = 0
     comment      driver      special_use = \Junk
   }
   mailbox Sent {
     auto = subscribe
     autoexpunge = 0
     autoexpunge_max_mails = 0
     comment      driver      special_use = \Sent
   }
   mailbox "Sent Messages" {
     auto = no
     autoexpunge = 0
     autoexpunge_max_mails = 0
     comment      driver      special_use = \Sent
   }
   mailbox Trash {
     auto = subscribe
     autoexpunge = 0
     autoexpunge_max_mails = 0
     comment      driver      special_use = \Trash
   }
   mailbox spam {
     auto = subscribe
     autoexpunge = 0
     autoexpunge_max_mails = 0
     comment      driver      special_use = \Junk
   }
   order = 0
   prefix = INBOX.
   separator = .
   subscriptions = yes
   type = private
}
passdb {
   args = /etc/dovecot/deny-users
   auth_verbose = default
   default_fields    deny = yes
   driver = passwd-file
   master = no
   name    override_fields    pass = no
   result_failure = continue
   result_internalfail = continue
   result_success = return-ok
   skip = never
}
passdb {
   args = /etc/dovecot/dovecot-ldap.conf.ext
   auth_verbose = default
   default_fields    deny = no
   driver = ldap
   master = no
   name    override_fields    pass = no
   result_failure = continue
   result_internalfail = continue
   result_success = return-ok
   skip = never
}
plugin {
   acl = vfile
   acl_shared_dict = file:/data/vmail/global/shared-mailboxes
   sieve = 
file:/data/vmail/user/%n/sieve;active=/data/vmail/user/%n/enabled.sieve
   sieve_extensions = +notify +imapflags -imap4flags +vacation-seconds
   sieve_vacation_min_period = 0
}
pop3_client_workarounds pop3_delete_type = default
pop3_deleted_flag pop3_enable_last = no
pop3_fast_size_lookups = no
pop3_lock_session = no
pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s
pop3_no_flag_updates = no
pop3_reuse_xuidl = no
pop3_save_uidl = no
pop3_uidl_duplicates = allow
pop3_uidl_format = %v.%u
pop3c_host pop3c_master_user pop3c_password pop3c_port = 110
pop3c_quick_received_date = no
pop3c_rawlog_dir pop3c_ssl = no
pop3c_ssl_verify = yes
pop3c_user = %u
postmaster_address = postmaster@%d
protocols = " imap lmtp sieve pop3"
quota_full_tempfail = no
rawlog_dir recipient_delimiter = +
rejection_reason = Your message to <%t> was automatically rejected:%n%r
rejection_subject = Rejected: %s
replication_dsync_parameters = -d -N -l 30 -U
replication_full_sync_interval = 1 days
replication_max_conns = 10
replicator_host = replicator
replicator_port = 0
sendmail_path = /usr/sbin/sendmail
service aggregator {
   chroot = .
   client_limit = 0
   drop_priv_before_exec = no
   executable = aggregator
   extra_groups    fifo_listener replication-notify-fifo {
     group      mode = 0600
     user    }
   group    idle_kill = 0
   privileged_group    process_limit = 0
   process_min_avail = 0
   protocol    service_count = 0
   type    unix_listener replication-notify {
     group      mode = 0600
     user    }
   user = $default_internal_user
   vsz_limit = 18446744073709551615 B
}
service anvil {
   chroot = empty
   client_limit = 0
   drop_priv_before_exec = no
   executable = anvil
   extra_groups    group    idle_kill = 4294967295 secs
   privileged_group    process_limit = 1
   process_min_avail = 1
   protocol    service_count = 0
   type = anvil
   unix_listener anvil-auth-penalty {
     group      mode = 0600
     user    }
   unix_listener anvil {
     group      mode = 0600
     user    }
   user = $default_internal_user
   vsz_limit = 18446744073709551615 B
}
service auth-worker {
   chroot    client_limit = 1
   drop_priv_before_exec = no
   executable = auth -w
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 0
   process_min_avail = 0
   protocol    service_count = 1
   type    unix_listener auth-worker {
     group      mode = 0600
     user = $default_internal_user
   }
   user    vsz_limit = 18446744073709551615 B
}
service auth {
   chroot    client_limit = 0
   drop_priv_before_exec = no
   executable = auth
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 1
   process_min_avail = 0
   protocol    service_count = 0
   type    unix_listener auth-client {
     group      mode = 0600
     user = $default_internal_user
   }
   unix_listener auth-login {
     group      mode = 0600
     user = $default_internal_user
   }
   unix_listener auth-master {
     group      mode = 0600
     user    }
   unix_listener auth-userdb {
     group      mode = 0666
     user = $default_internal_user
   }
   unix_listener login/login {
     group      mode = 0666
     user    }
   unix_listener token-login/tokenlogin {
     group      mode = 0666
     user    }
   user = $default_internal_user
   vsz_limit = 18446744073709551615 B
}
service config {
   chroot    client_limit = 0
   drop_priv_before_exec = no
   executable = config
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 0
   process_min_avail = 0
   protocol    service_count = 0
   type = config
   unix_listener config {
     group      mode = 0600
     user    }
   user    vsz_limit = 18446744073709551615 B
}
service dict-async {
   chroot    client_limit = 0
   drop_priv_before_exec = no
   executable = dict
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 0
   process_min_avail = 0
   protocol    service_count = 0
   type    unix_listener dict-async {
     group      mode = 0600
     user    }
   user = $default_internal_user
   vsz_limit = 18446744073709551615 B
}
service dict {
   chroot    client_limit = 1
   drop_priv_before_exec = no
   executable = dict
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 0
   process_min_avail = 0
   protocol    service_count = 0
   type    unix_listener dict {
     group      mode = 0600
     user    }
   user = $default_internal_user
   vsz_limit = 18446744073709551615 B
}
service director {
   chroot = .
   client_limit = 0
   drop_priv_before_exec = no
   executable = director
   extra_groups    fifo_listener login/proxy-notify {
     group      mode = 00
     user    }
   group    idle_kill = 4294967295 secs
   inet_listener {
     address      haproxy = no
     port = 0
     reuse_port = no
     ssl = no
   }
   privileged_group    process_limit = 1
   process_min_avail = 0
   protocol    service_count = 0
   type    unix_listener director-admin {
     group      mode = 0600
     user    }
   unix_listener director-userdb {
     group      mode = 0600
     user    }
   unix_listener login/director {
     group      mode = 00
     user    }
   user = $default_internal_user
   vsz_limit = 18446744073709551615 B
}
service dns_client {
   chroot    client_limit = 1
   drop_priv_before_exec = no
   executable = dns-client
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 0
   process_min_avail = 0
   protocol    service_count = 0
   type    unix_listener dns-client {
     group      mode = 0666
     user    }
   user = $default_internal_user
   vsz_limit = 18446744073709551615 B
}
service doveadm {
   chroot    client_limit = 1
   drop_priv_before_exec = no
   executable = doveadm-server
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 0
   process_min_avail = 0
   protocol    service_count = 1
   type    unix_listener doveadm-server {
     group      mode = 0600
     user    }
   user    vsz_limit = 18446744073709551615 B
}
service imap-hibernate {
   chroot    client_limit = 0
   drop_priv_before_exec = no
   executable = imap-hibernate
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 0
   process_min_avail = 0
   protocol = imap
   service_count = 0
   type    unix_listener imap-hibernate {
     group      mode = 0600
     user    }
   user = $default_internal_user
   vsz_limit = 18446744073709551615 B
}
service imap-login {
   chroot = login
   client_limit = 0
   drop_priv_before_exec = no
   executable = imap-login
   extra_groups    group    idle_kill = 0
   inet_listener imap {
     address      haproxy = no
     port = 143
     reuse_port = no
     ssl = no
   }
   inet_listener imaps {
     address      haproxy = no
     port = 993
     reuse_port = no
     ssl = yes
   }
   privileged_group    process_limit = 0
   process_min_avail = 10
   protocol = imap
   service_count = 0
   type = login
   user = $default_login_user
   vsz_limit = 18446744073709551615 B
}
service imap-urlauth-login {
   chroot = token-login
   client_limit = 0
   drop_priv_before_exec = no
   executable = imap-urlauth-login
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 0
   process_min_avail = 0
   protocol = imap
   service_count = 1
   type = login
   unix_listener imap-urlauth {
     group      mode = 0666
     user    }
   user = $default_login_user
   vsz_limit = 18446744073709551615 B
}
service imap-urlauth-worker {
   chroot    client_limit = 1
   drop_priv_before_exec = no
   executable = imap-urlauth-worker
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 1024
   process_min_avail = 0
   protocol = imap
   service_count = 1
   type    unix_listener imap-urlauth-worker {
     group      mode = 0600
     user = $default_internal_user
   }
   user    vsz_limit = 18446744073709551615 B
}
service imap-urlauth {
   chroot    client_limit = 1
   drop_priv_before_exec = no
   executable = imap-urlauth
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 1024
   process_min_avail = 0
   protocol = imap
   service_count = 1
   type    unix_listener token-login/imap-urlauth {
     group      mode = 0666
     user    }
   user = $default_internal_user
   vsz_limit = 18446744073709551615 B
}
service imap {
   chroot    client_limit = 1
   drop_priv_before_exec = no
   executable = imap
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 2048
   process_min_avail = 0
   protocol = imap
   service_count = 1
   type    unix_listener imap-master {
     group      mode = 0600
     user    }
   unix_listener login/imap {
     group      mode = 0666
     user    }
   user    vsz_limit = 18446744073709551615 B
}
service indexer-worker {
   chroot    client_limit = 1
   drop_priv_before_exec = no
   executable = indexer-worker
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 10
   process_min_avail = 0
   protocol    service_count = 0
   type    unix_listener indexer-worker {
     group      mode = 0600
     user = $default_internal_user
   }
   user    vsz_limit = 18446744073709551615 B
}
service indexer {
   chroot    client_limit = 0
   drop_priv_before_exec = no
   executable = indexer
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 1
   process_min_avail = 0
   protocol    service_count = 0
   type    unix_listener indexer {
     group      mode = 0666
     user    }
   user = $default_internal_user
   vsz_limit = 18446744073709551615 B
}
service ipc {
   chroot = empty
   client_limit = 0
   drop_priv_before_exec = no
   executable = ipc
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 1
   process_min_avail = 0
   protocol    service_count = 0
   type    unix_listener ipc {
     group      mode = 0600
     user    }
   unix_listener login/ipc-proxy {
     group      mode = 0600
     user = $default_login_user
   }
   user = $default_internal_user
   vsz_limit = 18446744073709551615 B
}
service lmtp {
   chroot    client_limit = 1
   drop_priv_before_exec = no
   executable = lmtp
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 120
   process_min_avail = 15
   protocol = lmtp
   service_count = 0
   type    unix_listener /var/spool/postfix/private/dovecot-lmtp {
     group = postfix
     mode = 0600
     user = postfix
   }
   unix_listener lmtp {
     group      mode = 0666
     user    }
   user = vmail
   vsz_limit = 18446744073709551615 B
}
service log {
   chroot    client_limit = 0
   drop_priv_before_exec = no
   executable = log
   extra_groups    group    idle_kill = 4294967295 secs
   privileged_group    process_limit = 1
   process_min_avail = 0
   protocol    service_count = 0
   type = log
   unix_listener log-errors {
     group      mode = 0600
     user    }
   user    vsz_limit = 18446744073709551615 B
}
service managesieve-login {
   chroot = login
   client_limit = 0
   drop_priv_before_exec = no
   executable = managesieve-login
   extra_groups    group    idle_kill = 0
   inet_listener sieve {
     address = 127.0.0.1
     haproxy = no
     port = 4190
     reuse_port = no
     ssl = no
   }
   privileged_group    process_limit = 0
   process_min_avail = 0
   protocol = sieve
   service_count = 1
   type = login
   user = $default_login_user
   vsz_limit = 18446744073709551615 B
}
service managesieve {
   chroot    client_limit = 1
   drop_priv_before_exec = no
   executable = managesieve
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 0
   process_min_avail = 0
   protocol = sieve
   service_count = 1
   type    unix_listener login/sieve {
     group      mode = 0666
     user    }
   user    vsz_limit = 18446744073709551615 B
}
service pop3-login {
   chroot = login
   client_limit = 0
   drop_priv_before_exec = no
   executable = pop3-login
   extra_groups    group    idle_kill = 0
   inet_listener pop3 {
     address      haproxy = no
     port = 110
     reuse_port = no
     ssl = no
   }
   inet_listener pop3s {
     address      haproxy = no
     port = 995
     reuse_port = no
     ssl = yes
   }
   privileged_group    process_limit = 0
   process_min_avail = 0
   protocol = pop3
   service_count = 1
   type = login
   user = $default_login_user
   vsz_limit = 18446744073709551615 B
}
service pop3 {
   chroot    client_limit = 1
   drop_priv_before_exec = no
   executable = pop3
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 1024
   process_min_avail = 0
   protocol = pop3
   service_count = 1
   type    unix_listener login/pop3 {
     group      mode = 0666
     user    }
   user    vsz_limit = 18446744073709551615 B
}
service replicator {
   chroot    client_limit = 0
   drop_priv_before_exec = no
   executable = replicator
   extra_groups    group    idle_kill = 4294967295 secs
   privileged_group    process_limit = 1
   process_min_avail = 0
   protocol    service_count = 0
   type    unix_listener replicator-doveadm {
     group      mode = 00
     user = $default_internal_user
   }
   unix_listener replicator {
     group      mode = 0600
     user = $default_internal_user
   }
   user    vsz_limit = 18446744073709551615 B
}
service ssl-params {
   chroot    client_limit = 0
   drop_priv_before_exec = no
   executable = ssl-params
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 0
   process_min_avail = 0
   protocol    service_count = 0
   type = startup
   unix_listener login/ssl-params {
     group      mode = 0666
     user    }
   unix_listener ssl-params {
     group      mode = 0666
     user    }
   user    vsz_limit = 18446744073709551615 B
}
service stats {
   chroot = empty
   client_limit = 0
   drop_priv_before_exec = no
   executable = stats
   extra_groups    fifo_listener stats-mail {
     group      mode = 0600
     user    }
   fifo_listener stats-user {
     group      mode = 0600
     user    }
   group    idle_kill = 4294967295 secs
   privileged_group    process_limit = 1
   process_min_avail = 0
   protocol    service_count = 0
   type    unix_listener stats {
     group      mode = 0600
     user    }
   user = $default_internal_user
   vsz_limit = 18446744073709551615 B
}
service tcpwrap {
   chroot    client_limit = 1
   drop_priv_before_exec = no
   executable = tcpwrap
   extra_groups    group    idle_kill = 0
   privileged_group    process_limit = 0
   process_min_avail = 0
   protocol    service_count = 0
   type    user = $default_internal_user
   vsz_limit = 18446744073709551615 B
}
shutdown_clients = yes
ssl = required
ssl_ca ssl_cert = </etc/dovecot/private/imap.chained.crt
ssl_cert_username_field = commonName
ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL
ssl_client_ca_dir = /etc/ssl/certs
ssl_client_ca_file ssl_client_cert ssl_client_key ssl_crypto_device
ssl_dh_parameters_length = 1024
ssl_key =  # hidden, use -P to show it
ssl_key_password ssl_options ssl_parameters_regenerate = 0
ssl_prefer_server_ciphers = no
ssl_protocols = !SSLv3
ssl_require_crl = yes
ssl_verify_client_cert = no
state_dir = /var/lib/dovecot
stats_carbon_interval = 30 secs
stats_carbon_name stats_carbon_server stats_command_min_time = 1 mins
stats_domain_min_time = 12 hours
stats_ip_min_time = 12 hours
stats_memory_limit = 16 M
stats_session_min_time = 15 mins
stats_user_min_time = 1 hours
submission_host syslog_facility = mail
userdb {
   args = username_format=%n /data/vmail/global/users
   auth_verbose = default
   default_fields = home=/data/vmail/user/%n uid=vmail gid=vmail
   driver = passwd-file
   name    override_fields    result_failure = continue
   result_internalfail = continue
   result_success = return-ok
   skip = never
}
valid_chroot_dirs verbose_proctitle = no
verbose_ssl = no
version_ignore = no
protocol lmtp {
   mail_plugins = " sieve"
   postmaster_address = postmaster at ...
}
protocol imap {
   mail_plugins = " acl imap_acl"
}

Scott Q.

2020-Sep-07 13:24 UTC

head link

Btrfs RAID-10 performance

Here's a few tips:

1. I assume that's a 2U format -24 bays.?You only have 1 raid card
for all 24 disks ? Granted you only have 16, but usually you should
assign 1 card per 8 drives. In our standard 2U chassis we have 3 hba's
per 8 drives. Your backplane should support that.
2. Add more drives
3. Get a pci nvme ssd card and move the indexes/control/sieve files
there.?


On Monday, 07/09/2020 at 08:16 Miloslav H?la wrote:


Dne 07.09.2020 v 12:43 Sami Ketola napsal(a):>> On 7. Sep 2020, at 12.38, Miloslav H?la  wrote:
>>
>> Hello,
>>
>> I sent this into the Linux Kernel Btrfs mailing list and I gotreply: "RAID-1 would be preferable"
(https://lore.kernel.org/linux-btrfs/7b364356-7041-7d18-bd77-f60e0e2e2112 at
lechevalier.se/T/).
May I ask you for the comments as from people around the
Dovecot?>>
>>
>> We are using btrfs RAID-10 (/data, 4.7TB) on a physical Supermicroserver with Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz and 125GB of
RAM. We run 'btrfs scrub start -B -d /data' every Sunday as a cron
task. It takes about 50 minutes to finish.>>
>> # uname -a
>> Linux imap 4.9.0-12-amd64 #1 SMP Debian 4.9.210-1 (2020-01-20)
x86_64 GNU/Linux>>
>> RAID is a composition of 16 harddrives. Harddrives are connectedvia AVAGO MegaRAID SAS 9361-8i as a RAID-0 devices. All harddrives are
SAS 2.5" 15k drives.>>
>> Server serves as a IMAP with Dovecot 2.2.27-3+deb9u6, 4104
accounts, Mailbox format, LMTP delivery.> 
> does "Mailbox format" mean mbox?
> 
> If so, then there is your bottleneck. mbox is the slowest possible
mailbox format there is.> 
> Sami
Sorry, no, it is a typo. We are using "Maildir".

"doveconf -a" attached

Milo


# 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf
# Pigeonhole version 0.4.16 (fed8554)
# OS: Linux 4.9.0-12-amd64 x86_64 Debian 9.13
# NOTE: Send doveconf -n output instead when asking for help.
auth_anonymous_username = anonymous
auth_cache_negative_ttl = 30 secs
auth_cache_size = 100 M
auth_cache_ttl = 30 secs
auth_debug = no
auth_debug_passwords = no
auth_default_realm auth_failure_delay = 2 secs
auth_gssapi_hostname auth_krb5_keytab auth_master_user_separator auth_mechanisms
= plain
auth_policy_hash_mech = sha256
auth_policy_hash_nonce auth_policy_hash_truncate = 12
auth_policy_reject_on_fail = no
auth_policy_request_attributes = login=%{orig_username} 
pwhash=%{hashed_password} remote=%{real_rip}
auth_policy_server_api_header auth_policy_server_timeout_msecs = 2000
auth_policy_server_url auth_proxy_self auth_realms auth_socket_path =
auth-userdb
auth_ssl_require_client_cert = no
auth_ssl_username_from_cert = no
auth_stats = no
auth_use_winbind = no
auth_username_chars = 
abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@
auth_username_format = %Lu
auth_username_translation auth_verbose = no
auth_verbose_passwords = no
auth_winbind_helper_path = /usr/bin/ntlm_auth
auth_worker_max_count = 30
base_dir = /var/run/dovecot
config_cache_size = 1 M
debug_log_path default_client_limit = 1000
default_idle_kill = 1 mins
default_internal_user = dovecot
default_login_user = dovenull
default_process_limit = 100
default_vsz_limit = 256 M
deliver_log_format = msgid=%m: %$
dict_db_config director_consistent_hashing = no
director_doveadm_port = 0
director_flush_socket director_mail_servers director_servers
director_user_expire = 15 mins
director_user_kick_delay = 2 secs
director_username_hash = %u
disable_plaintext_auth = yes
dotlock_use_excl = yes
doveadm_allowed_commands doveadm_api_key doveadm_password doveadm_port = 0
doveadm_socket_path = doveadm-server
doveadm_username = doveadm
doveadm_worker_count = 0
dsync_alt_char = _
dsync_features dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server
-u%u -U
first_valid_gid = 1
first_valid_uid = 109
haproxy_timeout = 3 secs
haproxy_trusted_networks hostname imap_capability imap_client_workarounds
imap_hibernate_timeout = 0
imap_id_log = *
imap_id_send = name *
imap_idle_notify_interval = 2 mins
imap_logout_format = in=%i out=%o
imap_max_line_length = 64 k
imap_metadata = no
imap_urlauth_host imap_urlauth_logout_format = in=%i out=%o
imap_urlauth_port = 143
imapc_cmd_timeout = 5 mins
imapc_features imapc_host imapc_list_prefix imapc_master_user
imapc_max_idle_time = 29 mins
imapc_max_line_length = 0
imapc_password imapc_port = 143
imapc_rawlog_dir imapc_sasl_mechanisms imapc_ssl = no
imapc_ssl_verify = yes
imapc_user import_environment = TZ CORE_OUTOFMEM CORE_ERROR LISTEN_PID
LISTEN_FDS
info_log_path instance_name = dovecot
last_valid_gid = 0
last_valid_uid = 0
lda_mailbox_autocreate = no
lda_mailbox_autosubscribe = no
lda_original_recipient_header libexec_dir = /usr/lib/dovecot
listen = *, ::
lmtp_address_translate lmtp_hdr_delivery_address = final
lmtp_proxy = no
lmtp_rcpt_check_quota = no
lmtp_save_to_detail_mailbox = no
lmtp_user_concurrency_limit = 0
lock_method = fcntl
log_path = syslog
log_timestamp = "%b %d %H:%M:%S "
login_access_sockets login_greeting = Dovecot ready.
login_log_format = %$: %s
login_log_format_elements = user= method=%m rip=%r lip=%l mpid=%e %c 
sessionlogin_plugin_dir = /usr/lib/dovecot/modules/login
login_plugins login_proxy_max_disconnect_delay = 0
login_source_ips login_trusted_networks mail_access_groups
mail_always_cache_fields mail_attachment_dir mail_attachment_fs = sis posix
mail_attachment_hash = %{sha1}
mail_attachment_min_size = 128 k
mail_attribute_dict mail_cache_fields = flags
mail_cache_min_mail_count = 0
mail_chroot mail_debug = no
mail_fsync = optimized
mail_full_filesystem_access = no
mail_gid = vmail
mail_home = /data/vmail/user/%n
mail_location = maildir:/data/vmail/user/%n/Maildir
mail_log_prefix = "%s(%u): "
mail_max_keyword_length = 50
mail_max_lock_timeout = 0
mail_max_userip_connections = 10
mail_never_cache_fields = imap.envelope
mail_nfs_index = no
mail_nfs_storage = no
mail_plugin_dir = /usr/lib/dovecot/modules
mail_plugins mail_prefetch_count = 0
mail_privileged_group mail_save_crlf = yes
mail_server_admin mail_server_comment mail_shared_explicit_inbox = no
mail_temp_dir = /tmp
mail_temp_scan_interval = 1 weeks
mail_uid = vmail
mailbox_idle_check_interval = 30 secs
mailbox_list_index = no
mailbox_list_index_very_dirty_syncs = no
maildir_broken_filename_sizes = no
maildir_copy_with_hardlinks = yes
maildir_empty_new = no
maildir_stat_dirs = no
maildir_very_dirty_syncs = no
managesieve_client_workarounds managesieve_implementation_string = Dovecot
Pigeonhole
managesieve_logout_format = bytes=%i/%o
managesieve_max_compile_errors = 5
managesieve_max_line_length = 65536
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope 
encoded-character vacation subaddress comparator-i;ascii-numeric 
relational regex copy include variables body enotify environment
mailbox 
date index ihave duplicate mime foreverypart extracttext 
vacation-seconds imapflags notify
master_user_separator mbox_dirty_syncs = yes
mbox_dotlock_change_timeout = 2 mins
mbox_lazy_writes = yes
mbox_lock_timeout = 5 mins
mbox_md5 = apop3d
mbox_min_index_size = 0
mbox_read_locks = fcntl
mbox_very_dirty_syncs = no
mbox_write_locks = fcntl dotlock
mdbox_preallocate_space = no
mdbox_purge_preserve_alt = no
mdbox_rotate_interval = 0
mdbox_rotate_size = 2 M
mmap_disable = no
namespace {
?? disabled = no
?? hidden = no
?? ignore_on_failure = no
?? inbox = no
?? list = children
?? location = 
maildir:/data/vmail/user/%%n/Maildir:INDEXPVT=/data/vmail/user/%n/Maildir/Shared/%%n:SUBSCRIPTIONS=../../%n/Maildir/Shared/subscriptions-%%n
?? order = 0
?? prefix = user.%%n.
?? separator = .
?? subscriptions = yes
?? type = shared
}
namespace inbox {
?? disabled = no
?? hidden = no
?? ignore_on_failure = no
?? inbox = yes
?? list = yes
?? location ?? mailbox Archives {
???? auto = no
???? autoexpunge = 0
???? autoexpunge_max_mails = 0
???? comment ???? driver ???? special_use = \Archive
?? }
?? mailbox Drafts {
???? auto = subscribe
???? autoexpunge = 0
???? autoexpunge_max_mails = 0
???? comment ???? driver ???? special_use = \Drafts
?? }
?? mailbox Junk {
???? auto = no
???? autoexpunge = 0
???? autoexpunge_max_mails = 0
???? comment ???? driver ???? special_use = \Junk
?? }
?? mailbox Sent {
???? auto = subscribe
???? autoexpunge = 0
???? autoexpunge_max_mails = 0
???? comment ???? driver ???? special_use = \Sent
?? }
?? mailbox "Sent Messages" {
???? auto = no
???? autoexpunge = 0
???? autoexpunge_max_mails = 0
???? comment ???? driver ???? special_use = \Sent
?? }
?? mailbox Trash {
???? auto = subscribe
???? autoexpunge = 0
???? autoexpunge_max_mails = 0
???? comment ???? driver ???? special_use = \Trash
?? }
?? mailbox spam {
???? auto = subscribe
???? autoexpunge = 0
???? autoexpunge_max_mails = 0
???? comment ???? driver ???? special_use = \Junk
?? }
?? order = 0
?? prefix = INBOX.
?? separator = .
?? subscriptions = yes
?? type = private
}
passdb {
?? args = /etc/dovecot/deny-users
?? auth_verbose = default
?? default_fields ?? deny = yes
?? driver = passwd-file
?? master = no
?? name ?? override_fields ?? pass = no
?? result_failure = continue
?? result_internalfail = continue
?? result_success = return-ok
?? skip = never
}
passdb {
?? args = /etc/dovecot/dovecot-ldap.conf.ext
?? auth_verbose = default
?? default_fields ?? deny = no
?? driver = ldap
?? master = no
?? name ?? override_fields ?? pass = no
?? result_failure = continue
?? result_internalfail = continue
?? result_success = return-ok
?? skip = never
}
plugin {
?? acl = vfile
?? acl_shared_dict = file:/data/vmail/global/shared-mailboxes
?? sieve = 
file:/data/vmail/user/%n/sieve;active=/data/vmail/user/%n/enabled.sieve
?? sieve_extensions = +notify +imapflags -imap4flags
+vacation-seconds
?? sieve_vacation_min_period = 0
}
pop3_client_workarounds pop3_delete_type = default
pop3_deleted_flag pop3_enable_last = no
pop3_fast_size_lookups = no
pop3_lock_session = no
pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s
pop3_no_flag_updates = no
pop3_reuse_xuidl = no
pop3_save_uidl = no
pop3_uidl_duplicates = allow
pop3_uidl_format = %v.%u
pop3c_host pop3c_master_user pop3c_password pop3c_port = 110
pop3c_quick_received_date = no
pop3c_rawlog_dir pop3c_ssl = no
pop3c_ssl_verify = yes
pop3c_user = %u
postmaster_address = postmaster@%d
protocols = " imap lmtp sieve pop3"
quota_full_tempfail = no
rawlog_dir recipient_delimiter = +
rejection_reason = Your message to  was automatically rejected:%n%r
rejection_subject = Rejected: %s
replication_dsync_parameters = -d -N -l 30 -U
replication_full_sync_interval = 1 days
replication_max_conns = 10
replicator_host = replicator
replicator_port = 0
sendmail_path = /usr/sbin/sendmail
service aggregator {
?? chroot = .
?? client_limit = 0
?? drop_priv_before_exec = no
?? executable = aggregator
?? extra_groups ?? fifo_listener replication-notify-fifo {
???? group ???? mode = 0600
???? user ?? }
?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 0
?? process_min_avail = 0
?? protocol ?? service_count = 0
?? type ?? unix_listener replication-notify {
???? group ???? mode = 0600
???? user ?? }
?? user = $default_internal_user
?? vsz_limit = 18446744073709551615 B
}
service anvil {
?? chroot = empty
?? client_limit = 0
?? drop_priv_before_exec = no
?? executable = anvil
?? extra_groups ?? group ?? idle_kill = 4294967295 secs
?? privileged_group ?? process_limit = 1
?? process_min_avail = 1
?? protocol ?? service_count = 0
?? type = anvil
?? unix_listener anvil-auth-penalty {
???? group ???? mode = 0600
???? user ?? }
?? unix_listener anvil {
???? group ???? mode = 0600
???? user ?? }
?? user = $default_internal_user
?? vsz_limit = 18446744073709551615 B
}
service auth-worker {
?? chroot ?? client_limit = 1
?? drop_priv_before_exec = no
?? executable = auth -w
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 0
?? process_min_avail = 0
?? protocol ?? service_count = 1
?? type ?? unix_listener auth-worker {
???? group ???? mode = 0600
???? user = $default_internal_user
?? }
?? user ?? vsz_limit = 18446744073709551615 B
}
service auth {
?? chroot ?? client_limit = 0
?? drop_priv_before_exec = no
?? executable = auth
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 1
?? process_min_avail = 0
?? protocol ?? service_count = 0
?? type ?? unix_listener auth-client {
???? group ???? mode = 0600
???? user = $default_internal_user
?? }
?? unix_listener auth-login {
???? group ???? mode = 0600
???? user = $default_internal_user
?? }
?? unix_listener auth-master {
???? group ???? mode = 0600
???? user ?? }
?? unix_listener auth-userdb {
???? group ???? mode = 0666
???? user = $default_internal_user
?? }
?? unix_listener login/login {
???? group ???? mode = 0666
???? user ?? }
?? unix_listener token-login/tokenlogin {
???? group ???? mode = 0666
???? user ?? }
?? user = $default_internal_user
?? vsz_limit = 18446744073709551615 B
}
service config {
?? chroot ?? client_limit = 0
?? drop_priv_before_exec = no
?? executable = config
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 0
?? process_min_avail = 0
?? protocol ?? service_count = 0
?? type = config
?? unix_listener config {
???? group ???? mode = 0600
???? user ?? }
?? user ?? vsz_limit = 18446744073709551615 B
}
service dict-async {
?? chroot ?? client_limit = 0
?? drop_priv_before_exec = no
?? executable = dict
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 0
?? process_min_avail = 0
?? protocol ?? service_count = 0
?? type ?? unix_listener dict-async {
???? group ???? mode = 0600
???? user ?? }
?? user = $default_internal_user
?? vsz_limit = 18446744073709551615 B
}
service dict {
?? chroot ?? client_limit = 1
?? drop_priv_before_exec = no
?? executable = dict
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 0
?? process_min_avail = 0
?? protocol ?? service_count = 0
?? type ?? unix_listener dict {
???? group ???? mode = 0600
???? user ?? }
?? user = $default_internal_user
?? vsz_limit = 18446744073709551615 B
}
service director {
?? chroot = .
?? client_limit = 0
?? drop_priv_before_exec = no
?? executable = director
?? extra_groups ?? fifo_listener login/proxy-notify {
???? group ???? mode = 00
???? user ?? }
?? group ?? idle_kill = 4294967295 secs
?? inet_listener {
???? address ???? haproxy = no
???? port = 0
???? reuse_port = no
???? ssl = no
?? }
?? privileged_group ?? process_limit = 1
?? process_min_avail = 0
?? protocol ?? service_count = 0
?? type ?? unix_listener director-admin {
???? group ???? mode = 0600
???? user ?? }
?? unix_listener director-userdb {
???? group ???? mode = 0600
???? user ?? }
?? unix_listener login/director {
???? group ???? mode = 00
???? user ?? }
?? user = $default_internal_user
?? vsz_limit = 18446744073709551615 B
}
service dns_client {
?? chroot ?? client_limit = 1
?? drop_priv_before_exec = no
?? executable = dns-client
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 0
?? process_min_avail = 0
?? protocol ?? service_count = 0
?? type ?? unix_listener dns-client {
???? group ???? mode = 0666
???? user ?? }
?? user = $default_internal_user
?? vsz_limit = 18446744073709551615 B
}
service doveadm {
?? chroot ?? client_limit = 1
?? drop_priv_before_exec = no
?? executable = doveadm-server
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 0
?? process_min_avail = 0
?? protocol ?? service_count = 1
?? type ?? unix_listener doveadm-server {
???? group ???? mode = 0600
???? user ?? }
?? user ?? vsz_limit = 18446744073709551615 B
}
service imap-hibernate {
?? chroot ?? client_limit = 0
?? drop_priv_before_exec = no
?? executable = imap-hibernate
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 0
?? process_min_avail = 0
?? protocol = imap
?? service_count = 0
?? type ?? unix_listener imap-hibernate {
???? group ???? mode = 0600
???? user ?? }
?? user = $default_internal_user
?? vsz_limit = 18446744073709551615 B
}
service imap-login {
?? chroot = login
?? client_limit = 0
?? drop_priv_before_exec = no
?? executable = imap-login
?? extra_groups ?? group ?? idle_kill = 0
?? inet_listener imap {
???? address ???? haproxy = no
???? port = 143
???? reuse_port = no
???? ssl = no
?? }
?? inet_listener imaps {
???? address ???? haproxy = no
???? port = 993
???? reuse_port = no
???? ssl = yes
?? }
?? privileged_group ?? process_limit = 0
?? process_min_avail = 10
?? protocol = imap
?? service_count = 0
?? type = login
?? user = $default_login_user
?? vsz_limit = 18446744073709551615 B
}
service imap-urlauth-login {
?? chroot = token-login
?? client_limit = 0
?? drop_priv_before_exec = no
?? executable = imap-urlauth-login
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 0
?? process_min_avail = 0
?? protocol = imap
?? service_count = 1
?? type = login
?? unix_listener imap-urlauth {
???? group ???? mode = 0666
???? user ?? }
?? user = $default_login_user
?? vsz_limit = 18446744073709551615 B
}
service imap-urlauth-worker {
?? chroot ?? client_limit = 1
?? drop_priv_before_exec = no
?? executable = imap-urlauth-worker
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 1024
?? process_min_avail = 0
?? protocol = imap
?? service_count = 1
?? type ?? unix_listener imap-urlauth-worker {
???? group ???? mode = 0600
???? user = $default_internal_user
?? }
?? user ?? vsz_limit = 18446744073709551615 B
}
service imap-urlauth {
?? chroot ?? client_limit = 1
?? drop_priv_before_exec = no
?? executable = imap-urlauth
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 1024
?? process_min_avail = 0
?? protocol = imap
?? service_count = 1
?? type ?? unix_listener token-login/imap-urlauth {
???? group ???? mode = 0666
???? user ?? }
?? user = $default_internal_user
?? vsz_limit = 18446744073709551615 B
}
service imap {
?? chroot ?? client_limit = 1
?? drop_priv_before_exec = no
?? executable = imap
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 2048
?? process_min_avail = 0
?? protocol = imap
?? service_count = 1
?? type ?? unix_listener imap-master {
???? group ???? mode = 0600
???? user ?? }
?? unix_listener login/imap {
???? group ???? mode = 0666
???? user ?? }
?? user ?? vsz_limit = 18446744073709551615 B
}
service indexer-worker {
?? chroot ?? client_limit = 1
?? drop_priv_before_exec = no
?? executable = indexer-worker
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 10
?? process_min_avail = 0
?? protocol ?? service_count = 0
?? type ?? unix_listener indexer-worker {
???? group ???? mode = 0600
???? user = $default_internal_user
?? }
?? user ?? vsz_limit = 18446744073709551615 B
}
service indexer {
?? chroot ?? client_limit = 0
?? drop_priv_before_exec = no
?? executable = indexer
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 1
?? process_min_avail = 0
?? protocol ?? service_count = 0
?? type ?? unix_listener indexer {
???? group ???? mode = 0666
???? user ?? }
?? user = $default_internal_user
?? vsz_limit = 18446744073709551615 B
}
service ipc {
?? chroot = empty
?? client_limit = 0
?? drop_priv_before_exec = no
?? executable = ipc
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 1
?? process_min_avail = 0
?? protocol ?? service_count = 0
?? type ?? unix_listener ipc {
???? group ???? mode = 0600
???? user ?? }
?? unix_listener login/ipc-proxy {
???? group ???? mode = 0600
???? user = $default_login_user
?? }
?? user = $default_internal_user
?? vsz_limit = 18446744073709551615 B
}
service lmtp {
?? chroot ?? client_limit = 1
?? drop_priv_before_exec = no
?? executable = lmtp
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 120
?? process_min_avail = 15
?? protocol = lmtp
?? service_count = 0
?? type ?? unix_listener /var/spool/postfix/private/dovecot-lmtp {
???? group = postfix
???? mode = 0600
???? user = postfix
?? }
?? unix_listener lmtp {
???? group ???? mode = 0666
???? user ?? }
?? user = vmail
?? vsz_limit = 18446744073709551615 B
}
service log {
?? chroot ?? client_limit = 0
?? drop_priv_before_exec = no
?? executable = log
?? extra_groups ?? group ?? idle_kill = 4294967295 secs
?? privileged_group ?? process_limit = 1
?? process_min_avail = 0
?? protocol ?? service_count = 0
?? type = log
?? unix_listener log-errors {
???? group ???? mode = 0600
???? user ?? }
?? user ?? vsz_limit = 18446744073709551615 B
}
service managesieve-login {
?? chroot = login
?? client_limit = 0
?? drop_priv_before_exec = no
?? executable = managesieve-login
?? extra_groups ?? group ?? idle_kill = 0
?? inet_listener sieve {
???? address = 127.0.0.1
???? haproxy = no
???? port = 4190
???? reuse_port = no
???? ssl = no
?? }
?? privileged_group ?? process_limit = 0
?? process_min_avail = 0
?? protocol = sieve
?? service_count = 1
?? type = login
?? user = $default_login_user
?? vsz_limit = 18446744073709551615 B
}
service managesieve {
?? chroot ?? client_limit = 1
?? drop_priv_before_exec = no
?? executable = managesieve
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 0
?? process_min_avail = 0
?? protocol = sieve
?? service_count = 1
?? type ?? unix_listener login/sieve {
???? group ???? mode = 0666
???? user ?? }
?? user ?? vsz_limit = 18446744073709551615 B
}
service pop3-login {
?? chroot = login
?? client_limit = 0
?? drop_priv_before_exec = no
?? executable = pop3-login
?? extra_groups ?? group ?? idle_kill = 0
?? inet_listener pop3 {
???? address ???? haproxy = no
???? port = 110
???? reuse_port = no
???? ssl = no
?? }
?? inet_listener pop3s {
???? address ???? haproxy = no
???? port = 995
???? reuse_port = no
???? ssl = yes
?? }
?? privileged_group ?? process_limit = 0
?? process_min_avail = 0
?? protocol = pop3
?? service_count = 1
?? type = login
?? user = $default_login_user
?? vsz_limit = 18446744073709551615 B
}
service pop3 {
?? chroot ?? client_limit = 1
?? drop_priv_before_exec = no
?? executable = pop3
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 1024
?? process_min_avail = 0
?? protocol = pop3
?? service_count = 1
?? type ?? unix_listener login/pop3 {
???? group ???? mode = 0666
???? user ?? }
?? user ?? vsz_limit = 18446744073709551615 B
}
service replicator {
?? chroot ?? client_limit = 0
?? drop_priv_before_exec = no
?? executable = replicator
?? extra_groups ?? group ?? idle_kill = 4294967295 secs
?? privileged_group ?? process_limit = 1
?? process_min_avail = 0
?? protocol ?? service_count = 0
?? type ?? unix_listener replicator-doveadm {
???? group ???? mode = 00
???? user = $default_internal_user
?? }
?? unix_listener replicator {
???? group ???? mode = 0600
???? user = $default_internal_user
?? }
?? user ?? vsz_limit = 18446744073709551615 B
}
service ssl-params {
?? chroot ?? client_limit = 0
?? drop_priv_before_exec = no
?? executable = ssl-params
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 0
?? process_min_avail = 0
?? protocol ?? service_count = 0
?? type = startup
?? unix_listener login/ssl-params {
???? group ???? mode = 0666
???? user ?? }
?? unix_listener ssl-params {
???? group ???? mode = 0666
???? user ?? }
?? user ?? vsz_limit = 18446744073709551615 B
}
service stats {
?? chroot = empty
?? client_limit = 0
?? drop_priv_before_exec = no
?? executable = stats
?? extra_groups ?? fifo_listener stats-mail {
???? group ???? mode = 0600
???? user ?? }
?? fifo_listener stats-user {
???? group ???? mode = 0600
???? user ?? }
?? group ?? idle_kill = 4294967295 secs
?? privileged_group ?? process_limit = 1
?? process_min_avail = 0
?? protocol ?? service_count = 0
?? type ?? unix_listener stats {
???? group ???? mode = 0600
???? user ?? }
?? user = $default_internal_user
?? vsz_limit = 18446744073709551615 B
}
service tcpwrap {
?? chroot ?? client_limit = 1
?? drop_priv_before_exec = no
?? executable = tcpwrap
?? extra_groups ?? group ?? idle_kill = 0
?? privileged_group ?? process_limit = 0
?? process_min_avail = 0
?? protocol ?? service_count = 0
?? type ?? user = $default_internal_user
?? vsz_limit = 18446744073709551615 B
}
shutdown_clients = yes
ssl = required
ssl_ca ssl_cert -------------- next part --------------
An HTML attachment was scrubbed...
URL:
<https://dovecot.org/pipermail/dovecot/attachments/20200907/5e4edd7b/attachment-0001.html>

Miloslav Hůla

2020-Sep-08 09:25 UTC

head link

Btrfs RAID-10 performance

Thanks for the tips!

Dne 07.09.2020 v 15:24 Scott Q. napsal(a):> 1. I assume that's a 2U format -24 bays.?You only have 1 raid card for 
> all 24 disks ? Granted you only have 16, but usually you should assign 1 
> card per 8 drives. In our standard 2U chassis we have 3 hba's per 8 
> drives. Your backplane should support that.
Exactly. And what's the reason/bottleneck? PCIe or card throughput?
> 2. Add more drives
We can add 2 next drives, and we actually did yesterday, but we keep 
free slots to be able replace drives by double-capacity ones.
> 3. Get a pci nvme ssd card and move the indexes/control/sieve files there.
It complicates current backup and restore a little bit, but I'll 
probably try that.

Thank you,
Milo

> On Monday, 07/09/2020 at 08:16 Miloslav H?la wrote:
> 
>     Dne 07.09.2020 v 12:43 Sami Ketola napsal(a):
>      >> On 7. Sep 2020, at 12.38, Miloslav H?la <miloslav.hula at
gmail.com
>     <mailto:miloslav.hula at gmail.com>> wrote:
>      >>
>      >> Hello,
>      >>
>      >> I sent this into the Linux Kernel Btrfs mailing list and I
got
>     reply: "RAID-1 would be preferable"
>    
(https://lore.kernel.org/linux-btrfs/7b364356-7041-7d18-bd77-f60e0e2e2112 at
lechevalier.se/T/).
>     May I ask you for the comments as from people around the Dovecot?
>      >>
>      >>
>      >> We are using btrfs RAID-10 (/data, 4.7TB) on a physical
>     Supermicro server with Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz and
>     125GB of RAM. We run 'btrfs scrub start -B -d /data' every
Sunday as
>     a cron task. It takes about 50 minutes to finish.
>      >>
>      >> # uname -a
>      >> Linux imap 4.9.0-12-amd64 #1 SMP Debian 4.9.210-1
(2020-01-20)
>     x86_64 GNU/Linux
>      >>
>      >> RAID is a composition of 16 harddrives. Harddrives are
connected
>     via AVAGO MegaRAID SAS 9361-8i as a RAID-0 devices. All harddrives
>     are SAS 2.5" 15k drives.
>      >>
>      >> Server serves as a IMAP with Dovecot 2.2.27-3+deb9u6, 4104
>     accounts, Mailbox format, LMTP delivery.
>      >
>      > does "Mailbox format" mean mbox?
>      >
>      > If so, then there is your bottleneck. mbox is the slowest
>     possible mailbox format there is.
>      >
>      > Sami
> 
>     Sorry, no, it is a typo. We are using "Maildir".
> 
>     "doveconf -a" attached
> 
>     Milo

Seemingly Similar Threads

Search for more seemingly similar threads

dovecot - Sep 2020 - Btrfs RAID-10 performance

Btrfs RAID-10 performance

Btrfs RAID-10 performance

Btrfs RAID-10 performance

Seemingly Similar Threads